KR102131830B1 - Mobile terminal and controlling method thereof - Google Patents

Abstract

According to the present invention, when a first face image including a camera and a display unit for displaying an image input through the camera and face elements necessary for first user authentication is input through the camera, the first face image is based on When the first user authentication is performed, and a second face image lacking some of the face elements required for the first user authentication is input, at least one of the face elements that can be derived from the second face image is used. It can provide a mobile terminal comprising a control unit for performing a second user authentication.
In addition, according to the present invention, through the camera for any one of the first face image including the face elements necessary for the first user authentication and the second face image lacking some of the face elements required for the first user authentication Receiving an input and displaying an image input through the camera; and
When the first face image is input, the first user authentication is performed based on the first face image, and when the second face image is input, face elements that can be derived from the second face image It may provide a control method of a mobile terminal including the step of performing a second user authentication using at least one of.

Description

Mobile terminal and its control method {MOBILE TERMINAL AND CONTROLLING METHOD THEREOF}

The present invention relates to a mobile terminal capable of user authentication through a camera and a control method thereof.

Terminals can be divided into mobile terminals (mobile/portable terminals) and stationary terminals according to their mobility. Again, the mobile terminal may be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry it.

As the functions of the terminal are diversified, for example, in the form of a multimedia player equipped with complex functions such as taking a picture or a video, playing music or a video file, receiving a game, or broadcasting, etc. Is being implemented.

In particular, as the functions of the mobile terminal are diversified, an authentication function using the user's personal information such as purchase of products, various credit payments, and access to a site requiring security is also performed through the mobile terminal. However, when user authentication is performed by inputting personal information as described above, security problems such as leakage of user personal information may occur, and inconveniences such as password entry into various certificates may occur.

In order to support and increase the functions of the aforementioned mobile terminal, it may be considered to improve the structural portion and/or software portion of the mobile terminal.

For convenience of use and security of safety, application of a user authentication method using a unique body element such as a user's fingerprint, iris, and face has been attempted for a mobile terminal. To this end, a recognition module for a user's body element is added in hardware to a mobile terminal, and attempts have been made to improve software for operating it.

However, even if such a user authentication method is applied, there is a problem in that the recognition rate is not constant according to the use environment. In addition, in order to increase the recognition rate, when the user's body needs to be brought into close proximity to the mobile terminal within a predetermined range, the user may feel a sense of rejection according to personal preference.

An object of the present invention is to provide a mobile terminal capable of performing user authentication using a user's body element, and a control method thereof, as proposed to meet the above-mentioned needs.

More specifically, an object of the present invention is to provide a mobile terminal capable of performing different authentication methods according to a distance between a user attempting user authentication and a mobile terminal.

In addition, an object of the present invention is to provide a mobile terminal equipped with an infrared light emitting unit and capable of recognizing a user's iris through a camera when infrared light is emitted through the infrared light emitting unit.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by a person having ordinary knowledge in the technical field to which the present invention belongs from the following description. Will be able to.

In order to achieve the above object, the present invention provides a first face image including a camera, a display unit displaying an image input through the camera, and face elements required for first user authentication through the camera. When the first user authentication is performed based on the face image and a second face image lacking some of the face elements required for the first user authentication is input, among the face elements that can be derived from the second face image And a control unit for performing second user authentication using at least one.

In addition, the present invention may input an input to any one of a first face image including face elements required for first user authentication and a second face image lacking some of the face elements required for first user authentication through a camera. Receiving, displaying an image input through the camera, and when the first face image is input, performs the first user authentication based on the first face image, and inputs the second face image If it is possible, it may provide a control method of a mobile terminal including performing a second user authentication using at least one of the face elements that can be derived from the second face image.

The technical solutions that can be obtained in the present invention are not limited to the above-mentioned solutions, and other solutions that are not mentioned are clearly understood by those skilled in the art from the following description. Will be understandable.

The effects of the mobile terminal and its control method according to the present invention are as follows.

According to at least one of the embodiments of the present invention, the mobile terminal of the present invention does not need to use the user's password for user authentication, so there is no risk of leakage of personal information, and the user has to manually remember and enter the password. Less.

In addition, according to at least one of the embodiments of the present invention, different user authentication methods are performed according to a distance at which a user performs user authentication through a mobile terminal, thereby maximizing convenience in use. Specifically, a user body element recognized according to a distance between the mobile terminal and the user may be different. According to the present invention, a user authentication method may be performed according to an authentication method corresponding to a user body element recognized by the mobile terminal. . Therefore, as a user, it is not necessary to set the user authentication method in advance or to move the mobile terminal close to increase the recognition rate of the user's body elements.

In addition, according to at least one of the embodiments of the present invention, the mobile terminal of the present invention further includes an infrared light emitting unit, thereby allowing the user to recognize the iris of the user through an existing camera, thereby additionally providing a camera for iris recognition. When equipped, it is possible to save costs.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description. will be.

1 is a block diagram illustrating a mobile terminal related to the present invention.
2 and 3 are conceptual views of an example of a mobile terminal related to the present invention viewed from different directions.
4 is an operation flowchart of a mobile terminal according to an embodiment of the present invention.
5 is an exemplary view for explaining a user authentication method using a user face applied to a mobile terminal according to an embodiment of the present invention.
6 is an exemplary view for explaining a user authentication method using a part of a user's face applied to a mobile terminal according to an embodiment of the present invention.
7 is an exemplary view for explaining an infrared light emitting unit of a mobile terminal according to an embodiment of the present invention.
8 is an exemplary view for explaining a wavelength of light recognized by a camera of a mobile terminal according to an embodiment of the present invention.
9 is a graph for explaining an infrared pass filter provided in the camera of a mobile terminal according to an embodiment of the present invention.
10 is an exemplary view for explaining a user authentication method using a part selected from a user applied to a mobile terminal according to an embodiment of the present invention.
11 is an exemplary view for explaining a case in which a part of a user's face selected from a user according to an embodiment of the present invention is used for user authentication.
12 is an exemplary view for explaining a case of releasing a touch screen lock state of a mobile terminal using a user authentication method according to an embodiment of the present invention;
13 is an exemplary view for explaining camera activation and performing user authentication when user authentication of a mobile terminal according to an embodiment of the present invention is required.
14 is an exemplary view for explaining first information displayed on a display unit of an authentication result according to a first user authentication method according to an embodiment of the present invention.
15 is an exemplary view for explaining the second information displayed on the display of the authentication result according to the second user authentication method according to an embodiment of the present invention.

Hereinafter, exemplary embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar elements are assigned the same reference numbers regardless of the reference numerals, and overlapping descriptions thereof will be omitted. The suffixes "modules" and "parts" for components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles that are distinguished from each other. In addition, in describing the embodiments disclosed in this specification, detailed descriptions of related well-known technologies are omitted when it is determined that they may obscure the gist of the embodiments disclosed herein. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed in the specification is not limited by the accompanying drawings, and all modifications included in the spirit and technical scope of the present invention , It should be understood to include equivalents or substitutes.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from other components.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

Mobile terminals described herein include mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation, and slate PCs. , Tablet PC (tablet PC), ultrabook (ultrabook), wearable device (wearable device, for example, a watch-type terminal (smartwatch), glass-type terminal (smart glass), HMD (head mounted display), etc. may be included have.

However, the configuration according to the embodiment described in the present specification can be easily recognized by those skilled in the art that it may be applied to a fixed terminal such as a digital TV, a desktop computer, and a digital signage, except when applicable only to a mobile terminal. will be.

1 is a block diagram illustrating a mobile terminal related to the present invention, and FIGS. 2 and 3 are conceptual views of an example of a mobile terminal related to the present invention viewed from different directions.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a detection unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, and a power supply unit 190 ) And the like. The components shown in FIG. 1 are not essential for implementing a mobile terminal, so the mobile terminal described herein may have more or fewer components than those listed above.

More specifically, among the above components, the wireless communication unit 110 moves between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or different from the mobile terminal 100. The terminal 100, or an external server, may include one or more modules that enable wireless communication between networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The input unit 120 may include a camera 121 for inputting a video signal or a video input unit, a microphone for inputting an audio signal (microphone 122), or an audio input unit, a user input unit 123 for receiving information from a user, for example , A touch key, a mechanical key, and the like. The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 includes a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity G-sensor, gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor), fingerprint scan sensor, ultrasonic sensor , Optical sensor (e.g. camera (see 121)), microphone (see 122), battery gage, environmental sensor (e.g. barometer, hygrometer, thermometer, radioactivity sensor, heat Detection sensors, gas detection sensors, etc.), chemical sensors (eg, electronic nose, health care sensors, biometric sensors, etc.), on the other hand, the mobile terminal disclosed herein, such sensors, these sensors Among them, information sensed by at least two or more sensors may be used in combination.

The output unit 150 is for generating output related to vision, hearing, or tactile sense, and includes at least one of a display unit 151, an audio output unit 152, a hap tip module 153, and an optical output unit 154 can do. The display unit 151 may form a mutual layer structure with the touch sensor or may be integrally formed, thereby realizing a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user, and at the same time, provide an output interface between the mobile terminal 100 and the user.

The interface unit 160 serves as a passage with various types of external devices connected to the mobile terminal 100. The interface unit 160 connects a device equipped with a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In the mobile terminal 100, in response to an external device being connected to the interface unit 160, appropriate control related to the connected external device may be performed.

The memory 170 may store a number of application programs (application programs) driven in the mobile terminal 100, data for operating the mobile terminal 100, and instructions. At least some of these applications can be downloaded from external servers via wireless communication. In addition, at least some other of these application programs may exist on the mobile terminal 100 from the time of shipment for basic functions of the mobile terminal 100 (for example, an incoming call, a calling function, a message reception, and a calling function). . Meanwhile, the application program may be stored in the memory 170 and installed on the mobile terminal 100 to be driven by the controller 180 to perform an operation (or function) of the mobile terminal.

The controller 180 controls the overall operation of the mobile terminal 100 in addition to the operations related to the application program. The controller 180 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 170.

In addition, the controller 180 may control at least some of the components discussed with reference to FIG. 1 to drive an application program stored in the memory 170. Furthermore, the controller 180 may operate by combining at least two or more of the components included in the mobile terminal 100 to operate the application program.

Under the control of the controller 180, the power supply unit 190 receives external power and internal power to supply power to each component included in the mobile terminal 100. The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the components may operate in cooperation with each other to implement an operation, control, or control method of a mobile terminal according to various embodiments described below. Also, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170.

Hereinafter, before looking at various embodiments implemented through the mobile terminal 100 described above, the components listed above will be described in more detail with reference to FIG. 1.

First, referring to the wireless communication unit 110, the broadcast reception module 111 of the wireless communication unit 110 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast reception modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or switching of broadcast channels for at least two broadcast channels.

The mobile communication module 112 includes technical standards or communication methods for mobile communication (eg, Global System for Mobile Communication (GSM), Code Division Multi Access (CDMA), Wideband CDMA (WCDMA), High Speed for HSDPA) Downlink Packet Access (LTE, Long Term Evolution (LTE), etc.) transmits and receives wireless signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network.

The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or external to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, WLAN (Wireless LAN), WiFi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink) Packet Access), LTE (Long Term Evolution), and the like, and the wireless Internet module 113 transmits and receives data according to at least one wireless Internet technology in a range including Internet technologies not listed above.

In view of the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, etc., through the mobile communication network, the wireless Internet module 113 performing wireless Internet access through the mobile communication network is the mobile communication module It may be understood as a kind of (112).

The short-range communication module 114 is for short-range communication, Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, NFC (Near Field Communication), by using at least one of Wi-Fi (Wireless-Fidelity), Wi-Fi Direct technology, it can support short-range communication. The short-range communication module 114 may be provided between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or through a mobile personal area networks. It is possible to support wireless communication between the (100) and another mobile terminal (100, or an external server) network.

Here, the other mobile terminal 100 is a wearable device (for example, a smart watch), smart glasses capable of exchanging data (or interoperable) with the mobile terminal 100 according to the present invention. (smart glass), HMD (head mounted display). The short-range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. Furthermore, when the sensed wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the controller 180 may include at least a portion of data processed by the mobile terminal 100, and the short-range communication module ( 114) to the wearable device. Accordingly, a user of the wearable device can use data processed by the mobile terminal 100 through the wearable device. For example, according to this, the user performs a phone call through the wearable device when a call is received by the mobile terminal 100 or, when a message is received by the mobile terminal 100, the received message through the wearable device It is possible to check the message.

The location information module 115 is a module for acquiring a location (or current location) of a mobile terminal, and typical examples thereof include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the mobile terminal utilizes a GPS module, the location of the mobile terminal can be obtained using a signal sent from a GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, the location of the mobile terminal may be obtained based on information of a Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal.

Next, looking at the input unit 120 in more detail, the input unit 120 is for input of image information (or signals), audio information (or signals), or information input from a user, and inputs image information. To this end, the mobile terminal 100 may include one or a plurality of cameras 121. The camera 121 processes image frames such as still images or moving pictures obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151. Meanwhile, the plurality of cameras 121 provided in the mobile terminal 100 may be arranged to form a matrix structure, and through the camera 121 forming the matrix structure, various angles or focuses may be applied to the mobile terminal 100. A plurality of image information may be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire left and right images for realizing a stereoscopic image.

The microphone 122 processes external sound signals as electrical voice data. The processed voice data may be used in various ways according to a function (or a running application program) being performed by the mobile terminal 100. Meanwhile, various noise cancellation algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122.

The user input unit 123 is for receiving information from a user. When information is input through the user input unit 123, the controller 180 may control the operation of the mobile terminal 100 to correspond to the input information. . The user input unit 123 is a mechanical input means (or a mechanical key, for example, a button located on the front, rear or side of the mobile terminal 100, a dome switch, a jog wheel, Jog switch, etc.) and a touch input means. As an example, the touch-type input means is made of a virtual key, a soft key or a visual key displayed on the touch screen through software processing, or a part other than the touch screen It may be made of a touch key (touch key) disposed on. Meanwhile, the virtual key or the visual key may be displayed on the touch screen while having various forms, for example, a graphic, text, icon, video, or the like. It can be made of a combination of.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a sensing signal corresponding thereto. The controller 180 may control driving or operation of the mobile terminal 100 based on the sensing signal, or perform data processing, function, or operation related to an application program installed in the mobile terminal 100. The representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object in the vicinity using mechanical force or infrared light without mechanical contact. The proximity sensor 141 may be provided with the proximity sensor 141 in the inner region of the mobile terminal or the proximity of the touch screen surrounded by the touch screen as described above. The proximity sensor 141 has a longer lifespan and a higher utilization than the contact sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the proximity sensor 141 may be configured to detect the proximity of the object with a change in electric field according to the proximity of the conductive object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of description, the act of allowing the object to be recognized as being located on the touch screen without being touched on the touch screen is called "proximity touch", and the touch The act of actually touching an object on the screen is called "contact touch". The location where an object is touched close on the touch screen refers to a location where the object is perpendicular to the touch screen when the object is touched close. The proximity sensor 141 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). have. Meanwhile, as described above, the controller 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern detected through the proximity sensor 141, and further, visual information corresponding to the processed data. It can be output on the touch screen. Furthermore, the controller 180 may control the mobile terminal 100 such that different operations or data (or information) are processed according to whether a touch on the same point on the touch screen is a proximity touch or a touch touch. .

The touch sensor detects a touch (or touch input) applied to the touch screen (or display unit 151) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. do.

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific part of the touch screen or capacitance generated in the specific part into an electrical input signal. The touch sensor may be configured to detect a position, area, pressure when a touch object is touched on the touch screen, and the like. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen or a stylus pen, a pointer, and the like.

As such, when there is a touch input to the touch sensor, the signal(s) corresponding to the touch is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180. Accordingly, the control unit 180 can know which area of the display unit 151 has been touched, and the like. Here, the touch controller may be a separate component from the controller 180, or may be the controller 180 itself.

Meanwhile, the controller 180 may perform different controls or perform the same control according to the type of the touch object that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different control or the same control according to the type of the touch object, it may be determined according to the current operating state of the mobile terminal 100 or the running application program.

On the other hand, the touch sensors and proximity sensors described above can be independently or in combination, such as short (or tap) touch on the touch screen, long touch, multi touch, drag touch ), flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, etc. You can sense the touch.

The ultrasonic sensor may recognize location information of a sensing target using ultrasonic waves. Meanwhile, the control unit 180 may calculate the position of the wave generating source through information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave generator can be calculated by using a property in which light is much faster than ultrasonic waves, that is, a time when light reaches the optical sensor is much faster than a time when ultrasonic waves reach the ultrasonic sensor. More specifically, the position of the wave generating source may be calculated by using a time difference from the time at which ultrasonic waves reach the light as a reference signal.

On the other hand, the camera 121, which is considered as the configuration of the input unit 120, is a type of camera sensor, and the camera sensor includes at least one of a camera 121, a photo sensor, and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photo sensor may be stacked on a display element, which is configured to scan the movement of the sensing object close to the touch screen. More specifically, the photo sensor mounts photo diodes and TRs (transistors) in rows/columns to scan the contents placed on the photo sensor using electrical signals that change according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the sensing target according to the amount of change of light, and through this, location information of the sensing target may be obtained.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100, or user interface (UI) or graphical user interface (GUI) information according to the execution screen information. .

In addition, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glasses-free method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

The audio output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, or the like. The sound output unit 152 may also output sound signals related to functions (for example, call signal reception sound, message reception sound, etc.) performed by the mobile terminal 100. The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 153 may be vibration. The intensity and pattern of vibration generated in the haptic module 153 may be controlled by a user's selection or setting of a control unit. For example, the haptic module 153 may synthesize different vibrations and output them sequentially or sequentially.

In addition to vibration, the haptic module 153 is suitable for stimulation of pin arrangements that vertically move to the contact skin surface, spray or suction power of air through a spray or intake, grazing on the skin surface, contact of an electrode, and electrostatic force. Various tactile effects can be generated, such as the effect of the product and the effect of reproducing the feeling of cold and warm using an element capable of absorbing heat or generating heat.

The haptic module 153 may not only deliver a tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through muscle sensations such as fingers or arms. Two or more haptic modules 153 may be provided according to a configuration aspect of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events occurring in the mobile terminal 100 may include receiving messages, receiving call signals, missed calls, alarms, schedule notifications, receiving emails, and receiving information through applications.

The signal output by the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear. The signal output may be terminated by the mobile terminal detecting the user's event confirmation.

The interface unit 160 serves as a passage with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device, receives power, transfers it to each component inside the mobile terminal 100, or allows data inside the mobile terminal 100 to be transmitted to the external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module (port), an audio input/output (I/O) port, a video input/output (I/O) port, an earphone port, and the like may be included in the interface unit 160.

On the other hand, the identification module is a chip that stores various information for authenticating the usage rights of the mobile terminal 100, a user identification module (UIM), a subscriber identity module (SIM), universal user authentication It may include a module (universal subscriber identity module; USIM). The device provided with the identification module (hereinafter referred to as an'identification device') may be manufactured in a smart card format. Accordingly, the identification device may be connected to the terminal 100 through the interface unit 160.

In addition, when the mobile terminal 100 is connected to an external cradle, the interface unit 160 becomes a passage through which power from the cradle is supplied to the mobile terminal 100 or is input by the user from the cradle. Various command signals may be passages to the mobile terminal 100. Various command signals or power inputted from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input/output data (eg, a phone book, a message, a still image, a video, etc.). The memory 170 may store data related to various patterns of vibration and sound output when a touch is input on the touch screen.

The memory 170 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.), RAM. (random access memory; RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic It may include a storage medium of at least one type of a disc and an optical disc. The mobile terminal 100 may be operated in connection with a web storage performing a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the controller 180 controls the operation related to the application program and the overall operation of the mobile terminal 100 in general. For example, if the state of the mobile terminal satisfies a set condition, the controller 180 may execute or release a lock state that limits the input of a user's control command to applications.

In addition, the controller 180 performs control and processing related to voice calls, data communication, video calls, etc., or performs pattern recognition processing capable of recognizing handwriting input or picture drawing input performed on a touch screen as text and images, respectively. Can. Furthermore, in order to implement various embodiments described below on the mobile terminal 100 according to the present invention, the controller 180 may control any one or a combination of the above-described components.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power required for the operation of each component. The power supply unit 190 includes a battery, and the battery may be a built-in battery made to be rechargeable, and may be detachably coupled to a terminal body for charging and the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 to which an external charger that supplies power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery wirelessly without using the connection port. In this case, the power supply unit 190 uses one or more of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission device or a magnetic resonance coupling method based on an electromagnetic resonance phenomenon. Power can be delivered.

Meanwhile, various embodiments below may be implemented in a recording medium readable by a computer or a similar device using, for example, software, hardware, or a combination thereof.

2 and 3, the disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited to this, and may be applied to various structures such as a watch type, a clip type, a glass type, or a folder type, a flip type, a slide type, a swing type, a swivel type to which two or more bodies are movably coupled. .

Furthermore, since the mobile terminal 100 according to the present invention can be more easily implemented when the display unit 151 is a touch screen, it is assumed hereafter that the display unit 151 is a touch screen.

In this specification, the first face image. The face image of the person input to the camera 121 of the mobile terminal 100 means, in particular, the first face image means an image including the entire face element for face recognition compared to the second face image to be described later. The first face image may include facial elements of a person's face, eyebrows, both eyes or one eye, nose and mouth. Also, the first face image may be an image that additionally includes other elements such as a person's ear and chin as face elements.

The controller 180 may perform user authentication of the mobile terminal 100 based on the first face image recognized through the camera 121, and the first user authentication may be performed based on the first face image. It is said.

That is, when the first face image of the person is input through the camera 121, the controller 180 recognizes the face of the person by distinguishing it from the background, and the person corresponding to the face image through the face element on the first face image You can determine if you are a user. At this time, the controller 180 may perform the first user authentication based on a preset face element according to a user or manufacturer setting.

That is, the controller 180 may not use all of the above-described face elements as a factor for user authentication, but may perform first user authentication based on a preset face element. For example, when the user sets both eyes and nose among the face elements on the first face image as a factor for performing the first user authentication, the controller 180 may control the shape of each eye on the first face image, each The first user authentication may be performed by recognizing the distance between the eyes, the shape of the nose, and the distance between the nose and both eyes. However, since the first user authentication is performed through face recognition, it is assumed that there are a plurality of preset face elements for the first user authentication.

In particular, in order to improve recognition rate and accuracy in user authentication, in some cases, the user may set all face elements on the first face image as a factor for first user authentication.

In the present specification, the second face image. It means an image that lacks some of the face elements necessary for the first user authentication. In particular, the second face image may be a partial image of a face input through the camera 121, or may include some of the face elements on the first face image. Also, the second face image may be an image that lacks some of the face elements preset for the first user authentication.

That is, among the face elements included in the first face image, a plurality of preset face elements are used for first user authentication. If the input image lacks some of the plurality of face elements, the controller 180 inputs The image can be recognized as a second face image.

For example, it is assumed that both eyes, nose, and mouth of a person are included as face elements on the first face image, and that the face elements preset as the factors for the first user authentication are both eyes and nose. At this time, if the distance between the user's face and the camera 12! of the mobile terminal 100 is close, some of the first face images may be input through the camera 121.

In particular, at this time, some of the input images may be images in which the mouth and one eye are excluded among the face elements on the first face image. That is, the face elements for the first user authentication are both eyes and nose, and a face image including one eye and nose lacking some of the face elements of both eyes may be the second face image of the present invention. Alternatively, in the above example, the face image including both eyes or one eye except the nose may be the second face image of the present invention. Alternatively, in the above example, an image in which both eyes are excluded and only the nose is included may be the second image of the present invention.

When the second face image is input, the controller 180 can perform the second user authentication using at least one of the face elements that can be derived from the second face image. That is, in the above example, when the second face image includes one eye and nose of the face element, the controller 180 may perform user authentication using at least one of the one eye and nose.

If the controller 180 performs user authentication using only one eye, the controller 180 may recognize the iris of one eye and perform user authentication. That is, the controller 180 may recognize the iris as a face element on the input image and compare the stored iris pattern to perform user authentication. The user authentication performed by the controller 180 using the second face image as described above is referred to as second user authentication.

As described above, when some of the face elements for the first user authentication are missing on the second face image input through the camera 121, the remaining elements other than the missing one of the face elements for the first user authentication are excluded. Whether to perform user authentication using all face elements on the second face image or user authentication using only specific face elements may be determined according to a user or manufacturer's setting.

In addition, when performing user authentication using only a specific face element, it may also be determined according to a user or a manufacturer's setting whether to recognize a face element among the recognized face elements or to perform user authentication preferentially.

On the other hand, the case where the second face image is an image in which some of the face elements for the first user authentication are lacking is described, but in some cases, the image in which all of the face elements for the first user authentication is missing also has the second face image. Can be.

In the above example, when the face image input through the camera 121 includes only the user's mouth as a face element, the second face image is an image including the mouth among the face elements, and the controller 180 uses the face element mouth Second user authentication may be performed.

Hereinafter, the present invention will be described in detail with reference to FIGS. 4 to 15.

4 is an operation flowchart of a mobile terminal according to an embodiment of the present invention. In addition, FIG. 5 is an exemplary view for explaining a user authentication method using a user face applied to a mobile terminal according to an embodiment of the present invention, and FIG. 6 is one of user faces applied to a mobile terminal according to an embodiment of the present invention It is an example for explaining the user authentication method using a part.

Referring to FIG. 4, the controller 180 may control the camera 121 to be activated for user authentication (401). For user authentication, an example when the controller 180 activates the camera 121 will be described later in the description of FIGS. 12 and 13.

In (a) of FIG. 5, a case is illustrated in which the user 500 is holding the mobile terminal 100 at a predetermined distance. When a user's face image is input through the camera 121 activated at the predetermined distance, the controller 180 distinguishes the input face image from the background image, and determines whether the input face image corresponds to the first face image It can be done (403). That is, the controller 180 may recognize a face element on the face image input through the camera 121 and determine whether the input face image includes a face element for first user authentication. In this case, the controller 180 may control the input first face image 505 to be displayed through the display unit 151.

Referring to (b) of FIG. 5, the controller 180 may perform the first user authentication based on the first face image 505 (405).

Specifically, the controller 180 extracts a preset face element from among face elements on the first face image 505 as a factor for first user authentication, and whether the extracted factor corresponds to a face element of a previously registered user. I can judge. The controller 180 may determine an area 515 including a face element for pre-set first user authentication among the first face images 505, and the focus of the camera 121 may be focused on the area 515. It can also be controlled to be adjusted. By adjusting the focus, the recognition rate may be increased in the face recognition performed by the controller 180 for user authentication.

For example, when both eyes, nose, and mouth are preset as face elements for the first user authentication, the controller 180 determines the region 515 including both eyes, nose, and mouth, and the region 515 ) Can recognize the shape, position, and distance between the face elements of each face element on the image. Based on the recognition result, the controller 180 may determine whether the input first face image corresponds to a pre-registered user face element.

As a result of the determination, when the extracted factor corresponds to the face element of the user registered in advance, the controller 180 may control the first user authentication to be performed. When the first user authentication is completed, the possible execution of the mobile terminal 100 of the control unit 180 and the execution of various applications performed through the mobile terminal 100 will be described later in the description of FIGS. 12 and 13.

Meanwhile, in step 403, a case in which the input face image is not the first face image will be described.

In (a) of FIG. 6, a case is illustrated in which the user 500 is holding the mobile terminal 100 at a predetermined distance. In particular, in FIG. 6(a), a case in which the distance between the mobile terminal 100 and the user 500 is closer than the distance in FIG. 5(a) is illustrated.

In such a case, a second face image other than the first face image as shown in FIG. 5B may be input through the activated camera 121. That is, when the distance between the mobile terminal 100 and the user 500 is close, a second face image lacking some of the face elements required for first user authentication may be input through the camera 121.

The controller 180 may determine whether the input face image corresponds to the second face image (407 ). That is, the controller 180 may recognize a face element on the face image input through the camera 121, and may recognize that the input face image lacks some of the face elements for first user authentication.

For example, as illustrated in FIG. 5, it is assumed that among the face elements on the first face image 505, the preset face elements for first user authentication are both eyes, nose, and mouth. When the face image 605 of the user 500 is input, the controller 180 can recognize that a second face image 605 that does not include one eye among both eyes as a face element is input.

In this case, the controller 180 may control the input second face image 605 to be displayed through the display unit 151.

Referring to FIG. 6B, the controller 180 may perform second user authentication based on the second face image 605 (409 ). In particular, in the above example, as the second face image 605 from which one eye is excluded is input, the controller 180 may recognize that the first user authentication is impossible. Accordingly, the controller 180 may perform second user authentication using at least one of the face elements that can be derived from the input second face image 605.

A case where a user's iris is preset as a face element for second user authentication among face elements to be derived from the second face image 605 will be described as an example. The control unit 180 may determine an area 610 including a face element for pre-set second user authentication, and control the focus of the camera 121 to be adjusted around the area 610. The controller 180 may recognize the user's iris using the camera 121 and determine whether the recognized iris corresponds to the iris pattern of a previously registered user.

As a result of the determination, when the recognized iris corresponds to the iris pattern of the user registered in advance, the controller 180 may control the second user authentication to be performed. When the second user authentication is completed, the possible execution of the mobile terminal 100 of the controller 180 and the execution of various applications performed through the mobile terminal 100 will be described later in the description of FIGS. 12 and 13.

Meanwhile, when the second face image 606 is not input, the controller 180 may control the camera 121 to be activated 401 when a user input is detected or a request for user authentication is detected.

Hereinafter, an operation of the camera 121 for iris recognition will be described in detail with reference to FIGS. 7 to 9.

7 is an exemplary view for explaining an infrared light emitting unit of a mobile terminal according to an embodiment of the present invention. In addition, FIG. 8 is an exemplary view for explaining a wavelength of light recognized by a camera of a mobile terminal according to an embodiment of the present invention, and FIG. 9 is an infrared pass filter provided in the camera of a mobile terminal according to an embodiment of the present invention It is a graph for explaining.

7A is an exemplary diagram for explaining the configuration of equipment for recognizing the iris 510 of the user 500. In (a) of FIG. 7, a camera 720 and an infrared pass filter 725 and an infrared light source 730 are illustrated as equipment for iris 510 recognition.

The iris 510 recognition increases when the iris 510 is exposed to the infrared light source and the visible light is removed. Therefore, when the iris 510 is exposed to the infrared light source 730, it is common for the camera 720 to recognize the pattern of the iris 510 while the visible light is removed through the infrared pass filter 725. In particular, since the infrared pass filter 725 is physically coupled to the camera 720, a separate camera 720 is required in addition to the camera 121 of the mobile terminal 100 through which visible light is passed for iris recognition.

However, referring to FIG. 7B, a mobile terminal 100 capable of iris recognition is proposed using a camera 121 that passes visible light.

Referring to FIG. 7B, the mobile terminal 100 of the present invention may include an infrared light emitting unit 735 adjacent to the camera 121. When the iris recognition method is used as the user authentication method, the controller 180 can control the infrared light to be emitted through the infrared light emitting unit 735. When the infrared light is emitted through the infrared light emitting unit 735, the controller 180 can control the user's iris to be recognized through the camera 121.

Meanwhile, in general, the camera 121 passes through the visible light region 800 of FIG. 8, and the infrared region 810 may include a filter to block. In addition, in the case of the iris recognition camera 720 and the infrared pass filter 725 illustrated in FIG. 7A, the infrared region 810 of FIG. 8 passes through, and the visible ray region 800 is blocked.

In FIG. 9A, a general filter of the camera 121 is illustrated as an example.

The region 900 corresponds to a region that receives light from the visible light region 800 of FIG. 8. However, the camera 121 of the present invention may include an improved filter to pass the infrared region 810 of FIG. 8 through the region 910 as shown by way of example in FIG. 9B. The camera 121 may additionally sense infrared light in addition to visible light using an improved filter.

When such an improved filter is provided, when infrared rays are emitted through the infrared light emitting unit 735, the emitted infrared rays are reflected on the iris, and the reflected infrared rays pass through the region 910 of the camera 121 filter. Accordingly, the controller 180 may recognize the iris of the user.

As illustrated in FIG. 6, when a user performs a user authentication process through iris recognition, the user and the camera 121 of the mobile terminal 100 are at a close distance. Accordingly, if the mobile terminal 100 to which the improved filter is applied is applied to the camera 121, even if the camera 121 passes visible light through the region 900, the accuracy of iris recognition can be increased. That is, as the user and the camera 121 are located close to each other, the control unit 180 controls the emission of infrared rays adjacent to the iris of the user through the infrared light emitting unit 735 to minimize the influence of visible light in iris recognition. Can.

Meanwhile, since the camera 121 passes visible light, it is still possible to photograph a subject exposed to the visible light.

10 is an exemplary view for explaining a user authentication method using a part selected from a user applied to a mobile terminal according to an embodiment of the present invention, and FIG. 11 is a part of a user's face selected from a user according to an embodiment of the present invention This is an example for explaining a case used for user authentication.

When the first face image 505 is input through the camera 121 as described above in the description of FIG. 5, the controller 180 displays the first face image 505 through the display unit 151. It can be controlled as much as possible. When the first face image is input in FIG. 5, the case in which the controller 180 performs first user authentication has been described. However, even when the first face image is input, in some cases, the controller 180 may not perform the first user authentication.

According to the setting of the user or the manufacturer, the controller 180 may control to display a notification window informing the user of the user authentication procedure according to the input of the first face image. In addition, the controller 180 may control the user to provide a user interface that allows the user to determine whether to proceed with the first user authentication procedure in the notification window. Through the user interface, the user may not perform the first user authentication through the mobile terminal 100 even if the first face image is input.

Alternatively, after the first face image is input, the controller 180 may control to display a selection window that allows the user to select at least one of first user authentication and second user authentication as a user authentication method.

For example, the selection window may include a first menu that allows the controller 180 to perform first user authentication, a second menu that causes the controller 180 to perform second user authentication, and a first controller to control unit 180. It may include a third menu to perform all of the second user authentication. At this time, when the third menu is selected from the user, the controller 180 can perform the second user authentication after the first user authentication is completed.

At this time, when the second or third menu is selected by the user, even if the first face image is input, the controller 180 may not perform the first user authentication.

When the first user authentication is not performed as described above, at least one of the face elements derived from the first face image 505 may be selected. In this case, the controller 180 can perform the second user authentication based only on the selected face element. In FIG. 10A, an example in which an iris is selected among face elements on the first face image 505 by the user's touch gesture 1000 is illustrated.

In this case, the controller 180 may treat the selected iris as a face element on the second face image for pre-set second user authentication when the second face image is input as described in FIG. 6. That is, when a first face image is input to the camera 121 and both eyes, nose, and mouth on the first face image are preset as face elements for first user authentication, when a specific face element is selected from the user, the controller 180, face elements other than the selected face element (iris) may be treated as an input image lacking. Accordingly, the controller 180 may perform the second user authentication described in FIG. 6.

The user's touch gesture 1000 for selecting the face element may be various types such as a touch input, a tap input, and a pinch-out input. Also, a drag input for setting an area including a specific face element may also be included in the touch gesture 1000.

Particularly, a case in which a region 1100 including an eyebrow and an eye is set among face elements on a first face image 505 by the drag input 1000 is illustrated as an example in FIG. 11A. In addition, a case in which a region 1110 including a mouth is set among face elements on the first face image 505 by the drag input 1000 is illustrated as an example in FIG. 11B. The controller 180 may perform the second user authentication based on the face elements included in the areas 1100 and 1110 set as the user's drag input 1000 in FIG. 11A or 11B. have.

Referring to (b) of FIG. 10, the controller 180 may control the selected face element 1010 to be enlarged and displayed for user identification of the selected face element. Also, the controller 180 may control the camera 121 to focus on the selected face element 1010. In addition, when the user touch gesture 1000 is input, the controller 180 can control the focus of the camera 121 to be adjusted, and in the example of the touch gesture 1000 in FIG. 10B, drag in the vertical direction. Input 1020 is shown.

The embodiment described in FIG. 10 may be applied when the first face image 505 is input and the controller 180 attempts user authentication, but the first user authentication fails.

Alternatively, although the first face image 505 is input, it may be applied even when the first menu of the example is not selected by the user. That is, although the first face image is input, it may be applied when the controller 180 performs the second user authentication according to the user input. Alternatively, the user authentication method set in the mobile terminal 100 or selected by the user may also be applied when both the first user authentication and the second user authentication are requested.

12 is an exemplary view for explaining a case of releasing a touch screen lock state of a mobile terminal using a user authentication method according to an embodiment of the present invention,

Here, the locked state of the display unit 151 means a state in which a touch gesture is not input or only some preset touch gestures are limitedly input in order to prevent an erroneous operation or a false touch on the display unit 151. .

When the display unit 151 is locked, the controller 180 may control the unlocked state to be released through the first user authentication or the second user authentication described above. To this end, the controller 180 may include a first face The camera 121 may be controlled to be activated in order to receive an image or a second face image. Activation of the camera 121 may be achieved by receiving a specific key input from a user or by receiving a touch gesture on the display unit 151. In addition, the controller 180 may control the camera 121 to be activated as the movement of the mobile terminal 100 is sensed through the sensing unit 140. For example, when the user moves the mobile terminal 100 to the user's face to input the first face image or the second face image, the controller 180 detects the movement through the sensing unit 140, The camera 121 can be controlled to be activated. In this case, the control unit 180 may control the graphic interface for user authentication to be displayed through the display unit 151.

In addition, the unlocking of the display unit 151 means a state in which when the touch gesture is input on the touch screen 151, the controller 180 can execute a command corresponding to the input touch gesture. When the locked state of the display unit 151 is released through the first user authentication or the second user authentication, the controller 180 displays a home screen screen having one or more pages displayed on the touch screen 151. In addition, at least one of a menu screen on which various app icons are displayed and an execution screen of a specific application may be controlled to be displayed as a lock release screen. In addition, when information that was being displayed before the display unit 151 was locked exists, the controller 180 may control to display information that was being displayed before the display unit 151 is locked after unlocking.

Referring to (a) of FIG. 12, when the display unit 151 is in the locked state 1200, the controller 180 can control a graphic to be displayed.

The controller 180 may control the camera 121 to be activated as the user input for activating the camera 121 or the movement of the mobile terminal 100 is detected. In addition, when the display unit 151 is locked, when the controller 180 determines that the user is a legitimate user through first or second user authentication, the controller 180 may control the display unit to be unlocked.

The case where the second face image 605 is input through the camera 121 activated in FIG. 12B and the second user authentication is performed based on the iris among the face elements is illustrated as an example.

Referring to (c) of FIG. 12, the controller 180 may control to unlock the display unit 151 through the second user authentication. In (c) of FIG. 12, the home screen screen 1210 is illustrated as an example of the unlock screen. The controller 180 may receive a touch gesture for operating the mobile terminal 100 from the user in the unlocked state of the display unit 151.

The input face image, the face element used for user authentication, and the authentication method are only examples, and the controller 180 may perform first user authentication using face recognition according to the input face image.

13 is an exemplary diagram for explaining camera activation and performing user authentication when user authentication of a mobile terminal according to an embodiment of the present invention is required. In this case, it is assumed that the user is running the specific application 1300 through the mobile terminal 100.

Referring to (a) of FIG. 13, when user authentication is required to execute a specific application 1300, the controller 180 enables the camera 121 to be activated to perform the first or second user authentication. Can be controlled.

The case where the second face image 605 is input through the camera 121 activated in FIG. 13B and the second user authentication is performed based on the iris among the face elements is illustrated as an example.

Referring to (c) of FIG. 13, the controller 180 may control the screen 1310 of the user authentication of the specific application 1300 to be displayed through the second user authentication. This embodiment can be widely applied to login of a specific website, payment of internet shopping, internet banking service, and the like.

14 is an exemplary view for explaining first information displayed on a display unit of an authentication result according to a first user authentication method according to an embodiment of the present invention, and FIG. 15 is a second user authentication method according to an embodiment of the present invention It is an exemplary view for explaining the second information displayed on the display unit as a result of authentication according to.

Here, the first information means all objects that can be displayed through the mobile terminal 100. The first information may include a photo, a video, a specific web page, a home screen screen, an application list, and an execution screen of a specific application. The first information may be stored in the mobile terminal 100 or may be received from the outside.

When the first user authentication is performed, the controller 180 can control the first information to be displayed through the display unit 151.

Referring to (a) of FIG. 14, when the first face image 505 is input through the camera 121, the controller 180 can display it and control the first user authentication to be performed. Referring to (b) of FIG. 14, the controller 180 may control the first information to be displayed according to the first user authentication, and here, as an example of the first information, an execution screen 1400 of a music playback application It was shown.

That is, when the display unit 151 of the mobile terminal 100 is locked, or when the first user authentication is required to execute the music playback application, the controller 180 performs the first user authentication to play music The execution screen of the application can be controlled to be displayed.

Meanwhile, the second information is a concept for distinguishing from the first information and means different information from the first information. When the second user authentication is performed, the controller 180 can control the second information to be displayed through the display unit 151.

Referring to (a) of FIG. 15, when the second face image 605 is input through the camera 121, the controller 180 can display it and control the second user authentication to be performed. Referring to (b) of FIG. 15, the controller 180 may control the second information to be displayed according to the second user authentication, where the execution screen 1500 of the map application is an example of the second information. It was shown.

That is, when the display unit 151 of the mobile terminal 100 is locked, or when the second user authentication is required to execute the map application, the controller 180 performs the second user authentication, thereby The execution screen can be controlled to be displayed.

The type of the first information or the second information displayed by the controller 180 when the unlocking of the display unit 151 is performed by the first user authentication or the second user authentication according to the user's or manufacturer's setting. Can be determined. Likewise, specific applications that allow execution by first user authentication or second user authentication may be determined according to the user or manufacturer settings, respectively.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit and essential features of the present invention.

The above-described present invention can be embodied as computer readable codes on a medium on which a program is recorded. The computer-readable medium includes all types of recording devices in which data that can be read by a computer system are stored. Examples of computer-readable media include ROM, RAM, CD-ROM, magnetic tapes, floppy disks, optical data storage devices, etc., which are also implemented in the form of carrier waves (eg, transmission over the Internet). It also includes. In addition, the computer may include a control unit 180 of the terminal.

Accordingly, the above detailed description should not be construed as limiting in all respects, but should be considered illustrative. The scope of the invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

100: mobile terminal
121: camera
140: sensing unit
151: display unit
180: control unit

Claims (11)

camera;
A display unit that displays an image input through the camera; And
When a first face image including face elements necessary for first user authentication is received through the camera, the first user authentication is performed based on the face elements, and at least one of the face elements lacking is performed. Includes a control unit for performing a second user authentication based on at least one face element included in the second face image when a second face image including a face element is received through the camera.
The control unit,
Before performing the first user authentication or the second user authentication, control to display a lock screen indicating a locked state of the display unit,
In response to the performed first user authentication, release the lock state of the display unit to control the execution screen of the first application corresponding to the first user authentication to be displayed,
And in response to the performed second user authentication, release the lock state of the display unit to control the execution screen of the second application corresponding to the second user authentication to be displayed. The method of claim 1, wherein the control unit,
And when at least one of the face elements in the first face image is selected, the second user authentication is performed based on only the selected face element. According to claim 2, The control unit,
And controlling the selected face element to be enlarged and displayed. According to claim 2, The control unit,
And controlling the camera to focus on the selected face element. delete The method of claim 1, wherein the control unit,
When user authentication is required to run a specific application,
And controlling the camera to be activated so that the first or second user authentication can be performed. delete According to claim 1,
The first user authentication is performed through recognition of at least two face elements among face elements in the first face image,
The second user authentication is performed through iris recognition, characterized in that the mobile terminal. The method of claim 8,
The mobile terminal further includes an infrared light emitting unit,
The control unit, when the infrared light is emitted through the infrared light emitting unit, the mobile terminal characterized in that the iris of the user is controlled through the camera. delete delete

Images