CN206271123U - Payment device based on facial recognition - Google Patents

Abstract

The utility model relates to a payment device, comprising: an acquisition module, which is used to photograph gestures and facial expressions of a group of users in advance; a storage module, which is used to store the gestures and facial expressions of a group of users; a processing module, which uses Perform gesture and facial expression recognition when the user needs to make a secure payment, including: prompting the user to perform facial recognition to complete the secure payment, and prompting the user to input a preset gesture and facial expression; the control acquisition module determines the direction of the user's eyes and position; obtain the relative angle between the user's eyes and the terminal screen; and obtain the gestures and facial expressions of the currently captured user; the comparison module is used to compare with a group of user's gestures and facial expressions stored in advance; if the comparison meets , the payment is confirmed; if the comparison does not match, the payment fails; further, the adjustment module is used to adjust the display parameters of the terminal screen according to the relative angle, and control the display range and brightness of the terminal screen according to the display parameters.

Description

Payment device based on facial recognition

technical field

The utility model relates generally to an image processing device, and more particularly to a payment device based on face recognition in an input image.

Background technique

Electronic payment is becoming increasingly popular due to its convenience. Bank cards including bank debit cards and credit cards and third-party payment institutions are playing an increasingly important role in transfer settlement. The user can use the bank card to use the POS (Point Of Sales, point of sale) machine terminal to carry out relatively real-time and accurate settlement, eliminating the trouble of carrying and counting cash on the spot. However, there are transaction hidden dangers in the method for settlement by means of the POS terminal, because swiping the bank card on the POS terminal and manually inputting the password corresponding to the bank card will leave the account number of the bank card on the POS terminal. Password information can easily lead to information leakage. Leakage of the account number and password information will pose a greater threat to the user's property security.

At present, in the user identification technology of mobile payment and mobile wallet, face recognition has gradually entered the security field. Due to the high security requirements of mobile payment, two-dimensional face recognition cannot meet its high security. The mobile phone payment method of face recognition is generally based on neural network for three-dimensional face recognition technology, which is complex in calculation, takes up a lot of content, slow in recognition, and has strict requirements on the angle of photography and light intensity, so it is not suitable for popularization and application.

Therefore, there is an urgent need to find a safe and simple face recognition technology that can replace card swiping and manual input, so as to better meet the needs of current electronic payment.

At the same time, as mobile devices, such as mobile phones and tablets, become more and more powerful, they have become an indispensable must-have for users. When personal privacy or corporate confidential pictures, videos, documents, etc. are involved, it is inevitable that people around can see or peek into the content of the mobile phone screen, making it difficult to ensure the security of personal and corporate information. How to control the screen display of the terminal based on the perspective of the user is also a technical problem to be solved urgently.

Utility model content

The present invention has been made to address at least the problems and disadvantages described above and to provide at least the benefits described below. Accordingly, one aspect of the present invention provides a payment device based on facial recognition.

The embodiment of the utility model also provides a payment device, including:

An acquisition module for pre-capturing gestures and facial expressions of a set of users;

a storage module, configured to store gestures and facial expressions of the group of users;

The processing module is used for gesture and facial expression recognition when the user needs to make a secure payment, including:

Prompt the user that facial recognition is required to complete a secure payment, and prompt the user to enter pre-set gestures and facial expressions;

The control acquisition module determines the direction and position of the user's eyes; acquires the relative angle between the user's eyes and the terminal screen;

And get the user's gestures and facial expressions currently captured;

The comparison module is used to compare with the gestures and facial expressions of a group of users stored in advance;

If the comparison matches, the payment will be confirmed; if the comparison does not match, the payment will fail;

Further, the adjustment module is configured to adjust the display parameters of the terminal screen according to the relative angle, and control the display range and brightness of the terminal screen according to the display parameters.

Optionally, the terminal screen includes: using one or more of grating array technology, lens technology, and directional light source technology to adjust the display of the terminal screen according to the display parameters.

Optionally, the method further includes: if the gesture and facial expression of the user cannot be acquired, reminding that the payment fails.

Optionally, the acquiring the relative angle between the user's eyes and the terminal screen includes: acquiring the relative angle in real time.

Optionally, the stored set of gestures and facial expressions of the user may be associated with a digital password.

Further, an embodiment of the present utility model provides a terminal, and the terminal includes the above-mentioned payment device.

Description of drawings

Fig. 1 is the structural block diagram of the mobile terminal user identity authentication module based on multi-biometric feature mode in the prior art;

Fig. 2 is a block diagram of a mobile terminal according to an embodiment of the present invention.

FIG. 3 is a schematic diagram of user face and gesture recognition in an embodiment of the present invention.

detailed description

Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like elements throughout. In this regard, embodiments of the invention may have different forms and should not be construed as limited to the descriptions set forth herein. Accordingly, the embodiments are described below, by referring to the figures, only to illustrate aspects of the present invention.

Fig. 1 shows a structural block diagram of a mobile terminal user identity authentication module based on multiple biometric modalities. As shown in Figure 1, the mobile terminal user identity authentication device based on multiple biometric modes includes an image acquisition module, an image transmission module, and a biometric algorithm processing module, and distinguishes the functions of iris recognition and face recognition by combining distance detection at the algorithm level range, and give full play to the characteristics of iris recognition security and face recognition ease of use, thereby improving the security performance of mobile terminal equipment. However, the complexity of the device is high.

Fig. 2 is a block diagram of a mobile terminal according to an embodiment of the present invention. A mobile terminal can be a smart phone, a cellular phone, a game console, a television, a display device, a vehicle head unit, a notebook computer, a laptop computer, a tablet personal computer (PC), a personal media player (PMP), Personal Digital Assistants (PDAs), etc.

Referring to FIG. 2, the mobile terminal mainly includes an image processor, a controller, a memory, a display unit, and a communication unit. Other components such as a microphone may also be included in the mobile terminal, but the following description will only describe components related to the embodiment of the present invention.

Use the front camera or sensor module on one side of the mobile terminal screen, as well as the gyroscope, gravity sensor and other devices of the mobile terminal to track and confirm the orientation and position of the user's eyes relative to the screen, and realize the tracking and confirmation of the mobile terminal's posture relative to the user's eyes. Identification and confirmation of orientation and position.

The face recognizer obtains a detected face among an input image and a reduced image, and obtains a size and a position of the detected face. Regardless of processing speed, face locations can be easily obtained by performing face detection on the entire region of the image. On the other hand, in the case of detecting faces of various sizes, as a method of dealing with the problem of the relationship between the resolution of the image and the size of the face to be detected, the following methods can be considered: a method of fixing the resolution of the image (i.e., methods of preparing various face recognizers for various sizes of faces contained in the input image) and methods of fixing the size of detected faces (i.e., reducing the resolution of the input image in different ways to utilize method for detection by a single face recognizer of the face size). Therefore, as shown in FIG. 2, the face recognizer checks for the presence of a face in an area of 24×24 pixels in each of Image 1 and the downscaled created Images 1/2 and 1/4.

For example, if the amount of downscaling (such as 1/2 and 1/4) is too small to perform face detection accurately, images can also be created with various downscaling ratios of 7/8, 6/8, and 5/8 /8, 6/8, and 5/8, and the face recognizer can perform face detection on each created image.

To perform feature extraction in face detection, a pixel difference method can be used. In this method, a plurality of groups having two pixels between which there is a gray level difference that allows easy extraction of facial features is selected from 24 × 24 pixels, and among the plurality of groups having two pixels Each of the groups draws the difference between the gray levels of the two pixels.

In preparation for recognizing a face from a face image, the face recognizer specifies the positions of left and right eyes to normalize the face contained in the image by increasing the resolution of the face image detected by the face recognizer. That is, the face recognizer detects the position of the eyes to obtain the size, position and angle.

The above identification process is completed by the controller controlling the face recognizer and the face recognizer. The controller determines whether the eyes have been detected to determine the presence or absence of the user, and according to the percentage of the eyes in the screen, that is, the size of the eyes, estimate the user's presence in the mobile terminal and the user. the relative distance between them. Simultaneously recognize the user's face and gestures.

The payment method provided by the embodiment of the utility model includes the following steps:

Determine the direction and position of the user's eyes; obtain the relative angle between the user's eyes and the terminal screen.

Adjust the display parameters of the terminal screen according to the relative angle, the display parameters include display content and display range;

The control method is further explained as follows:

The image processor performs facial recognition and determines whether the facial recognition was successful. If facial recognition fails, return and wait for the next detection. If, the facial recognition is successful, the controller analyzes the user state information based on the facial recognition result provided from the image processor. Specifically, the controller determines the presence of the user when eyes are detected in the input image, and analyzes the position and direction of the eyes of the user looking at the mobile terminal at this time, and the relative distance from the mobile terminal. Gestures near the user's face are also determined. The specific operation is as follows:

Users pre-take a set of gestures and facial expression images according to the payment system requirements. As shown in Figure 3, the user can stretch out five fingers beside the face to make a "5" gesture. The payment system saves the image. Using this as an example, the system could ask the user to save a similar set of images, such as images of hand gestures and facial expressions that match the numbers 0-9. Or an image representing an English letter, such as "V" or "OK". The above-mentioned images are stored on the local terminal or network server of the payment system.

When the user needs to make electronic payment, the payment system opens the payment device implemented by the utility model;

Prompt the user that facial recognition is required to complete a secure payment, and prompt the user to enter pre-set gestures and facial expressions;

Determine the direction and position of the user's eyes; obtain the relative angle between the user's eyes and the terminal screen;

Obtain the user's gestures and facial expressions currently captured;

Compare with a pre-stored set of user gestures and facial expressions;

If the comparison matches, the payment will be confirmed; if the comparison does not match, the payment will fail;

Further, the utility model can also store a group of user's gestures and facial expressions that can be associated with digital passwords, and these gestures and facial expression images can be set as different digital passwords by users in different orders. In order to facilitate the user to perform security input, various password combination schemes can be used.

The further consideration of this utility model is that when a user uses a mobile phone in a public place, such as on a subway or a bus, other passengers around the user may see the content displayed on the user's current screen, so it is difficult to ensure the security of personal transaction information .

In the prior art, common terminal screens include LCD (Liquid Crystal Display) liquid crystal screens and OLED (Organic Light-Emitting Diode) screens. The viewing angle of LCD and OLED screens can generally reach more than 150 degrees. Using a series of optical methods, the viewing angle and viewing range of the screen can be adjusted, such as grating array technology (using grating to block and directional light transmission), lens technology (adding convex lenses, concave lenses and other directional light transmission to the screen surface) Out), directional light source technology (backlight light source or luminous light source orientation), etc., can realize the directional display screen. The embodiment of the utility model can realize the adjustment of the viewing angle or range of the mobile terminal screen, so as to ensure that the information displayed on the screen can only be seen by the user using the mobile terminal, but cannot be seen by others, thereby protecting the user when making payment. transaction information security.

Apparently, the payment device of the present invention can be applied to corresponding electronic verification devices. Similarly, the above gesture and facial expression images can be used as verification codes. The corresponding electronic verification device is as follows:

An electronic verification device based on facial recognition, comprising:

An acquisition module for pre-capturing gestures and facial expressions of a set of users;

a storage module, configured to store gestures and facial expressions of the group of users;

The processing module is used for gesture and facial expression recognition when the user needs to carry out electronic verification, including:

Prompt the user that facial recognition is required to complete electronic verification, and prompt the user to enter pre-set gestures and facial expressions;

The control acquisition module determines the direction and position of the user's eyes; acquires the relative angle between the user's eyes and the terminal screen;

And get the user's gestures and facial expressions currently captured;

The comparison module is used to compare with the gestures and facial expressions of a group of users stored in advance;

If the comparison matches, then confirm that the electronic verification is correct; if the comparison does not match, then confirm that the electronic verification has failed;

Further, the adjustment module is configured to adjust the display parameters of the terminal screen according to the relative angle, and control the display range and brightness of the terminal screen according to the display parameters.

The above are only optional implementations of the utility model, and are not intended to limit the utility model in any form. Any simple modification, equivalent change, combination or modification made to the above implementation methods based on the technical essence of the utility model, All still belong to the protection scope of the technical solution of the utility model.

Those of ordinary skill in the art can understand that all or part of the steps in the above method can be completed by instructing related hardware (such as a processor) through a program, and the program can be stored in a computer-readable storage medium, such as a read-only memory, magnetic disk or optical disk Wait. Optionally, all or part of the steps in the foregoing embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module/unit in the above-mentioned embodiments can be implemented in the form of hardware, such as implementing its corresponding functions through an integrated circuit, or can be implemented in the form of software function modules, such as executing a program stored in a memory by a processor. programs/instructions to realize their corresponding functions. The invention is not limited to any specific combination of hardware and software.

The above descriptions are only illustrative specific implementations of the present utility model, and are not intended to limit the scope of the present utility model. Any equivalent changes and modifications made by those skilled in the art without departing from the concept and principle of the present utility model shall fall within the protection scope of the present utility model. And it should be noted that each component of the utility model is not limited to the above-mentioned overall application, and each technical feature described in the specification of the utility model can be selected to be used alone or in combination according to actual needs. Therefore, The utility model naturally covers other combinations and specific applications related to the innovation of this case.

Claims (6)

1. a kind of payment mechanism based on face recognition, including：

Acquisition module, for shooting one group of gesture and facial expression of user in advance；

Memory module, stores for the gesture and facial expression to one group of user；

Processing module, for when user needs to carry out secure payment, carrying out gesture and human facial expression recognition, including：

Prompting user needs to carry out face recognition to complete secure payment, and points out user input gesture set in advance and face Expression；

Control acquisition module determines the direction and position of eyes of user；Obtain the relative angle of eyes of user and terminal screen；

And obtain the gesture and facial expression of the user of current shooting；

Comparing module, for comparing with the gesture and facial expression that prestore one group of user；

If comparison meets, confirm to pay；If comparison does not meet, failure is paid；

Further, adjusting module, the display parameters for adjusting terminal screen according to relative angle, according to display parameters control The indication range of terminal screen and brightness.

2. the payment mechanism of face recognition is based on as claimed in claim 1, and terminal screen includes：Using grating array technology, Lens technologies, one or more pointed in light source technology, the display model of the terminal screen is adjusted according to the display parameters Enclose and brightness.

3. the payment mechanism based on face recognition as claimed in claim 2, also includes：If the gesture of the user cannot be obtained And facial expression, then remind and pay failure.

4. the payment mechanism of face recognition is based on as claimed in claim 3, wherein, it is described to obtain eyes of user and terminal screen Relative angle include：The relative angle is obtained in real time.

5. the payment mechanism of face recognition is based on as claimed in claim 3, wherein, the gesture and face of described one group of user of storage Expression can be associated with numerical ciphers.

6. a kind of terminal, the terminal includes the payment mechanism based on face recognition as described in any one of claim 1 to 5.