CN115657861A

CN115657861A - Interaction method and terminal equipment

Info

Publication number: CN115657861A
Application number: CN202211671123.9A
Authority: CN
Inventors: 杨帆; 杨宇; 杨占金; 任敬辉; 张小亮
Original assignee: Beijing Superred Technology Co Ltd
Current assignee: Beijing Superred Technology Co Ltd
Priority date: 2022-12-26
Filing date: 2022-12-26
Publication date: 2023-01-31

Abstract

The invention discloses an interaction method and terminal equipment, and relates to the technical field of terminals. The terminal device is suitable for being in communication connection with one or more external devices, and the method comprises the following steps: collecting scene information, and judging whether a starting command exists or not according to the scene information; if the starting command exists, acquiring an iris image of the user; determining the identity information of the user according to the iris image, and authenticating the identity information; and if the authentication is passed, responding to the voice control instruction of the user, and controlling the operation of the external equipment according to the voice control instruction. According to the technical scheme of the invention, a user does not need to perform contact operation on the terminal equipment, the terminal equipment can independently complete the interaction process, the interaction mode is more friendly and convenient, the applicable scene is wider, and the peripheral equipment is convenient to manage.

Description

Interaction method and terminal equipment

Technical Field

The present invention relates to the field of terminal technologies, and in particular, to an interaction method and a terminal device.

Background

Currently, the interactive modes adopted by the terminal device include a touch screen mode, a key menu mode and the like. For example, the device is provided with a touch screen or a multi-function key (usually including a preset function key, a menu direction key, a confirmation key cancel key, and other common keys) to implement interactive functions such as function selection, command transmission, system setting, and the like. However, for a miniature desktop terminal with a small size, a larger touch display screen or related operation keys cannot be deployed, and even if the miniature touch screen is deployed, the operation is very inconvenient.

The existing micro iris recognition terminal is not suitable for installing multifunctional keys and a large touch screen due to the limitation of receptor volume, so that an external upper computer is usually required, and relevant instructions are issued through upper computer software to complete operations such as registration, recognition, identity authentication and the like. It can be seen that the existing miniature iris recognition terminal equipment does not have the interaction capability and cannot independently complete the service function, so that the applicable scene of the product is limited.

Therefore, an interaction method and a terminal device are needed to solve the problems in the above technical solutions.

Disclosure of Invention

Therefore, the present invention provides an interaction method and a terminal device to solve or at least alleviate the above problems.

According to an aspect of the present invention, there is provided an interaction method, performed in a terminal device, the terminal device being adapted to be communicatively connected to one or more external devices, the method comprising: collecting scene information, and judging whether a starting command exists or not according to the scene information; if the starting command exists, acquiring an iris image of the user; determining the identity information of the user according to the iris image, and authenticating the identity information; and if the authentication is passed, responding to a voice control instruction of the user, and controlling the operation of the external equipment according to the voice control instruction.

Optionally, in the interaction method according to the present invention, the scene information includes a scene image; acquiring scene information, and judging whether a starting command exists according to the scene information, wherein the method comprises the following steps: and acquiring a scene image in real time, and judging whether a gesture starting command exists according to the scene image.

Optionally, in the interaction method according to the present invention, determining whether there is a gesture start command according to the scene image includes: judging whether the scene image contains a first preset gesture or not; if the first predetermined gesture is included, it is determined that a gesture initiating command exists.

Optionally, in the interaction method according to the present invention, further comprising: judging whether a gesture canceling command exists according to the scene image; and if the gesture cancellation command exists, stopping responding to the voice control instruction of the user.

Optionally, in the interaction method according to the present invention, determining whether there is a gesture cancel command according to the scene image includes: judging whether the scene image contains a second preset gesture or not; if the second predetermined gesture is included, it is determined that a gesture cancel command exists.

Optionally, in the interaction method according to the present invention, the scene information includes a scene voice; acquiring scene information, and judging whether a starting command exists according to the scene information, wherein the method comprises the following steps: and acquiring scene voice in real time, and judging whether a voice starting command exists or not according to the scene voice.

Optionally, in an interaction method according to the present invention, the scene information includes a scene image, and the method further includes: judging whether the scene image contains an information code; if the information code is contained, analyzing the information code to obtain secret key information; comparing the key information with a preset key; and if the comparison is passed, responding to the voice control instruction of the user, and controlling the operation of the external equipment according to the voice control instruction.

Optionally, in the interaction method according to the present invention, before responding to the voice control instruction of the user, the method includes: and playing the voice prompt message to prompt that the identity information authentication is passed.

Optionally, in the interaction method according to the present invention, the external device includes a computing device; controlling the operation of the external device according to the voice control instruction, including: and controlling the starting and/or logging-in of the operating system of the computing device according to the voice control instruction.

Optionally, in the interaction method according to the present invention, the terminal device is adapted to be in communication connection with a server, and the computing device includes an application program adapted to communicate with the server; controlling the operation of the external device according to the voice control instruction, including: sending the voice control instruction to the application program via the server so that the application program controls the operation of the computing device according to the voice control instruction.

Optionally, in the interaction method according to the present invention, the external device further includes a lock; controlling the operation of the external device according to the voice control instruction, including: and controlling the lockset to open or close according to the voice control instruction.

Optionally, in an interaction method according to the present invention, the terminal device includes an iris lens and a driving mechanism; acquiring an iris image of a user, comprising: the driving mechanism drives the iris lens to move so that the iris lens can be positioned on the eyes of the user and the iris image of the eyes of the user is acquired.

According to an aspect of the present invention, there is provided a terminal device adapted to be communicatively connected to one or more external devices, comprising: the scene acquisition module is suitable for acquiring scene information; the iris acquisition module is suitable for acquiring an iris image of a user; and the control module is respectively in communication connection with the scene acquisition module and the iris acquisition module, is suitable for acquiring the scene information, judges whether a starting command exists according to the scene information, controls the iris acquisition module to acquire an iris image of a user if the starting command exists, determines the identity information of the user according to the iris image, authenticates the identity information, responds to a voice control instruction of the user if the authentication is passed, and controls the operation of the external equipment according to the voice control instruction.

Optionally, in the terminal device according to the present invention, the scene information includes a scene image and a scene voice, and the scene acquisition module includes: the image acquisition module is suitable for acquiring a scene image and sending the scene image to the control module so that the control module can judge whether a gesture starting command exists according to the scene image; and the sound acquisition module is suitable for acquiring scene voice and sending the scene voice to the control module so that the control module can judge whether a voice starting command exists according to the scene voice.

Optionally, in the terminal device according to the present invention, the control module is further adapted to: judging whether the scene image contains an information code; if the information code is contained, analyzing the information code to obtain secret key information; comparing the key information with a preset key; and if the comparison is passed, responding to the voice control instruction of the user, and controlling the operation of the external equipment according to the voice control instruction.

Optionally, in the terminal device according to the present invention, the iris acquisition module includes: an iris lens; and the driving mechanism is connected with the iris lens and is suitable for driving the iris lens to move so as to be convenient for positioning the iris lens to the eyes of the user and acquiring the iris image of the eyes of the user.

According to the technical scheme of the invention, the invention provides an interaction method and terminal equipment, wherein the terminal equipment judges whether a starting command sent by a user exists according to scene information by acquiring the scene information in real time, automatically enters an authentication process when the starting command exists, controls an iris acquisition module to acquire an iris image of the user, and authenticates user identity information according to the iris image. After the authentication is passed, the user obtains the authorization permission for controlling the operation of the external equipment by using the terminal equipment, at this time, the user can send out a voice control instruction, and the terminal equipment controls the operation of the external equipment according to the voice control instruction of the user. Therefore, according to the interaction method provided by the invention, the whole interaction process comprises the control operation on the external equipment after the starting, the authentication and the authentication are passed, the user does not need to perform contact operation on the terminal equipment in a key and touch screen mode, the terminal equipment can independently complete the interaction process, the interaction mode is more friendly and convenient, the size of the terminal equipment is not limited, and the application scene is wider. After the authentication is passed, the user can control and operate the external equipment only by carrying out voice interaction with the terminal equipment, so that the peripheral equipment can be managed conveniently. In addition, identity authentication is carried out based on iris recognition, and the accuracy rate is higher.

Furthermore, the terminal equipment can acquire scene images and scene voices in real time, so that a user can send out a starting command in various modes such as gestures and voices, the use scene is further expanded, and the user can conveniently select various interaction modes.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings, which are indicative of various ways in which the principles disclosed herein may be practiced, and all aspects and equivalents thereof are intended to be within the scope of the claimed subject matter. The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description read in conjunction with the accompanying drawings. Throughout this disclosure, like reference numerals generally refer to like parts or elements.

Fig. 1 shows a block diagram of a terminal device 100 according to an embodiment of the present invention;

FIG. 2 shows a flow diagram of an interaction method 200 according to one embodiment of the invention;

FIG. 3 illustrates a schematic diagram of a first predetermined gesture in accordance with one embodiment of the present invention;

FIG. 4 illustrates a schematic diagram of a second predetermined gesture in accordance with one embodiment of the present invention;

fig. 5 shows a schematic front-side structure of the terminal device 100 according to an embodiment of the present invention;

fig. 6 is a schematic diagram showing an internal configuration of the terminal device 100 according to an embodiment of the present invention;

fig. 7 shows an exploded view of the terminal device 100 according to an embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

Fig. 1 shows a block diagram of a terminal device 100 according to an embodiment of the present invention.

As shown in fig. 1, the terminal device 100 includes a scene acquisition module 110, an iris acquisition module 120, and a control module 130. The control module 130 is in communication connection with the scene acquisition module 110 and the iris acquisition module 120, respectively.

Here, the control module 130 and the scene capturing module 110 and the iris capturing module 120 may be connected in a wired (including electrical connection) or wireless (including bluetooth) communication manner.

In an embodiment of the present invention, the scene capturing module 110 is configured to capture scene information, and may upload the scene information to the control module 130. The iris collecting module 120 is used for collecting an iris image and may upload the iris image to the control module 130.

The scene information is collected by the scene collecting module 110, and the control module 130 determines whether there is a start command according to the scene information. If the control module 130 determines that there is a start command according to the scene information, an iris image may be acquired through the iris acquisition module 120. Further, the control module 130 may determine the identity information of the user according to the iris image and authenticate the identity information of the user. If the authentication is passed, the terminal device 100 may start a subsequent interaction process, so that the user performs a control operation on the external device. Specifically, after the authentication is passed, the terminal device 100 may instruct the user to issue a control instruction (specifically, a voice control instruction) to the external device, and when the terminal device 100 receives the control instruction issued by the user, the control module 130 responds to the control instruction of the user and controls the operation of the external device according to the control instruction.

In an embodiment, the control instruction may specifically be a voice control instruction, and after the identity information of the user is authenticated according to the acquired iris image, the terminal device 100 may start a voice interaction process: the user can send out a voice control instruction, and when the terminal device 100 receives the control instruction sent out by the user, the control module 130 responds to the control instruction of the user and controls the operation of the external device according to the control instruction. Thus, the user can perform voice control operation on the external device through voice interaction without performing contact operation on the terminal device 100.

Specifically, after the terminal device 100 is powered on, the terminal device enters a standby state, and at this time, the control module 130 may send a scene acquisition instruction to the scene acquisition module 110 to instruct the scene acquisition module 110 to acquire scene information in real time. The scene capturing module 110 sends the scene information captured in real time to the control module 130, and then the control module 130 determines whether a start command exists according to the scene information. If the control module 130 determines that there is a start command, an authentication procedure may be entered: the iris acquisition module 120 is controlled to acquire an iris image, and the identity information of the user is determined according to the iris image, so as to authenticate the identity information of the user. Specifically, the control module 130 instructs the iris acquisition module 120 to acquire an iris image by sending an iris acquisition command to the iris acquisition module 120, and then the iris acquisition module 120 sends the acquired iris image to the control module 130, so that the control module 130 can determine the identity information of the user according to the iris image and authenticate the identity information of the user.

In one embodiment, the scene information may include a scene image, a scene voice. Accordingly, the scene capturing module 110 may include an image capturing module 111 and a sound capturing module 113, and the image capturing module 111 and the sound capturing module 113 are both communicatively connected to the control module 130. The image capturing module 111 is configured to capture a scene image, and may upload the scene image to the control module 130. The sound collection module 113 is configured to collect scene voices, and may upload the scene voices to the control module 130.

Specifically, after the terminal device 100 is powered on, the terminal device enters a standby state, and at this time, the control module 130 may send a scene acquisition instruction to the scene acquisition module 110 (the image acquisition module 111 and the sound acquisition module 113) to instruct the scene acquisition module 110 to acquire scene information in real time. Subsequently, the image capturing module 111 captures a scene image in real time and uploads the scene image to the control module 130, and the sound capturing module 113 captures a scene voice in real time and uploads the scene voice to the control module 130.

The control module 130 may determine whether a gesture start command exists according to the scene image, and if it is determined that the gesture start command exists, may send an iris acquisition instruction to the iris acquisition module 120 to control the iris acquisition module 120 to acquire the iris image of the user. The control module 130 may further determine whether a voice start command exists according to the scene voice, and if it is determined that the voice start command exists, the control module 130 may send an iris collecting instruction to the iris collecting module 120 to control the iris collecting module 120 to collect the iris image of the user.

In one embodiment, the control module 130 determines whether a gesture initiating command is present by determining whether a first predetermined gesture is included in the scene image. Specifically, if a first preset gesture is contained in the scene image, determining that a gesture starting command exists; otherwise, if the first predetermined gesture is not included in the scene image, it is determined that there is no gesture start command.

In addition, the control module 130 may further determine whether a gesture cancellation command exists according to the scene image acquired by the image acquisition module 111 in real time. And if the gesture canceling command exists, stopping responding to a control instruction (voice control instruction) sent by the user, and finishing the control operation on the external equipment after the authentication is passed.

In addition, the sound collection module 113 can also collect a voice control instruction of the user, so that the control module controls the operation of the external device according to the voice control instruction. Specifically, after the identity information of the user is authenticated according to the collected iris image, the terminal device 100 may start a voice interaction process, so that the user sends a voice control instruction, and the sound collection module 113 may collect the voice control instruction of the user, so that the control module controls the operation of the external device according to the voice control instruction.

In one embodiment, the terminal device 100 further includes a play module 140. After the user identity information is authenticated, the control module 130 may instruct the playing module 140 to play a voice prompt message to prompt the user that the user identity information is authenticated. For example, the voice prompt message may be "authenticate pass, you good, need I do something for you," but the invention is not limited thereto. Next, the user may issue voice control instructions. The terminal device 100 may receive a voice control command sent by a user through the sound collection module 113, and send the voice control command to the control module 130. Subsequently, the control module 130 may respond to the voice control instruction, and may control the operation of the external device according to the voice control instruction after performing voice recognition on the voice control instruction.

In one embodiment, the iris acquisition module of the terminal device 100 may include an iris lens, a driving mechanism. The driving mechanism is connected with the iris lens and can drive the iris lens to move. When the iris acquisition module acquires the iris image of the user, the driving mechanism can drive the iris lens to move so that the iris lens can be positioned on the eyes of the user, and then the iris image of the eyes of the user is acquired.

According to an embodiment of the invention, the terminal device 100 is configured to perform the interaction method 200 of the invention. The interaction method 200 of the present invention will be described in detail below.

FIG. 2 shows a flow diagram of an interaction method 200 according to one embodiment of the invention. The interaction method 200 is suitable for being executed in a terminal device (the aforementioned terminal device 100).

As shown in FIG. 2, the interactive method 200 includes steps 210 to 240.

In step 210, by collecting the scene information, it is determined whether there is a start command according to the scene information. Here, scene information may be collected in real time. The scene information may include, for example, a scene image, a scene voice, and the like, which is not limited in this respect.

If the starting command is determined to exist, the following authentication process based on the iris image (including steps 220 to 230) can be executed.

Specifically, in step 220, an iris image of the user is acquired.

In step 230, the identity information of the user is determined according to the acquired iris image, and the identity information of the user is authenticated.

In one embodiment, the terminal device 100 may pre-enter one or more iris images, identity information, and related information whether the terminal device has a control authority, and establish an association relationship between the iris images and the identity information. In this way, in step 230, by comparing the acquired iris image with the pre-recorded iris image, the identity information associated with the iris image of the user can be determined, and further, whether the user has the control authority is determined according to the identity information of the user, and if the user has the control authority, the authentication is passed.

If the authentication of the identity information of the user is passed, the user may obtain an authorization permission to control the operation of the external device by using the terminal device 100, and at this time, a subsequent interaction process may be started, so that the user may perform a control operation on the external device.

Specifically, after the authentication is passed, the terminal device 100 may instruct the user to issue a control instruction to the external device, and the terminal device 100 executes step 240 upon receiving the control instruction issued by the user.

In step 240, the terminal device 100 controls the operation of the external device according to the control instruction in response to the control instruction of the user. In particular, the control instruction may be a voice control instruction. After the identity information of the user is authenticated according to the collected iris image, the terminal device 100 may start a voice interaction process, and then the user may send a voice control instruction, and after receiving the voice control instruction sent by the user, the terminal device 100 responds to the voice control instruction and controls the operation of the external device according to the voice control instruction. Here, the voice recognition algorithm may be used to control the operation of the external device after performing voice recognition on the voice control command.

Thus, the user can perform voice control operation on the external device through voice interaction without performing contact operation on the terminal device 100.

In one embodiment, before performing step 240, the terminal device 100 may play a voice prompt message to prompt the identity information authentication to pass. Subsequently, a voice control instruction issued by a user may be received, and in response to the voice control instruction, the operation of the external device may be controlled in accordance with the voice control instruction.

Specifically, the terminal device 100 further includes a playing module 140. In the terminal device 100, after the authentication of the user identity information is passed, the control module 130 may instruct the playing module 140 to play a voice prompt message to prompt the user that the authentication of the user identity information is passed, and obtain an authorization permission to control the operation of the external device by using the terminal device 100. For example, the voice prompt message may be "authenticate pass, you good, need I do something for you," but the invention is not limited thereto. Next, the user may issue voice control instructions. The terminal device 100 may receive a voice control command sent by a user through the sound collection module 113, and send the voice control command to the control module 130. Subsequently, the control module 130 may respond to the voice control instruction, and may control the operation of the external device according to the voice control instruction after performing voice recognition on the voice control instruction.

As described in the foregoing, according to the terminal device 100 of the present invention, the terminal device 100 includes the scene capture module 110, the iris capture module 120, and the control module 130. The control module 130 is in communication connection with the scene acquisition module 110 and the iris acquisition module 120, and may specifically adopt a wired or wireless communication connection.

Specifically, after the terminal device 100 is powered on, the terminal device enters a standby state, and at this time, the control module 130 may send a scene acquisition instruction to the scene acquisition module 110 to instruct the scene acquisition module 110 to acquire scene information in real time. The scene capturing module 110 sends the scene information captured in real time to the control module 130, and then the control module 130 determines whether a start command exists according to the scene information. If the control module 130 determines that the start command exists, the iris acquisition module 120 may be controlled to acquire an iris image. Specifically, the control module 130 instructs the iris acquisition module 120 to acquire an iris image by transmitting an iris acquisition command to the iris acquisition module 120, and then the iris acquisition module 120 transmits the acquired iris image to the control module 130, so that the control module 130 can determine the identity information of the user according to the iris image and authenticate the identity information of the user. After the authentication is passed, the terminal device 100 may instruct the user to issue a control instruction to the external device, and when the terminal device 100 receives the control instruction issued by the user, the control module 130 responds to the control instruction of the user and controls the operation of the external device according to the control instruction.

In one embodiment, the scene capturing module 110 may include an image capturing module 111 and a sound capturing module 113, and the image capturing module 111 and the sound capturing module 113 are both communicatively connected to the control module 130. The image capturing module 111 is configured to capture a scene image, and may upload the scene image to the control module 130. The sound collection module 113 is configured to collect scene voices, and may upload the scene voices to the control module 130. In addition, the sound collection module 113 may also collect a voice control instruction of the user, and send the voice control instruction to the control module 130, so that the control module 130 controls the operation of the external device according to the voice control instruction.

In one embodiment, the scene information includes an image of a scene, and accordingly, the start command includes a gesture start command (i.e., a start command issued by a user through a gesture). In this way, in step 210, the terminal device 100 may acquire a scene image in real time, determine whether a gesture start command exists according to the scene image, and acquire an iris image of the user if the gesture start command exists. Specifically, in the terminal device 100, a scene image may be acquired in real time by the image acquisition module 111 and uploaded to the control module 130, and then the control module 130 may determine whether a gesture start command exists according to the scene image, and if it is determined that the gesture start command exists, may send an iris acquisition instruction to the iris acquisition module 120 to control the iris acquisition module 120 to acquire an iris image of the user.

In one implementation, the user may issue the gesture initiating command by making a first predetermined gesture in front of the terminal device 100, where it is necessary to ensure that the image capturing module 111 is capable of capturing the first predetermined gesture.

Accordingly, for the terminal device 100, the control module 130 may determine whether there is a gesture start command from the scene image by: and judging whether a first preset gesture is contained in the scene image, and if the first preset gesture is contained, determining that a gesture starting command exists. Specifically, it may be determined whether a gesture is included in the scene image, and if the gesture is included, it is determined whether the gesture is a first predetermined gesture. If it is a first predetermined gesture, it is determined that a gesture initiating command exists.

FIG. 3 illustrates a schematic diagram of a first predetermined gesture according to one embodiment of the present invention. As shown in fig. 3, the first predetermined gesture may be implemented, for example, as a five-finger spread and waving of the palm. However, it should be noted that the present invention does not limit the specific gesture of the first predetermined gesture, and it can be set by those skilled in the art according to the actual requirement.

In one embodiment, the user may also issue a gesture cancel command to cancel the control operation. Specifically, the terminal device 100 may further determine whether a gesture cancellation command exists according to a scene image acquired in real time. And if the gesture canceling command exists, stopping responding to the control instruction (voice control instruction) of the user so as to finish the control operation on the external equipment after the authentication is passed.

In one implementation, the user may issue the gesture cancel command by making a second predetermined gesture in front of the terminal device 100, where it is necessary to ensure that the second predetermined gesture can be captured by the image capture module 111.

Accordingly, for the terminal device 100, the control module 130 may determine whether there is a gesture cancel command from the scene image by: and judging whether a second preset gesture is contained in the scene image, and if the second preset gesture is contained, determining that a gesture canceling command exists. Specifically, it may be determined whether a gesture is included in the scene image, and if the gesture is included, it is determined that the gesture is a second predetermined gesture, it is determined that a gesture start command exists.

FIG. 4 illustrates a schematic diagram of a second predetermined gesture in accordance with one embodiment of the present invention. As shown in fig. 4, the second predetermined gesture may be implemented, for example, as a five-finger tuck clenching fist. However, it should be noted that the present invention does not limit the specific gesture of the second predetermined gesture, and it can be set by those skilled in the art according to the actual needs.

In one embodiment, the scene information may further include a scene voice, and accordingly, the start command includes a voice start command (i.e., a start command issued by a user through voice). In this way, in step 210, the terminal device 100 may collect the scene voice in real time, and determine whether there is a voice start command according to the scene voice. Here, the speech recognition algorithm may be used to perform speech recognition on the scene speech, and further determine whether there is a speech start command. If it is determined that the voice start command exists, an iris image of the user is acquired.

Specifically, in the terminal device 100, the scene voice may be collected in real time by the voice collection module 113 and uploaded to the control module 130, and then the control module 130 may determine whether a voice start command exists according to the scene voice, and if it is determined that the voice start command exists, may send an iris collection instruction to the iris collection module 120 to control the iris collection module 120 to collect an iris image of the user.

Besides, besides the iris authentication mode, in other embodiments, authorization authentication can be performed based on the information code to realize temporary authorization of the user. The specific method is as follows.

For the scene image acquired by the image acquisition module 111 in real time, the control module 130 may further determine whether the scene image includes an information code. Here, the information code may be implemented as a two-dimensional code, for example, but the present invention is not limited thereto, and in other embodiments, the information code may also be implemented as a one-dimensional code.

And if the scene image is determined to contain the information code, analyzing the information code to acquire the key information from the information code.

And comparing the key information with a preset key. Here, a preset key for matching may be previously entered in the terminal device 100. And if the key information is matched with the preset key, the comparison is passed.

If the comparison is passed, the user can be authorized to perform the subsequent voice interaction process, that is: the user can send a voice control instruction to the terminal device 100 to implement a control operation for an external device.

For the terminal device 100, after the comparison between the key information and the preset key is passed, step 240 may be executed: and when a user voice control command is received, responding to the voice control instruction of the user, and controlling the operation of the external equipment according to the voice control instruction.

It should be noted that, when it is necessary to temporarily obtain an authorized use permission for a user not registered in the terminal device 100, an information code may be used. A legal user can generate a temporary authorization information code by using the APP and send the authorization information code to an authorized user, so that the authorized user can realize temporary authorization only by aiming at the terminal device 100 (image acquisition module) to present the authorization information code, enter a subsequent voice interaction process, and control the operation of an external device by sending a voice control instruction.

In one embodiment, the external device may include, for example, a computing device, a lock, or the like. The computing device, lock, may be communicatively coupled to the terminal device 100. For example, the terminal device 100 may be wirelessly communicatively connected with the terminal device 100 through a bluetooth module.

When the operation of the external device is controlled according to the control instruction in step 240, specifically, the operating system of the computing device may be controlled to start and/or log in according to the control instruction (voice control command). The lock can be controlled to be opened or closed according to a control instruction (a voice control command).

For example, a user may issue a voice control command of "turning on the computing device", the sound collection module 113 of the terminal device 100 may receive the voice control command and send the voice control command to the control module 130, and then the control module 130 controls the computing device to turn on and start the operating system according to the voice control command in response to the voice control command. Then, the user may also issue a voice control command to "log in the operating system", and the terminal device 100 may automatically input information such as a login account number and a password according to the voice control command in response to "log in the operating system" to control the computing device to log in the operating system.

For another example, the user may issue a voice control command to "open (or close) a nearby lock", and the terminal device 100 may control the nearby lock communicatively connected to the terminal device 100 to open (or close) in response to the voice control command to "open (or close) the nearby lock".

In one implementation, the terminal device 100 may be connected to the computing device through a USB interface in a wired manner, so that the computing device can provide power to the terminal device 100 and perform data transmission based on the USB connection.

In addition, (the control module 130 of) the terminal device 100 may also be communicatively connected to a server. An application program adapted to communicate with the server may be installed in the computing device. When controlling the operation of the external device according to the voice control instruction, the terminal device 100 may transmit the voice control instruction of the user to the server, and transmit the voice control instruction to the application program via the server, so that the operation of the computing device may be controlled according to the voice control instruction by the application program in the computing device.

In another implementation, terminal device 100 may also be communicatively coupled to a computing device via a docking station, which may be coupled to an input device such as a keyboard, mouse, or the like. In this way, information may be input to the computing device via the docking station and the input device in accordance with the control instructions to control the operation of the computing device.

According to the interaction method 200 and the terminal device 100 of the present invention, the terminal device collects scene information in real time, determines whether a start command sent by the user exists according to the scene information, automatically enters an authentication process when the start command is determined to exist, controls the iris acquisition module to acquire the iris image of the user, and authenticates the identity information of the user according to the iris image. After the authentication is passed, the user obtains the authorization permission for controlling the operation of the external equipment by using the terminal equipment, at this time, the user can send out a voice control instruction, and the terminal equipment controls the operation of the external equipment according to the voice control instruction of the user. Therefore, according to the interaction method of the invention, the whole interaction process comprises the control operation of the external device after the starting, the authentication and the authentication are passed, the user does not need to perform the contact operation in the terminal device 100 in a key and touch screen mode, the terminal device can independently complete the interaction process, the interaction mode is more friendly and convenient, the size of the terminal device is not limited, and the applicable scene is wider. After the authentication is passed, the user can control and operate the external equipment only by carrying out voice interaction with the terminal equipment, so that the peripheral equipment can be managed conveniently. In addition, identity authentication is carried out based on iris recognition, and the accuracy rate is higher.

Furthermore, the terminal equipment can acquire scene images and scene voices in real time, so that a user can send out a starting command through various modes such as gestures and voices, the use scene is further expanded, and the user can select various interaction modes conveniently.

In one embodiment of the present invention, the terminal device 100 may be specifically implemented as an iris recognition terminal device.

Fig. 5 to 7 are schematic structural views of a terminal device 100 (iris recognition terminal device) according to an embodiment of the present invention.

As shown in fig. 5 to 7, the terminal device 100 includes a control module 130, an image capturing module 111, and an iris capturing module 120. The control module 130 is in communication connection with the image capturing module 111 and the iris capturing module 120, and may specifically be in communication connection in a wired manner, for example, the control module 130 is electrically connected with the image capturing module 111 and the iris capturing module 120. The image capture module 111 may be configured to capture images of a scene and the iris capture module 120 may be configured to capture images of a user's iris.

The image capturing module 111 may capture a scene image in real time, and send the scene image captured in real time to the control module 130. The control module 130 may determine whether a gesture start command exists according to the scene image, and if the gesture start command exists, control the iris acquisition module 120 to acquire an iris image of the user so as to authenticate the user identity based on the iris image.

The iris collecting module 120 may transmit the collected iris image to the control module 130, and the control module 130 may determine the identity information of the user according to the iris image and authenticate the identity information.

It should be noted that, after the authentication of the user's identity information based on the iris image is passed, the user can obtain an authorized permission to control the operation of the external device using the terminal device 100.

For example, in one embodiment, the terminal device 100 may be communicatively coupled to one or more external devices. The external devices may include, for example, computing devices, locks, and the like. After the authentication is passed, the terminal device 100 may instruct the user to issue a control instruction (e.g., a voice control instruction) to the external device, and when the terminal device 100 receives the control instruction issued by the user, the control module 130 controls the operation of the external device according to the control instruction in response to the control instruction of the user.

In one embodiment, the terminal device 100 further includes a sound collection module 113 for collecting sound. The sound collection module 113 is communicatively connected (or may be electrically connected) with the control module 130. After the identity information of the user is authenticated based on the iris image, the voice control instruction sent by the user may be received by the voice collecting module 113, and sent to the control module 130. Subsequently, the control module 130 may control the operation of the external device according to the voice control instruction in response to the voice control instruction of the user.

Specifically, in this embodiment, after the terminal device 100 is powered on, the terminal device enters a standby state, and at this time, the control module 130 may send a scene capture instruction to the image capture module 111 to instruct the image capture module 111 to capture a scene image in real time. The image capturing module 111 transmits the scene image captured in real time to the control module 130, and then the control module 130 determines whether there is a start command according to the scene image. If the control module 130 determines that the start command exists, the iris acquisition module 120 may be controlled to acquire an iris image. Specifically, the control module 130 instructs the iris acquisition module 120 to acquire an iris image by transmitting an iris acquisition command to the iris acquisition module 120, and then the iris acquisition module 120 transmits the acquired iris image to the control module 130, so that the control module 130 can determine the identity information of the user according to the iris image and authenticate the identity information of the user. After the authentication is passed, the terminal device 100 may instruct the user to issue a control command to the external device, and specifically, the terminal device 100 may receive the voice control command issued by the user through the sound collection module 113 and send the voice control command to the control module 130. Subsequently, the control module 130 may control the operation of the external device according to the voice control instruction in response to the voice control instruction of the user.

In addition, in this embodiment, the sound collection module 113 may also collect scene voices in real time and send the scene voices to the control module 130. The control module 130 may determine whether a voice start command exists according to the scene voice, and if the voice start command exists, the control module controls the iris acquisition module 120 to acquire the iris image of the user, so as to authenticate the user identity based on the iris image.

In one implementation, the sound collection module 113 may be implemented as a microphone.

In one embodiment, as shown in fig. 5-7, the terminal device 100 includes a housing 190, and the housing 190 includes a main housing 195 and a base housing 196. Here, the main housing 195 and the base housing 196 are both hollow structures, and the main housing 195 is rotatably connected to the base housing 196 so that the main housing 195 can rotate relative to the base housing 196. A panel 191 made of a transparent material (specifically, a glass panel) is fixed to the front surface of main housing 195, and here, the surface on which panel 191 is provided is generally the front surface (front surface) of terminal device 100 and the housing. A display screen 192 may be provided on the inner side of the panel 191 (the side facing the main housing 195). Specifically, the display screen 192 may be fixedly disposed at the front of the main housing 195 and covered by a glass panel. The back of the main housing 195 is fixedly provided with a cover plate 193, the cover plate 193 is fixedly connected with the main housing 195, and the cover plate 193 is rotatably connected with the base housing 196 through a second rotating shaft 194.

The image capturing module 111, the iris capturing module 120, and the voice capturing module 113 are all installed in the main housing 195 and covered by the panel 191. The control module 130 is mounted within the housing 190.

For example, in one implementation, the main housing 195 may be rotatably coupled to the base housing 196 by the second shaft 194, and the main housing 195 may rotate in a height direction (i.e., pitch motion) relative to the base housing 196.

In one embodiment, image acquisition module 111 includes a wide-angle lens communicatively coupled to control module 130. The scene image may be captured through the wide-angle lens and transmitted to the control module 130. Here, the present invention does not limit the kind and model of the wide-angle lens. In one implementation, the wide-angle lens may specifically be a wide-angle RGB lens.

In one embodiment, as shown in fig. 6 and 7, the iris acquisition module 120 includes an iris lens 123 and a driving mechanism 121, and the iris lens 123 may acquire an iris image of the user. The driving mechanism 121 is connected with the iris lens 123, the iris lens 123 can be driven to move through the driving mechanism 121, the iris lens 123 can be positioned on the eyes of the user, and after the iris lens 123 is aligned with the eyes of the user, an iris image of the eyes of the user can be acquired. It should be noted that the control module 130 may be electrically connected to the driving mechanism 121 to control the driving mechanism 121 to drive the iris lens 123 to move until the iris lens 123 is aligned with the eye of the user.

In one implementation, the drive mechanism 121 may be implemented as a steering engine. The iris lens 123 may be rotatably connected to the driving mechanism 121 (steering engine) through a first rotating shaft 122. The driving mechanism 121 drives the first rotating shaft 122 to rotate, so as to drive the iris lens 123 to rotate in the height direction (i.e., to perform a pitching motion).

In an embodiment, as shown in fig. 6 and 7, the iris acquisition module 120 may further include an infrared light supplement lamp 124, the infrared light supplement lamp 124 is connected to the driving mechanism 121, and the driving mechanism 121 may drive the infrared light supplement lamp 124 and the iris lens 123 to move synchronously, so that when an iris image is acquired through the iris lens 123, light supplement may be performed on the iris lens 123 through the infrared light supplement lamp 124.

In one embodiment, as shown in fig. 6 and 7, the iris lens 123 and the infrared fill-in light 124 are both rotatably connected to the driving mechanism 121 through the first rotating shaft 122. The driving mechanism 121 (e.g., a steering engine) drives the first rotating shaft 122 to rotate, and can drive the iris lens 123 and the infrared light supplement lamp 124 to rotate synchronously along the height direction, so that the iris lens 123 aligns with the eyes of the user and acquires an iris image.

Specifically, the driving mechanism 121 is fixedly installed in the main housing 195, the first rotating shaft 122 is rotatably installed in the driving mechanism 121, and the iris lens 123 and the infrared light supplement lamp 124 are both fixed on the first rotating shaft 122 and face the same direction.

When the tilt angle of the iris lens 123 needs to be adjusted to a larger extent, the control module 130 controls the driving mechanism 121 to drive the iris lens 123 and the infrared light supplement lamp 124 to rotate in the height direction, so as to adjust the tilt angle of the iris lens 123 relative to the driving mechanism 121 and the main housing 195, and can also manually adjust the tilt angle of the main housing 195 (and the modules installed therein) relative to the base housing 196.

In one embodiment, as shown in fig. 7, the terminal device 100 further includes a play module 140, the play module 140 is installed in the main housing 195, and the play module 140 is communicatively connected to the control module 130. The playing module 140 can receive a playing instruction sent by the control module 130, and play the voice prompt message according to the playing instruction. For example, after the authentication of the user identity information is passed, the control module 130 may instruct the playing module 140 to play a voice prompt message to prompt the user that the authentication of the user identity information is passed and obtain an authorization permission to control the operation of the external device by using the terminal device 100. Next, the user may issue voice control instructions. The terminal device 100 may receive a voice control instruction sent by a user through the sound collection module 113, and send the voice control instruction to the control module 130, and the control module 130 may control an operation of an external device according to the voice control instruction.

In one implementation, the playing module 140 may be implemented as a speaker.

In one embodiment, as shown in fig. 7, the control module 130 includes a main control circuit board 131 and an extension circuit board 133, the main control circuit board 131 being mounted within the main housing 195, and the extension circuit board 133 being mounted within the base housing 196. Here, a base chassis 197 is fixedly mounted on the bottom of the base housing 196, and the extension circuit board 133 may be fixedly mounted on the base chassis 197 and covered by the base housing 196. The main control circuit board 131 is in communication connection (specifically, may be electrically connected) with the image acquisition module 111, the iris acquisition module 120, the sound acquisition module 113, and the playing module 140, respectively.

The expansion circuit board 133 is communicatively connected (or may be electrically connected) to the main control circuit board 131. Wherein, the extension circuit board 133 is provided with a power supply, a power management circuit, and a bluetooth module. In this way, the power on the expansion circuit board 133 can be connected to the main control circuit board 131 via the power management circuit, so that the power can be supplied to the main control circuit board 131 through the power management circuit. And, the expansion circuit board 133 of the control module 130 can be in communication connection with an external device through a bluetooth module, for example, in communication connection with a lock through the bluetooth module.

In one embodiment, as shown in fig. 7, the terminal device 100 further includes a ranging sensor 170, and the ranging sensor 170 is connected to a focusing motor of the iris lens 123 to automatically adjust the focal length of the iris lens 123. Specifically, the distance measuring sensor 170 may measure a distance between the user's eye and the iris lens 123 and transmit the measured distance data to the focus motor of the iris lens 123 so that the focus motor focuses the iris lens 123 according to the measured distance data, so that the iris lens 123 can realize auto-focusing according to the distance from the user's eye. In one implementation, ranging sensor 170 may be a tof ranging sensor 170.

In one embodiment, the terminal device 100 further includes a plurality of filters, which may be fixed within the main housing 195. The plurality of filters may be specifically infrared filters for filtering out color light other than infrared light to pass the infrared light. As shown in fig. 7, the plurality of filters specifically include a first filter 181 for the iris lens 123, a second filter 182 for the infrared fill-in lamp 124, and a third filter 183 for the distance measuring sensor 170. Here, the first filter 181, the second filter 182, and the third filter 183 are respectively disposed inside the panel 191 and below the display screen 192. Specifically, the display screen 192, the first filter 181, the second filter 182, and the third filter 183 may be embedded in the front portion of the main housing, and covered by the panel 191 (glass panel).

It should be understood that the first filter 181 corresponds to the position of the iris lens 123, and may be disposed right in front of the iris lens 123, for example, to filter the iris lens 123 and provide infrared light to the iris lens 123; the second optical filter 182 corresponds to the position of the infrared fill-in light 124, and may be disposed right in front of the infrared fill-in light 124, for example, so as to supplement infrared light to the iris lens 123; the third filter 183 corresponds to a position of the distance measuring sensor 170 (tof distance measuring sensor), and may be disposed, for example, directly in front of the distance measuring sensor 170 to filter the distance measuring sensor 170 and pass infrared light.

It should be noted that details of the interaction method of the terminal device 100 and the execution logic of each module thereof may refer to the corresponding description in the interaction method 200, and are not described herein again.

In the description of the present specification, the terms "connected", "fixed", and the like are to be construed broadly unless otherwise explicitly specified or limited. Furthermore, the terms "front", "back", "upper", "lower", "inner", "outer", "top", "bottom", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience in describing and simplifying the description, but do not indicate or imply that the referred devices or units must have a specific direction, be constructed in a specific orientation, and be operated, and thus, should not be construed as limiting the present invention.

In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules or units or components of the devices in the examples disclosed herein may be arranged in a device as described in this embodiment or alternatively may be located in one or more devices different from the devices in this example. The modules in the foregoing examples may be combined into one module or may be further divided into multiple sub-modules.

Those skilled in the art will appreciate that the modules in the devices in an embodiment may be adaptively changed and arranged in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments.

As used herein, unless otherwise specified the use of the ordinal adjectives "first", "second", "third", etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.

While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as described herein. Moreover, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense with respect to the scope of the invention, as defined in the appended claims.

Claims

1. An interaction method, performed in a terminal device adapted to be communicatively connected to one or more external devices, the method comprising:

acquiring scene information, and judging whether a starting command exists or not according to the scene information;

if the starting command exists, acquiring an iris image of the user;

determining the identity information of the user according to the iris image, and authenticating the identity information;

and if the authentication is passed, responding to a voice control instruction of the user, and controlling the operation of the external equipment according to the voice control instruction.

2. The method of claim 1, wherein the scene information comprises a scene image; acquiring scene information, and judging whether a starting command exists according to the scene information, wherein the method comprises the following steps:

and acquiring a scene image in real time, and judging whether a gesture starting command exists according to the scene image.

3. The method of claim 2, wherein determining whether a gesture initiating command exists based on the scene image comprises:

judging whether the scene image contains a first preset gesture or not;

if the first predetermined gesture is included, it is determined that a gesture initiating command exists.

4. The method of claim 2, further comprising:

judging whether a gesture canceling command exists according to the scene image;

and if the gesture cancellation command exists, stopping responding to the voice control instruction of the user.

5. The method of claim 4, wherein determining whether a gesture cancel command is present based on the scene image comprises:

judging whether the scene image contains a second preset gesture or not;

if the second predetermined gesture is included, it is determined that a gesture cancel command exists.

6. The method of any one of claims 1-5, wherein the scene information includes scene speech; acquiring scene information, and judging whether a starting command exists according to the scene information, wherein the method comprises the following steps:

and acquiring scene voice in real time, and judging whether a voice starting command exists according to the scene voice.

7. The method of any one of claims 1-5, wherein prior to responding to the user's voice control instructions, comprising:

and playing the voice prompt message to prompt that the identity information passes the authentication.

8. The method of any of claims 1-5, the external device comprising a computing device; controlling the operation of the external device according to the voice control instruction, including:

and controlling the starting and/or the login of the operating system of the computing device according to the voice control instruction.

9. The method of claim 8, wherein the terminal device is adapted to be communicatively coupled to a server, and wherein the computing device includes an application adapted to communicate with the server;

controlling the operation of the external device according to the voice control instruction, including:

sending the voice control instruction to the application program via the server so that the application program controls the operation of the computing device according to the voice control instruction.

10. The method of any one of claims 1-5, wherein the external device further comprises a lock; controlling the operation of the external device according to the voice control instruction, including:

and controlling the lockset to be opened or closed according to the voice control instruction.

11. A terminal device adapted to be communicatively coupled to one or more external devices, comprising:

the scene acquisition module is suitable for acquiring scene information;

the iris acquisition module is suitable for acquiring an iris image of a user;

and the control module is respectively in communication connection with the scene acquisition module and the iris acquisition module, is suitable for acquiring the scene information, judges whether a starting command exists according to the scene information, controls the iris acquisition module to acquire an iris image of a user if the starting command exists, determines the identity information of the user according to the iris image, authenticates the identity information, responds to a voice control instruction of the user if the authentication is passed, and controls the operation of the external equipment according to the voice control instruction.

12. The terminal device of claim 11, wherein the scene information includes a scene image and a scene voice, and the scene capturing module includes:

the image acquisition module is suitable for acquiring a scene image and sending the scene image to the control module so that the control module can judge whether a gesture starting command exists according to the scene image;

and the sound acquisition module is suitable for acquiring scene voice and sending the scene voice to the control module so that the control module can judge whether a voice starting command exists according to the scene voice.

13. The terminal device of claim 11 or 12, wherein the iris acquisition module comprises:

an iris lens;

and the driving mechanism is connected with the iris lens and is suitable for driving the iris lens to move so as to position the iris lens to the eyes of the user and acquire the iris image of the eyes of the user.