CN103853330A - Method for controlling display layer to be switched based on eyes and mobile terminal - Google Patents

Abstract

The invention discloses a method for controlling display layer switching based on eyes and a mobile terminal. The method for controlling display layer switching based on eyes includes the steps of: displaying at least one switching area at a preset position on the screen; detecting whether the eyes are fixed on the switching area; if yes, switch the current display layer to the display layer corresponding to the switching area. Therefore, the fast switching of the display layer is controlled by gazing at the switching area, which enriches the operation method, liberates the user's hands, enhances the convenience of the user's operation, and improves the user experience. At the same time, by displaying part of the content of the corresponding display layer in the switching area, the user can preview the part of the content to accurately determine whether the display layer is the target display layer, avoid repeated switching due to misjudgment, improve operational efficiency, and further enhance user experience. .

Description

Method and mobile terminal for controlling display layer switching based on eyes

technical field

The invention relates to the field of communication technology, in particular to a method for controlling display layer switching based on eyes and a mobile terminal.

Background technique

Mobile terminals usually have multiple display layers, and each display layer displays content such as images and text. Usually, only one display layer is displayed on the screen of the mobile terminal at a time. When another display layer needs to be displayed, the display layer needs to be displayed. Toggle action.

In the prior art, when the user switches the display layer, he can only switch the display layer by sliding his finger or clicking the screen. When the user's hands are inconvenient, it is impossible to switch the display layer; or, when the screen is large, it will be more difficult for the user to perform the switching operation with one hand, and even cause misoperation. Therefore, the existing mobile terminals are not convenient enough for display layer switching, and the user experience is not good.

Contents of the invention

The main purpose of the present invention is to provide a method for controlling display layer switching based on eyes and a mobile terminal, aiming at freeing the user's hands, enhancing the convenience of user operation, and improving user experience.

In order to achieve the above purpose, the present invention proposes a method for controlling display layer switching based on eyes, comprising steps:

displaying at least one switching area at a preset position on the screen;

detecting whether eyes are fixed on the switching area;

If yes, switch the current display layer to the display layer corresponding to the switching area.

Preferably, the detecting whether the eyes are fixed on the switching area includes:

Detecting whether the line of sight of the eyes falls into the switching area and lasts for a preset time;

If yes, it is determined that eyes are fixed on the switching area.

Preferably, the detecting whether the eyes are fixed on the switching area includes:

Detect whether the line of sight of the eye falls into the switching area and has an eye blinking action;

If yes, it is determined that eyes are fixed on the switching area.

Preferably, the switching area displays part of the content of the corresponding display layer.

Preferably, the switching area is a switching label of a corresponding display layer.

The present invention also proposes a mobile terminal, including a display module, a detection module, and a processing module. The display module includes at least two display layers, wherein:

A display module, configured to display at least one switching area at a preset position on the screen;

A detection module, configured to detect whether the eyes are fixed on the switching area, and if so, send a switching signal to the processing module;

A processing module, configured to switch the current display layer to the display layer corresponding to the switching area according to the switching signal.

Preferably, the detection module includes a camera and an analysis and calculation unit, wherein:

The camera is used to track eyeballs and take images;

The analyzing and calculating unit is used for judging whether the line of sight of the eye falls into the switching area and lasts for a preset time according to the image, and if so, determines that the eye is focused on the switching area.

Preferably, the detection module includes a camera and an analysis and calculation unit, wherein:

The camera is used to track eyeballs and take images;

The analysis and calculation unit is used to determine whether the sight line of the eye falls into the switching area and has a blinking action according to the image, and if so, determines that the eye is fixed on the switching area.

The method for controlling display layer switching based on eyes provided by the present invention realizes fast switching of display layers by gazing at the switching area with the eyes, which enriches the operation method, liberates the user's hands, enhances the convenience of user operation, and improves the user experience. experience. At the same time, by displaying part of the content of the corresponding display layer in the switching area, the user can preview the part of the content to accurately determine whether the display layer is the target display layer, avoiding repeated switching due to misjudgment, improving operational efficiency, and further improving user experience .

Description of drawings

FIG. 1 is a flow chart of the first embodiment of the method for controlling display layer switching based on eyes of the present invention;

Fig. 2 is a schematic diagram of an example of the arrangement of display layers in the present invention;

3 is a schematic diagram of an example of displaying a switching area on a display layer in the present invention;

Fig. 4 is a schematic diagram after switching display layers in the present invention;

Fig. 5 is a flow chart of the second embodiment of the method for controlling display layer switching based on eyes of the present invention;

Fig. 6 is a structural block diagram of an embodiment of the mobile terminal of the present invention;

FIG. 7 is a structural block diagram of the detection module in FIG. 6 .

The realization of the purpose of the present invention, functional characteristics and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

Detailed ways

It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

Referring to FIG. 1 , the first embodiment of the method for controlling display layer switching based on eyes of the present invention is proposed, and the method for controlling display layer switching based on eyes includes the following steps:

Step S101: Display at least one switching area at a preset position on the screen

The preset position may be a preset fixed position, such as the left, right, top or bottom of the screen, or may be preset as a blank position of the current display layer. The switching area may be a switching icon or a switching label. If it is a switching label, the number of switching areas depends on the number of display layers. If there are two display layers, there will be one switching area. If there are three or more display layers, there will be more than two switching areas. Preferably, the switching area is an area displaying part of the content of the corresponding display layer, the number of which is the same as the switching labels, and determined according to the number of display layers. The part of the content may be part of the content randomly extracted from the display layer, or may be a representative part of the content on the display layer, or may be user-defined content. The partial content may be images or texts.

As shown in FIG. 2 , the mobile terminal has four display layers 1 to 4, and the four display layers are stacked vertically together as shown in FIG. 3 . Among them, the current display layer is display layer 1, and there is a house image P0 on display layer 1, and the rest is a blank area, and the blank area has three switching areas, and each switching area displays part of the content on the corresponding display layer, and the Part of the content just corresponds to the switching area, and the content displayed here is all images, which are P1, P2, and P3 respectively. Moreover, part of the content displayed in the switching area is relatively blurred, not as clear as the content on the current display layer, and the clarity decreases with the stacking order of the display layer from top to bottom, showing a sense of hierarchy. As shown in Figure 3, the first to fourth display layers are stacked in sequence, the display layer 1 is the current display layer, and the image P0 on it is the clearest; the image P1 of the display layer 2 displayed in the first switching area, the second switching area The sharpness of the displayed image P2 of the display layer 3 and the image P3 of the display layer 4 displayed in the third switching area decreases sequentially.

Step S102: Detect whether the sight line of the eyes falls into a switching area and lasts for a preset time

The mobile terminal tracks the movement of the eyeball through the camera, and takes an image of the eyeball, then analyzes the direction of the eye's line of sight according to the eyeball image, calculates the intersection point of the line of sight and the screen, and judges whether the line of sight of the eye falls into a certain switching area according to the coordinate position of the intersection point. If it is determined that the line of sight falls into a certain switching area and lasts for a preset time, then it is determined that the eyes are fixed on the switching area, and then enter step S103; In this switching area, the mobile terminal does not respond and continues to track eyeballs.

Step S103: Switch the current display layer to the display layer corresponding to the switching area

When the mobile terminal determines that eyes are fixed on the switching area, it switches the current display layer to the display layer corresponding to the switching area, and simultaneously generates and displays the switching area corresponding to the switched display layer on the screen.

As shown in Figure 3, when it is determined that the user's eyes are focused on the image P1 in the first switching area, the current display layer is switched to the display layer 2 corresponding to the first switching area, and after switching, as shown in Figure 4, the display layer The text content and image content on 2 are all displayed, and the switching area among Fig. 4 is omitted and not shown.

For the switching of the vertically stacked display layers as shown in Figure 2-Figure 4, the mobile terminal can realize the switching of the display layer by sinking the current display layer 1 and floating the display layer 2 as the first layer to cover the display layer 1; Or through optical adjustment (such as pixel adjustment, etc.) to display all the content on the display layer 2 clearly, while all the content on the display layer 1 is invisible or allow part of the content to be displayed in the switching area with a lower definition.

Referring to FIG. 5 , the method for controlling display layer switching based on eyes of the present invention is proposed, and the method for controlling display layer switching based on eyes includes the following steps:

Step S201: Display at least one switching area at a preset position on the screen

Step S202: Detect whether the line of sight of the eye falls into a certain switching area and has a blinking action

The mobile terminal tracks the movement of the eyeball through the camera, and takes an image of the eyeball, and then analyzes the direction of the eye's line of sight according to the eyeball image, and judges the intersection point of the line of sight and the screen based on this, and judges whether the line of sight of the eye falls into a certain switching area according to the coordinate position of the intersection point. If it is determined that the line of sight falls into a certain switching area, then continue to judge whether there is a blinking action during this period, if there is, then it is determined that the eyes are fixed on the switching area, and enter step S203; if it is determined that the line of sight does not fall into a certain switching area or there is no If the eye blinks, it is determined that the eyes are not watching the switching area, the mobile terminal does not respond, and continues to track the eyeballs.

Step S203: Switch the current display layer to the display layer corresponding to the switching area

In some embodiments, there are also specific switching areas. When the user focuses on some specific switching areas, the mobile terminal will switch forward to the next layer or back to the previous layer.

Accordingly, the method for switching display layers based on eye control of the present invention realizes fast switching of display layers by focusing on the switching area with the eyes, which enriches the operation method, liberates the user's hands, enhances the convenience of user operation, and improves user experience .

By displaying part of the content of the corresponding display layer in the switching area, the user can preview the part of the content to accurately determine whether the display layer is the target display layer, avoiding repeated switching due to misjudgment, improving operational efficiency, and further improving user experience.

Referring to Fig. 6 and Fig. 7, an embodiment of the mobile terminal of the present invention is proposed, the mobile terminal includes a display module 110, a detection module 120 and a processing module 130, and the display module 110 includes at least two display layers, wherein:

Display module 110: including at least two display layers, on which content such as images and texts are displayed. Wherein, including displaying at least one switching area at a preset position on the screen.

The preset position may be a preset fixed position, such as the left, right, top or bottom of the screen, or may be preset as a blank position of the current display layer. The switching area may be a switching icon or a switching label. If it is a switching label, the number of switching areas depends on the number of display layers. If there are two display layers, there will be one switching area. If there are three or more display layers, there will be more than two switching areas. Preferably, the switching area is an area displaying part of the content of the corresponding display layer, the number of which is the same as the switching labels, and determined according to the number of display layers. The part of the content may be part of the content randomly extracted from the display layer, or may be a representative part of the content on the display layer, or may be user-defined content. The partial content may be images or texts.

As shown in FIG. 2 , the display module 110 has four display layers, and the four display layers are stacked vertically together as shown in FIG. 3 . Among them, the current display layer is display layer 1, and there is a house image P0 on display layer 1, and the rest is a blank area, and the blank area has three switching areas, and each switching area displays part of the content on the corresponding display layer, and the Part of the content just corresponds to the switching area, and the content displayed here is all images, which are P1, P2, and P3 respectively. Moreover, part of the content displayed in the switching area is relatively blurred, not as clear as the content on the current display layer, and the clarity decreases with the stacking order of the display layer from top to bottom, showing a sense of hierarchy. As shown in Figure 3, the display layers 1 to 4 are stacked in sequence, and the display layer 1 is the current display layer, and the image P0 on it is the clearest; the image P1 of the display layer 2 displayed in the first switching area, and the The sharpness of the image P2 of the display layer 3 and the image P3 of the display layer 4 displayed in the third switching area decreases successively.

Detection module 120 : used to detect whether the eyes are focused on a certain switching area, and if so, send a switching signal to the processing module 130 .

As shown in FIG. 7 , the detection module 120 includes a camera 121 and an analysis and calculation unit 122 . Wherein, the camera 121 is used to track the movement of the eyeball and take pictures of the eyeball. The analysis and calculation unit 122 is used to analyze the line of sight direction of the eyes according to the eyeball image, calculate the intersection point of the line of sight and the screen, and judge whether the line of sight of the eyes falls into a certain switching area according to the coordinate position of the intersection point; if it is determined that the line of sight falls into a certain switching area and continues Preset time, it is determined that the eyes are watching the switching area, and a switching signal is sent to the processing unit 130; to respond.

In some embodiments, the analysis and calculation unit 122 is used to analyze the line of sight direction of the eye according to the eyeball image, calculate the intersection point of the line of sight and the screen, and judge whether the line of sight of the eye falls into a certain switching area according to the coordinate position of the intersection point; Enter a certain switching area, then continue to judge whether there is a blinking action during this period, if there is, then determine that the eyes are watching the switching area, and send a switching signal to the processing unit 130; if it is determined that the line of sight does not fall into a certain switching area or If there is no blinking action during this period, it is determined that the eyes are not watching the switching area, and no response is given.

Processing module 130: for switching the current display layer to the display layer corresponding to the switching area according to the switching signal, and simultaneously generating a switching area corresponding to the switched display layer on the screen and controlling the display module 110 to display it.

As shown in Figure 3, when it is determined that the user's eyes are focused on the image P1 in the first switching area, the current display layer is switched to the display layer 2 corresponding to the first switching area, and after switching, as shown in Figure 4, the display layer The text content and image content on 2 are all displayed, and the switching area among Fig. 4 is omitted and not shown.

For the switching of the vertically stacked display layers as shown in Figures 2-4, the processing module 130 can realize the switching of the display layer by sinking the current display layer 1 and floating the display layer 2 as the first layer to cover the display layer 1. Switching; or through optical adjustment (such as pixel adjustment, etc.) to make all the content on the display layer 2 clearly displayed, while all the content on the display layer 1 is invisible or allow some content to be displayed in the switching area with a lower definition .

Therefore, the mobile terminal of the present invention realizes fast switching of the display layer by looking at the switching area, which enriches the operation method, frees the user's hands, enhances the convenience of the user's operation, and improves the user experience.

By displaying part of the content of the corresponding display layer in the switching area, the user can preview the part of the content to accurately determine whether the display layer is the target display layer, avoiding repeated switching due to misjudgment, improving operational efficiency, and further improving user experience.

It should be understood that the above are only preferred embodiments of the present invention, and cannot therefore limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the description of the present invention and the contents of the accompanying drawings, or directly or indirectly used in Other relevant technical fields are all equally included in the patent protection scope of the present invention.

Claims (10)

1. A method for controlling display layer switching based on eyes, comprising the steps of: displaying at least one switching area at a preset position on the screen; detecting whether eyes are fixed on the switching area; If yes, switch the current display layer to the display layer corresponding to the switching area. 2. The method for controlling display layer switching based on eyes according to claim 1, wherein the detecting whether eyes are focused on the switching area comprises: Detecting whether the line of sight of the eyes falls into the switching area and lasts for a preset time; If yes, it is determined that eyes are fixed on the switching area. 3. The method for controlling display layer switching based on eyes according to claim 1, wherein the detecting whether eyes are focused on the switching area comprises: Detect whether the line of sight of the eye falls into the switching area and has an eye blinking action; If yes, it is determined that eyes are fixed on the switching area. 4. The method for controlling display layer switching based on eyes according to any one of claims 1-3, wherein the switching area displays part of the content of the corresponding display layer. 5. The method for controlling display layer switching based on eyes according to any one of claims 1-3, wherein the switching area is a switching label of a corresponding display layer. 6. A mobile terminal, characterized in that it includes a display module, a detection module and a processing module, the display module includes at least two display layers, wherein: A display module, configured to display at least one switching area at a preset position on the screen; A detection module, configured to detect whether the eyes are fixed on the switching area, and if so, send a switching signal to the processing module; A processing module, configured to switch the current display layer to the display layer corresponding to the switching area according to the switching signal. 7. The mobile terminal according to claim 6, wherein the detection module includes a camera and an analysis and calculation unit, wherein: The camera is used to track eyeballs and take images; The analyzing and calculating unit is used for judging whether the line of sight of the eye falls into the switching area and lasts for a preset time according to the image, and if so, determines that the eye is focused on the switching area. 8. The mobile terminal according to claim 6, wherein the detection module includes a camera and an analysis and calculation unit, wherein: The camera is used to track eyeballs and take images; The analysis and calculation unit is used to determine whether the sight line of the eye falls into the switching area and has a blinking action according to the image, and if so, determines that the eye is fixed on the switching area. 9. The mobile terminal according to any one of claims 6-8, wherein the switching area displays part of the content of the corresponding display layer. 10. The mobile terminal according to any one of claims 6-8, wherein the switching area is a switching label of a corresponding display layer.

Images