CN103024146A - Method for controlling display screen and mobile intelligent terminal - Google Patents

Abstract

The present invention is applicable to the field of mobile communication technology, and provides a method for controlling a display screen and a mobile intelligent terminal, the method comprising: the front camera of the mobile terminal captures the image data; judging whether the front camera detects a human eye based on the image data; if a human eye is detected, controlling the backlight of the mobile terminal to remain lit. The present invention uses the front camera to obtain image data, and judges whether someone is browsing the mobile terminal display screen based on the image data. When it is judged that someone is browsing the mobile terminal camera, a method of keeping the backlight on or prompting the user is adopted, which solves the problem of poor user experience caused by the timed backlight off or the accidental touch of the power off button when the user browses the mobile terminal screen under the prior art.

Description

Method for controlling display screen and mobile smart terminal

technical field

The invention belongs to the technical field of mobile communication, and in particular relates to a method for controlling a display screen and a mobile intelligent terminal.

Background technique

Existing mobile smart terminals such as mobile phones and tablet computers generally enter the dormant state or shut down at a preset time, that is, when the mobile phone and tablet computer do not receive touch and key signals and reach a preset time threshold, the mobile phone and tablet computer enters the sleep mode. In the dormant state, the display screen enters the dormant state or turns off, but there are certain problems in this setting. When the user is reading a book, browsing the web news or watching a video, the display screen may be turned off suddenly or the display screen enters a dormant state, affecting the user experience. Therefore, there is a problem in the prior art that when a user browses the screen of a mobile terminal, the backlight is turned off regularly or the display screen of the mobile phone is turned off by misoperation, which brings a bad experience.

Contents of the invention

The purpose of the embodiments of the present invention is to provide a method for controlling the display screen and a mobile smart terminal, so as to solve the problem in the prior art that when a user browses the screen of the mobile terminal, the backlight is turned off at regular intervals or the display screen of the mobile phone is turned off due to misuse. Problem with poor experience.

The embodiment of the present invention is realized in this way, a method for controlling a display screen, the method includes the following steps:

The front camera of the mobile terminal captures image data;

According to the image data, it is judged whether the front camera detects human eyes;

If human eyes are detected, control the backlight of the mobile terminal to keep on.

Another object of the embodiments of the present invention is to provide a smart mobile terminal, which includes:

The acquisition unit is used for the front-facing camera of the mobile terminal to capture image data;

A judging unit, configured to judge whether the front camera detects human eyes according to the image data;

The control unit is configured to control the backlight of the mobile terminal to keep on if the human eyes are detected.

In the embodiment of the present invention, the front camera is used to determine whether the human eye is within the viewfinder range of the camera. When it is determined that the human eye is within the viewfinder range of the camera, the backlight of the mobile terminal is controlled to remain on, or the user is prompted to decide whether to turn off the display screen or Whether to make the display screen dormant solves the problem existing in the prior art that when a user browses the screen of a mobile terminal, the backlight is turned off at regular intervals or the display screen of the mobile phone is turned off by misoperation, which brings about a bad experience.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the accompanying drawings that need to be used in the descriptions of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only of the present invention. For some embodiments, those of ordinary skill in the art can also obtain other drawings based on these drawings without any creative effort.

Fig. 1 is the implementation flowchart of the method for controlling the display screen provided by the present invention;

Fig. 2 is a block diagram of a mobile intelligent terminal for controlling a display screen provided by the present invention.

Detailed ways

In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

The present invention provides a method for controlling a display screen, the method is shown in Figure 1, and the specific steps include:

S11. The front camera of the mobile terminal takes a view and collects image data.

S12. According to the image data, determine whether the front camera detects human eyes.

S13. If human eyes are detected, control the backlight of the mobile terminal to keep on.

It should be noted that the purpose of step S13 is to determine that someone is browsing the screen of the mobile terminal if human eyes are detected, so the backlight is kept on.

Optionally, the method for realizing S12 is specifically:

Converting the image data into a binary skin color segmentation map;

Extracting the area where the pixels are greater than the preset value on the binary skin color segmentation map, and determining the range area of the human face;

It should be noted that, generally, the preset value is a specific value of about 300, so that the area of the face can be determined.

In the range area of the human face, if a black part is found, it is determined that the camera has detected human eyes.

It should be noted that after image processing, the black parts that can be found in the area of the face indicate the eyes and eyebrows. It can be confirmed that the human eyes are in the image data of the camera, and it can be further confirmed that someone is browsing the mobile phone screen.

Optionally, the converting the image data into a binary skin color segmentation map specifically includes:

Convert the RGB values in the image data into YCbCr color coding,

$\left[\begin{array}{c}\mathrm{<span\; class="notranslate">\; Y</span>}\\ \mathrm{<span\; class="notranslate">\; Cb</span>}\\ \mathrm{<span\; class="notranslate">\; Cr</span>}\end{array}\right]<span\; class="notranslate">\; =</span>\frac{\mathrm{<span\; class="notranslate">\; 1</span>}}{\mathrm{<span\; class="notranslate">\; 256</span>}}\left[\begin{array}{ccc}\mathrm{<span\; class="notranslate">\; 65.738</span>}& \mathrm{<span\; class="notranslate">\; 129.057</span>}& \mathrm{<span\; class="notranslate">\; 25.06</span>}\\ <span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; 37.945</span>}& <span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; 74.494</span>}& \mathrm{<span\; class="notranslate">\; 112.43</span>}\\ \mathrm{<span\; class="notranslate">\; 112.439</span>}& <span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; 94.154</span>}& <span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; 18.28</span>}\end{array}\right]\left[\begin{array}{c}\mathrm{<span\; class="notranslate">\; R</span>}\\ \mathrm{<span\; class="notranslate">\; G</span>}\\ \mathrm{<span\; class="notranslate">\; B</span>}\end{array}\right]<span\; class="notranslate">\; +</span>\left[\begin{array}{c}\mathrm{<span\; class="notranslate">\; 16</span>}\\ \mathrm{<span\; class="notranslate">\; 128</span>}\\ \mathrm{<span\; class="notranslate">\; 128</span>}\end{array}\right]<span\; class="notranslate">\; ;</span>$

a赋值为25.39，b赋值为14.03，ec_x赋值为1.60，ec_y赋值为2.41，计算所述（x，y），所述（x，y）离坐标原点距离代表肤色聚类亮度；The YCbCr color code is subjected to nonlinear transformation to obtain the brightness of skin color clusters. The specific formula is:

a is assigned a value of 25.39, b is assigned a value of 14.03, ec _x is assigned a value of 1.60, and ec _y is assigned a value of 2.41, and the (x, y) is calculated, and the distance between the (x, y) and the coordinate origin represents the brightness of the skin color cluster;

The image data is converted into a binary skin color segmentation map of the skin color area according to the brightness of the skin color clusters.

Preferably, before the step S13, it may also include:

The front camera of the mobile terminal is switched to a low frame rate mode, and the frame rate of the low frame rate mode is lower than 1 frame/second.

It should be noted that the beneficial effect of switching the front camera of the mobile terminal to the low frame rate mode is to avoid frequent use of the camera to consume a large amount of power.

Optionally, before the step S11, it also includes:

Receiving a command to turn off the display screen or to make the display screen dormant, and start the front camera.

Optionally, the above method also includes:

Prompts the user whether to turn off the display or sleep the display.

It should be noted that when the user is browsing the screen and touches the power button or other shutdown buttons by mistake, start the camera to check whether there are human eyes. If human eyes are detected, it will be considered that there is a user browsing the screen, and the user will be reminded to decide whether to close the screen. Display or make the display dormant, you can avoid bad experience caused by wrong operation.

Optionally, before the step S11, it also includes:

The front camera is activated each time the backlight time period arrives.

Optionally, the above method also includes:

Control the backlight from being on until the next backlight time period arrives.

It should be noted that when the backlight of the mobile phone is on for a period of time, if there is no user operation, the mobile phone will automatically turn off the backlight, but at this time there may be users browsing mobile web pages or other content. The above method avoids this situation. Appear.

Optionally, before the step S11, it also includes:

The front-facing camera is activated each time a preset time period for collecting image data by the camera arrives.

Optionally, the above method also includes:

Control the time period from when the backlight is on to when the next camera collects image data arrives.

The present invention provides a mobile intelligent terminal for controlling a display screen. The mobile intelligent terminal is shown in FIG. 2 and specifically includes:

Acquisition unit 21, used for capturing image data of the front camera of the mobile terminal;

A judging unit 22, configured to judge whether the front camera detects human eyes according to the image data;

The control unit 23 is configured to control the backlight of the mobile terminal to keep on if a human eye is detected.

Optionally, the judging unit 22 specifically includes:

A conversion module, for converting the image data into a binary skin color segmentation map;

A determination module, configured to extract an area with pixels greater than a preset value on the binary skin color segmentation map, and determine a face range area;

The searching and judging module is used for judging that the camera detects human eyes if a black part is found in the range area of the human face.

Optionally, the conversion module specifically includes:

The first conversion sub-module is used to convert the RGB value in the image data into YCbCr color coding,

$\left[\begin{array}{c}\mathrm{<span\; class="notranslate">\; Y</span>}\\ \mathrm{<span\; class="notranslate">\; Cb</span>}\\ \mathrm{<span\; class="notranslate">\; Cr</span>}\end{array}\right]<span\; class="notranslate">\; =</span>\frac{\mathrm{<span\; class="notranslate">\; 1</span>}}{\mathrm{<span\; class="notranslate">\; 256</span>}}\left[\begin{array}{ccc}\mathrm{<span\; class="notranslate">\; 65.738</span>}& \mathrm{<span\; class="notranslate">\; 129.057</span>}& \mathrm{<span\; class="notranslate">\; 25.06</span>}\\ <span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; 37.945</span>}& <span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; 74.494</span>}& \mathrm{<span\; class="notranslate">\; 112.43</span>}\\ \mathrm{<span\; class="notranslate">\; 112.439</span>}& <span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; 94.154</span>}& <span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; 18.28</span>}\end{array}\right]\left[\begin{array}{c}\mathrm{<span\; class="notranslate">\; R</span>}\\ \mathrm{<span\; class="notranslate">\; G</span>}\\ \mathrm{<span\; class="notranslate">\; B</span>}\end{array}\right]<span\; class="notranslate">\; +</span>\left[\begin{array}{c}\mathrm{<span\; class="notranslate">\; 16</span>}\\ \mathrm{<span\; class="notranslate">\; 128</span>}\\ \mathrm{<span\; class="notranslate">\; 128</span>}\end{array}\right]<span\; class="notranslate">\; ;</span>$

The transformation sub-module is used to perform nonlinear transformation on the YCbCr color code to obtain the brightness of the skin color clustering, and the specific formula is: a is assigned a value of 25.39, b is assigned a value of 14.03, ec _x is assigned a value of 1.60, and ec _y is assigned a value of 2.41, and the (x, y) is calculated, and the distance between the (x, y) and the coordinate origin represents the brightness of the skin color cluster;

The second conversion sub-module is used to convert the image data into a binary skin color segmentation map of the skin color area according to the brightness of the skin color clusters.

Preferably, the mobile intelligent terminal also includes:

The switching module is used to switch the front camera of the mobile terminal to a low frame rate mode, and the frame rate of the low frame rate mode is lower than 1 frame/second.

Optionally, the smart mobile terminal also includes:

The first starting unit is configured to receive a command to turn off the display screen or make the display screen dormant, and start the front camera.

Further, the smart mobile terminal also includes:

The prompt unit is used to prompt the user whether to turn off the display screen or make the display screen dormant.

Optionally, the smart mobile terminal also includes:

The second starting unit is configured to start the front camera each time the backlight time period arrives.

Further, the smart mobile terminal also includes:

The first control unit is used to control the backlight from being on until the arrival of the next backlight time period.

Optionally, the smart mobile terminal also includes:

The third starting unit is configured to start the front-facing camera each time a preset time period for collecting image data by the camera arrives.

Further, the smart mobile terminal also includes:

The second control unit is used to control the backlight from being in the on state until the arrival of the next time period for collecting image data by the camera.

Those of ordinary skill in the art can understand that the various modules included in the above-mentioned embodiments are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be realized; in addition, the specific names of each functional module It is only for the convenience of distinguishing each other, and is not used to limit the protection scope of the present invention.

Those of ordinary skill in the art can also understand that all or part of the steps in the method for controlling the display screen in the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a mobile smart terminal and can be read In the storage medium, the storage medium includes ROM/RAM and the like.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. within range.

Claims (20)

1. the method for control display screen is characterized in that described method comprises:

The front-facing camera of the portable terminal acquisition of image data of finding a view;

According to described view data, judge whether front-facing camera detects human eye;

As detecting human eye, the backlight of control portable terminal continues to keep illuminating state.

2. the method for claim 1 is characterized in that, and is described according to described view data, judges whether front-facing camera detects human eye and be specially:

Described view data is converted to two-value skin color segmentation figure;

Extract pixel greater than the zone of preset value at described two-value skin color segmentation figure, determine people's face scope zone;

In described people's face scope zone, if find the black part, judge that then camera detects human eye.

3. method as claimed in claim 2 is characterized in that, describedly described view data is converted to two-value skin color segmentation figure is specially:

Convert the rgb value in the described view data color-code of YCbCr to,

$\left[\begin{array}{c}Y\\ \mathrm{Cb}\\ \mathrm{Cr}\end{array}\right]=\frac{1}{256}\left[\begin{array}{ccc}65.738& 129.057& 25.06\\ -37.945& -74.494& 112.43\\ 112.439& -94.154& -18.28\end{array}\right]\left[\begin{array}{c}R\\ G\\ B\end{array}\right]+\left[\begin{array}{c}16\\ 128\\ 128\end{array}\right];$

The YCbCr color-code is carried out nonlinear transformation, obtain the brightness of colour of skin cluster, concrete formula is:

The a assignment is that 25.39, b assignment is 14.03, ec _xAssignment is 1.60, ec _yAssignment is 2.41, calculate described (x, y), described (x, y) from the origin of coordinates apart from representing the brightness of colour of skin cluster;

Described view data is converted to the two-value skin color segmentation figure of area of skin color according to the brightness of described colour of skin cluster.

4. such as each described method of claim 1-3, it is characterized in that the front-facing camera of described portable terminal is found a view and specifically also comprised before the acquisition of image data:

The front-facing camera of portable terminal switches to low frame per second pattern, and the frame rate of described low frame per second pattern was lower than for 1 frame/second.

5. the method for claim 1 is characterized in that, the front-facing camera of the described portable terminal acquisition of image data of finding a view specifically also comprises:

Reception is closed display screen or is made the order of display screen dormancy, starts described front-facing camera.

6. method as claimed in claim 5 is characterized in that, described method also comprises:

Whether prompting user is closed display screen or is made the display screen dormancy.

7. the method for claim 1 is characterized in that, the front-facing camera of the described portable terminal acquisition of image data of finding a view specifically also comprises:

Each time cycle backlight arrives and starts described front-facing camera.

8. method as claimed in claim 7 is characterized in that, described method also comprises:

The control backlight is in illuminating state to next time cycle arrival backlight.

9. the method for claim 1 is characterized in that, the front-facing camera of the described portable terminal acquisition of image data of finding a view specifically also comprises:

Each default camera collection view data time cycle starts described front-facing camera when arriving.

10. method as claimed in claim 9 is characterized in that, described method also comprises:

The control backlight is in illuminating state to next camera collection view data time cycle arrival.

11. the mobile intelligent terminal of a control display screen is characterized in that described mobile intelligent terminal comprises:

Collecting unit, the front-facing camera that the is used for portable terminal acquisition of image data of finding a view;

Judging unit is used for according to described view data, judges whether front-facing camera detects human eye;

Control unit is used for as detecting human eye, and the backlight of control portable terminal continues to keep illuminating state.

12. mobile intelligent terminal as claimed in claim 11 is characterized in that, described judging unit specifically comprises:

Modular converter is used for described view data is converted to two-value skin color segmentation figure;

Determination module is used for extracting pixel greater than the zone of preset value at described two-value skin color segmentation figure, determines people's face scope zone;

Search judge module, be used for if find the black part, judging then that camera detects human eye in described people's face scope zone.

13. mobile intelligent terminal as claimed in claim 12 is characterized in that, modular converter specifically comprises:

The first conversion submodule, for the color-code that the rgb value of described view data is converted to YCbCr,

$\left[\begin{array}{c}Y\\ \mathrm{Cb}\\ \mathrm{Cr}\end{array}\right]=\frac{1}{256}\left[\begin{array}{ccc}65.738& 129.057& 25.06\\ -37.945& -74.494& 112.43\\ 112.439& -94.154& -18.28\end{array}\right]\left[\begin{array}{c}R\\ G\\ B\end{array}\right]+\left[\begin{array}{c}16\\ 128\\ 128\end{array}\right];$

Transformation submodule is used for the YCbCr color-code is carried out nonlinear transformation, obtains the brightness of colour of skin cluster, and concrete formula is:

The a assignment is that 25.39, b assignment is 14.03, ec _xAssignment is 1.60, ec _yAssignment is 2.41, calculate described (x, y), described (x, y) from the origin of coordinates apart from representing the brightness of colour of skin cluster;

The second conversion submodule is for the two-value skin color segmentation figure that described view data is converted to area of skin color according to the brightness of described colour of skin cluster.

14. such as each described mobile intelligent terminal of claim 11 to 13, it is characterized in that described mobile intelligent terminal also comprises:

Handover module, the front-facing camera that is used for portable terminal switches to low frame per second pattern, and the frame rate of described low frame per second pattern was lower than for 1 frame/second.

15. mobile intelligent terminal as claimed in claim 11, described mobile intelligent terminal also comprises:

The first start unit is used for receiving the order of closing display screen or making the display screen dormancy, starts described front-facing camera.

16. mobile intelligent terminal as claimed in claim 15 is characterized in that, described mobile intelligent terminal also comprises:

Tip element is used for prompting user and whether closes display screen or make the display screen dormancy.

17. mobile intelligent terminal as claimed in claim 11 is characterized in that, described portable terminal also comprises:

The second start unit is used for each time cycle arrival backlight and starts described front-facing camera.

18. mobile intelligent terminal as claimed in claim 17 is characterized in that, described portable terminal also comprises:

The first control unit is used for the control backlight and is in illuminating state to next time cycle arrival backlight.

19. mobile intelligent terminal as claimed in claim 11 is characterized in that, described mobile intelligent terminal also comprises:

The 3rd start unit, the camera collection view data time cycle that is used at every turn presetting starts described front-facing camera when arriving.

20. mobile intelligent terminal as claimed in claim 19 is characterized in that, described mobile intelligent terminal also comprises:

The second control unit is used for the control backlight and is in illuminating state to next camera collection view data time cycle arrival.

Images