CN106354246A - Control method, device and terminal of terminal display - Google Patents

Abstract

The present invention provides a terminal display control method, device, and terminal. The method includes: obtaining the user's current holding method when using the terminal; dividing the display area of the terminal into an accessible area and an inaccessible area according to the holding method; detecting The user's operation intention; control the content display of the inaccessible area according to the operation intention. Through the implementation of the present invention, the display screen is divided into an accessible area and an inaccessible area according to the user's grip mode. On this basis, the user's operation intention is detected to control the display mode of the content in the inaccessible area. For example, when When the user needs to operate the inaccessible area, the content of the inaccessible area is directly displayed in the accessible area, so that the user does not need to change hands or operate the terminal with both hands, and does not need to manually switch to the one-handed operation mode through specific steps. Full-screen operation with one hand solves the problem that users of existing large-screen mobile phones cannot operate with one hand, and enhances the user experience.

Description

A terminal display control method, device and terminal

technical field

The present invention relates to the field of display control, in particular to a terminal display control method, device and terminal.

Background technique

At present, the screens of handheld electronic devices on the market are getting larger and larger. The advantage is that it brings users a better user experience, can display more content at the same time, and obtains a larger and more comfortable field of vision, but the disadvantages also follow. , In terms of operation, due to the continuous increase of the screen, many functions cannot be operated with one hand, especially the buttons/keys distributed on the upper half of the screen and the opposite side of the holding hand, which must be completed with both hands . In this way, for handheld electronic devices, there will be a lack of ease of use, which will cause inconvenience in operation and affect user experience.

Therefore, how to provide a terminal display control method that can satisfy the user's one-handed operation is a technical problem to be solved urgently by those skilled in the art.

Contents of the invention

The invention provides a terminal display control method, device and terminal to solve the problem that users of existing large-screen mobile phones cannot operate with one hand.

The present invention provides a terminal display control method, which includes: acquiring the user's current holding method when using the terminal; dividing the display area of the terminal into an accessible area and an inaccessible area according to the holding method; detecting the user's operation intention; Control the content display of the inaccessible area according to the operation intention.

Further, the operation intention includes: the user wishes to operate the accessible area, or the user wishes to operate the untouchable area; controlling the display of the terminal according to the operation intention includes: if the user wishes to operate the accessible area, control the content of the untouchable area to return to normal display ; If the user wishes to operate the untouchable area, the control terminal displays the content of the untouchable area in the accessible area.

Further, the control terminal displaying the content of the inaccessible area in the accessible area includes: the control terminal only displays the content of the inaccessible area in the accessible area, or displays the content of the inaccessible area through a floating window, or simultaneously displays the content of the inaccessible area. The content of the accessible area and the untouchable area.

Further, obtaining the user's current holding method when using the terminal includes: detecting the pressure distribution when the user uses the terminal through the pressure sensor, determining the user's holding method according to the pressure distribution, or, using the touch screen itself to determine the contact position and contact area. detection to determine how the user's hand is held.

Further, dividing the display area of the terminal into an accessible area and an untouchable area according to the holding method includes: determining the user's holding position according to the holding method, obtaining the operation range of the user's thumb when the user is holding the position, and dividing the The display area is regarded as the accessible area, and the display area outside the operating range is regarded as the untouchable area.

Further, detecting the user's operation intention includes: detecting the change of pressure/temperature/contact area when the user uses the terminal, or the distribution of 3D objects around the terminal, or the user's human brain consciousness activity, or the user's operation area selection result , to determine the operating intent.

Further, after controlling the terminal to display the content of the untouchable area in the accessible area, it also includes: detecting whether the operation on the content of the untouchable area is completed, and if so, controlling the content of the untouchable area to resume normal display.

Further, detecting whether the operation on the content of the inaccessible area is completed includes: detecting whether the user’s operation on the content of the inaccessible area is received, and if so, performing the operation and controlling the content of the inaccessible area to resume normal display; or, detecting Control whether the duration of displaying the content of the inaccessible area in the accessible area by the terminal is greater than the threshold, and if so, control the content of the inaccessible area to resume normal display.

The present invention provides a terminal display control device, which includes: an acquisition module, used to acquire the user's current grip mode when using the terminal; a division module, used to divide the display area of the terminal into accessible areas and The untouchable area; the detection module, used to detect the user's operation intention; the control module, used to control the content display of the untouchable area according to the operation intention.

Further, the operation intention includes: the user wishes to operate the accessible area, or the user wishes to operate the untouchable area; the control module is used to control the content of the untouchable area to return to normal display if the user wishes to operate the accessible area; If the untouchable area is operated, the control terminal will display the content of the untouchable area in the accessible area.

Further, the control module is used to control the terminal to display only the content of the non-touchable area in the accessible area, or display the content of the non-touchable area through the floating window, or display the content of the accessible area and the non-touchable area at the same time.

Further, the acquisition module is used to detect the pressure distribution when the user uses the terminal through the pressure sensor, determine the user's grip mode according to the pressure distribution, or determine the user's hand grip through the detection of the contact position and contact area by the touch screen itself. support method.

Further, the division module is used to determine the user's hand-held position according to the gripping method, obtain the operating range of the user's thumb when the user is holding the position, use the display area within the operating range as the accessible area, and use the display area outside the operating range as the unreachable area. reach area.

Further, the detection module is used to determine the operation by detecting the change of pressure/temperature/contact area when the user uses the terminal, or the distribution of 3D objects around the terminal, or the user's human brain consciousness activity, or the user's operation area selection result. intention.

Further, the control module is also used to detect whether the operation on the content of the inaccessible area is completed after the control terminal displays the content of the inaccessible area in the accessible area, and if so, control the content of the inaccessible area to resume normal display.

Further, the control module is used to detect whether the user’s operation on the content of the inaccessible area is received, if so, perform the operation, and control the content of the inaccessible area to return to normal display; or, the detection control terminal displays inaccessible area Whether the duration of the content in the touchable area is greater than the threshold, if so, control the content of the untouchable area to resume normal display.

The present invention provides a terminal, which includes the terminal display control device provided by the present invention, and the display of the terminal is controlled by the terminal display control device.

Beneficial effects of the present invention:

The present invention provides a new terminal display control method, which divides the display screen into an accessible area and an inaccessible area according to the user's grip mode, and on this basis, detects the content of the inaccessible area according to the user's operation intention. For example, when the user needs to operate the inaccessible area, the content of the inaccessible area is directly displayed in the accessible area, so that the user does not need to change hands or operate the terminal with both hands, and can display the full screen in the accessible area with one hand The operation solves the problem that users of existing large-screen mobile phones cannot operate with one hand, and enhances the user experience.

Description of drawings

FIG. 1 is a schematic structural diagram of a terminal display control device provided by a first embodiment of the present invention;

FIG. 2 is a flowchart of a terminal display control method provided in a second embodiment of the present invention;

FIG. 3 is a flowchart of a terminal display control method provided in a third embodiment of the present invention;

FIG. 4a is a schematic diagram of a terminal holding method in a third embodiment of the present invention;

Fig. 4b is a schematic diagram of display screen division in the third embodiment of the present invention;

Fig. 4c is a schematic diagram of terminal display before user operation in the third embodiment of the present invention;

Fig. 4d is a schematic diagram of terminal display after user operation in the third embodiment of the present invention.

detailed description

The present invention will be further explained by means of specific embodiments in combination with the accompanying drawings.

First embodiment:

FIG. 1 is a schematic structural diagram of a terminal display control device provided in the first embodiment of the present invention. It can be seen from FIG. 1 that in this embodiment, the terminal display control device 1 provided by the present invention includes:

An acquisition module 11, configured to acquire the user's current grip mode when using the terminal;

A division module 12, configured to divide the display area of the terminal into an accessible area and an inaccessible area according to the holding mode;

A detection module 13, configured to detect the user's operation intention;

The control module 14 is configured to control the content display of the inaccessible area according to the operation intention.

In some embodiments, the operation intention in the above embodiments includes: the user wishes to operate the accessible area, or the user wishes to operate the untouchable area; the control module 14 is used to control the untouchable area if the user wishes to operate the accessible area The content of the display returns to normal; if the user wishes to operate the untouchable area, the control terminal displays the content of the untouchable area in the accessible area.

In some embodiments, the control module 14 in the above embodiments is used to control the terminal to display only the content of the non-touchable area in the accessible area, or display the content of the non-touchable area through a floating window, or display the accessible area at the same time and the contents of the inaccessible area.

In some embodiments, the acquisition module 11 in the above embodiments is used to detect the pressure distribution when the user uses the terminal through the pressure sensor, determine the user's grip mode according to the pressure distribution, or use the touch screen itself to determine the contact position, contact Detection of the area, etc., to determine the way the user holds the hand, etc.

In some embodiments, the division module 12 in the above-mentioned embodiments is used to determine the user's hand-holding position according to the gripping method, obtain the operating range of the thumb when the user is in the holding position, and use the display area within the operating range as an accessible area, Make the display area outside the operating range an inaccessible area.

In some embodiments, the detection module 13 in the above embodiments is used to detect changes in pressure/temperature/contact area when the user uses the terminal, or the distribution of 3D objects around the terminal, or the user's human brain consciousness activity, or The user's operation area selection result determines the operation intention.

In some embodiments, the control module 14 in the above embodiments is also used to detect whether the operation on the content of the inaccessible area is completed after the control terminal displays the content of the inaccessible area in the accessible area, and if so, the control cannot The content of the touched area returns to normal display.

In some embodiments, the control module 14 in the above-mentioned embodiments is used to detect whether the user's operation on the content of the untouchable area is received, and if so, perform the operation and control the content of the untouchable area to resume normal display; or, detect Control whether the duration of displaying the content of the inaccessible area in the accessible area by the terminal is greater than the threshold, and if so, control the content of the inaccessible area to resume normal display.

Correspondingly, the present invention provides a terminal, which includes the terminal display control device 1 provided by the present invention, and the display of the terminal is controlled by the device 1 .

Second embodiment:

FIG. 2 is a flowchart of a terminal display control method provided in the second embodiment of the present invention. It can be seen from FIG. 2 that in this embodiment, the terminal display control method provided by the present invention includes the following steps:

S201: Obtain the holding method of the user when using the terminal currently;

S202: Divide the display area of the terminal into an accessible area and an inaccessible area according to the holding method;

S203: Detect the user's operation intention;

S204: Control the content display of the untouchable area according to the operation intention.

In some embodiments, the operation intention in the above embodiments includes: the user wishes to operate the accessible area, or the user wishes to operate the untouchable area; controlling the display of the terminal according to the operation intention includes: if the user wishes to operate the accessible area, then control The contents of the inaccessible area resume normal display; if the user wishes to operate the inaccessible area, the control terminal displays the contents of the inaccessible area in the accessible area.

In some embodiments, displaying the content of the untouchable area in the accessible area by the control terminal in the above embodiment includes: controlling the terminal to only display the content of the untouchable area in the accessible area, or displaying the untouchable area through a floating window , or display both the content of the accessible area and the content of the untouchable area.

In some embodiments, obtaining the user's current holding method when using the terminal in the above embodiments includes: detecting the pressure distribution of the user when using the terminal through a pressure sensor, and determining the user's holding method according to the pressure distribution; or, by The touch screen itself detects the contact position, contact area, etc., and determines the way the user holds the hand.

In some embodiments, dividing the display area of the terminal into an accessible area and an untouchable area according to the holding method in the above embodiment includes: determining the user's holding position according to the holding method, and obtaining the position of the user's thumb when the holding position is held. In the operating range, the display area within the operating range is regarded as an accessible area, and the display area outside the operating range is regarded as an untouchable area.

In some embodiments, detecting the user's operation intention in the above embodiments includes: detecting changes in pressure/temperature/contact area when the user uses the terminal, or the distribution of 3D objects around the terminal, or the user's human brain consciousness activity , or the selection result of the user's operation area to determine the operation intention.

In some embodiments, after controlling the terminal to display the content of the untouchable area in the accessible area, the above embodiment further includes: detecting whether the operation on the content of the untouchable area is completed, and if so, controlling the restoration of the content of the untouchable area normal display.

In some embodiments, detecting whether the operation on the content of the inaccessible area in the above embodiment is completed includes: detecting whether the user’s operation on the content of the inaccessible area is received, and if so, performing the operation, and controlling the operation of the inaccessible area The content returns to normal display; or, detects whether the duration of the control terminal displaying the content of the inaccessible area in the accessible area is greater than the threshold, and if so, controls the content of the inaccessible area to return to normal display.

The present invention will be further explained in combination with specific application scenarios.

Third embodiment:

In this embodiment, the present invention is explained by taking the user using a mobile phone with his right hand as an example.

FIG. 3 is a flow chart of a terminal display control method provided by the third embodiment of the present invention. It can be seen from FIG. 3 that in this embodiment, the terminal display control method provided by the present invention includes the following steps:

S301: The user uses the mobile phone with one hand.

S302: The terminal detects the gripping manner of the user.

As shown in FIG. 4a , the terminal determines that the user's grip mode is: one-hand operation with the right hand and located at the lower right corner of the display screen according to the pressure state detected by the display screen.

S303: The terminal divides the area of the display screen into an accessible area and an untouchable area.

As shown in FIG. 4b, the terminal divides the area at the lower right corner of the display screen into an accessible area (shaded area) according to the holding method, and divides other areas into untouchable areas (white area).

S304: The terminal monitors the user's operation intention.

Specifically, most of the current capacitive multi-touch screens have realized the detection of the contact area of each contact point, and there will be more touch screens in the future to support the detection of parameters such as contact pressure. The way of holding the terminal during operation, when the user tries to extend his finger (thumb in most cases) to touch the "non-touchable area", the contact method of the base of the thumb and other 4 fingers on the mobile phone and the screen will be different. There is a significant change, therefore, the user's operation intention can be detected by the software system. As we all know, it is common at present that when the touch screen reports the contact coordinates, it will report the contact area parameters of each touch operation contact to the system, including two parameters sizeX and sizeY, both of which have a value range of 0 A decimal of -1 indicates the relative value of the contact area in the horizontal and vertical directions. When the user is operating normally, the user uses the fingertip to click and touch. Generally, the value reported is less than 0.2. When the user uses the pulp of the finger, the thumb This value is usually greater than 0.2 when non-normally operating regions such as roots are in contact. (Note that 0.2 is an example value and a relative value.) Therefore, by combining the two parameters of the touch point coordinates and the touch point size, it is possible to detect whether the user's action is an action of "the root of the thumb touching the edge of the screen", and pass the action's Occurs, it is considered that the user has an intention to touch the operation content on the opposite side.

Of course, with the advancement of sensing technology, for contact pressure, temperature, the overall holding method of the device, the contact area and pressure, or the distribution of objects in the 3D space around the device, or even when the human brain consciousness activity After the recognition is more accurate, a special awareness detection module can also be added for user operation intention detection in this method, so as to achieve a more accurate result of this method.

When the operation intention is that the user needs to operate the inaccessible area, execute step S305; otherwise, display normally, that is, display in full screen

S305: Display the content of the untouchable area in the accessible area according to the operation intention.

As shown in FIG. 4 c , the terminal displays both the content of the inaccessible area and the content of the accessible area in the accessible area, and displays them in a proportionally reduced manner.

S306: After detecting that the user operation is completed, display normally.

As shown in FIG. 4d, after the user operates, it means that the user has completed the operation on the inaccessible area, and the contents of the inaccessible area are normally displayed.

This embodiment realizes the combination of general operation detection and user intention detection, which greatly simplifies the user's operation steps, reduces the complexity of the system configuration, and saves the cost of setting a special mode switching unit (switching button, etc.). The present invention focuses on the user's subconscious and unconscious actions, and does not require the user to actively designate a specific action or preset a fixed action.

In practical applications, when the user's normal click operation is detected (that is, when the contact area parameter is small), the interface responds normally; when it is detected that the user's thumb root is pressed to the edge of the screen, the interface shrinks to as shown The area shown in 4c is convenient for the user to operate, and the action of clicking the target button can be continued without the user's palm leaving the edge, that is, the required operation can be completed in one step instead of being divided into two steps. The detection method is: in the edge area (reported contact x-coordinate > screen width pixels * 90% or x-coordinate < screen width pixels * 10%), a contact action with a contact area parameter greater than 0.2 is detected.

Of course, in some embodiments, a spatial position sensor can be used to detect user operations and operation intentions, specifically:

The touch screen detects the user's touch operation; the finger spatial position sensor detects moving objects near the screen; the pressure sensor detects the pressure generated by the hand held on the edge of the mobile phone;

When it is detected that the user's thumb stretches towards the position that is difficult to touch on the top, and the pressure on the edge of the grip is greater than a certain value, it can be judged that the user is trying to touch a certain position on the top, and the current interface is reduced to the area shown in Figure 4c , so that the user can operate, and the action of clicking the target button can be continued without the user's palm leaving the edge, that is, the required operation can be completed in one step instead of being divided into two steps.

In summary, through the implementation of the present invention, there are at least the following beneficial effects:

Divide the display screen into an accessible area and an inaccessible area according to the user's holding method. On this basis, detect the user's operation intention to control the display mode of the content in the inaccessible area. For example, when the user needs to operate the inaccessible area In this way, the content of the inaccessible area is directly displayed in the accessible area, so that the user does not need to change hands or operate the terminal with both hands, and can perform full-screen operations in the accessible area with one hand, which solves the problem that users of existing large-screen mobile phones cannot single-handedly operate the terminal. The problem of hand operation is improved, which enhances the user experience. More importantly, the user does not need to switch between one-handed and non-one-handed operation modes before performing the desired operation, but the device automatically switches to one-handed operation for the user when it automatically senses that the user needs one-handed operation The mode of operation, so that the one-handed mode can be used naturally and automatically with the same few steps as the normal operation and without knowing that there is a one-handed mode that can be switched.

The above are only specific embodiments of the present invention, and do not limit the present invention in any form. Any simple modification, equivalent change, combination or modification made to the above embodiments according to the technical essence of the present invention still belong to this invention. The protection scope of the technical solution of the invention.

Claims (17)

1. A terminal display control method, characterized in that, comprising: Obtain the holding method of the user when using the terminal currently; dividing the display area of the terminal into an accessible area and an inaccessible area according to the holding manner; Detect the user's operation intention; The content display of the inaccessible area is controlled according to the operation intention. 2. The terminal display control method according to claim 1, wherein the operation intention includes: the user wishes to operate the accessible area, or the user wishes to operate the inaccessible area; The intention to control the display of the terminal includes: if the user wishes to operate the accessible area, then controlling the contents of the inaccessible area to resume normal display; if the user wishes to operate the inaccessible area, then controlling the terminal to display The content of the non-touchable area is displayed in the accessible area. 3. The terminal display control method according to claim 2, wherein the controlling the terminal to display the contents of the inaccessible area in the accessible area comprises: controlling the terminal to display the content in the accessible area. Only the content of the inaccessible area is displayed in the area, or the content of the inaccessible area is displayed through a floating window, or the content of the accessible area and the content of the inaccessible area are displayed simultaneously. 4. The terminal display control method according to claim 1, characterized in that said acquiring the user's current holding method when using the terminal comprises: detecting the pressure distribution when the user uses the terminal through a pressure sensor, according to the The pressure distribution determines the gripping manner of the user, or the gripping manner of the user's hand is determined through the detection of the contact position and the contact area by the touch screen. 5. The terminal display control method according to claim 1, wherein the dividing the display area of the terminal into an accessible area and an inaccessible area according to the holding method comprises: Determine the user's holding position, obtain the operating range of the user's thumb when the user is holding the position, use the display area within the operating range as the accessible area, and use the display area outside the operating range as the inaccessible area Area. 6. The terminal display control method according to claim 1, wherein the detecting the user's operation intention comprises: detecting the change of pressure/temperature/contact area when the user uses the terminal, or the 3D display around the terminal. The distribution of objects, or the user's human brain consciousness activity, or the user's selection result of the operation area determines the operation intention. 7. The terminal display control method according to any one of claims 1 to 6, characterized in that, after controlling the terminal to display the contents of the inaccessible area in the accessible area, it further comprises: detecting whether Complete the operation on the content of the inaccessible area, if yes, control the content of the inaccessible area to resume normal display. 8. The terminal display control method according to claim 7, wherein the detecting whether the operation on the content of the inaccessible area is completed comprises: detecting whether a user operation on the content in the inaccessible area is received , if so, perform an operation, and control the content of the inaccessible area to resume normal display; or, detect whether the duration of controlling the terminal to display the content of the inaccessible area in the accessible area is greater than a threshold, if , then control the contents of the inaccessible area to resume normal display. 9. A terminal display control device, characterized in that it comprises: An acquisition module, configured to acquire the holding mode of the user when using the terminal currently; A division module, configured to divide the display area of the terminal into an accessible area and an inaccessible area according to the holding manner; A detection module, used to detect the user's operation intention; A control module, configured to control the content display of the inaccessible area according to the operation intention. 10. The terminal display control device according to claim 9, wherein the operation intention includes: the user wishes to operate the accessible area, or the user wishes to operate the inaccessible area; the control module is used to , if the user wishes to operate the accessible area, control the contents of the inaccessible area to resume normal display; if the user wishes to operate the inaccessible area, control the terminal to display the inaccessible area in the accessible area The content of the touch zone. 11. The terminal display control device according to claim 10, wherein the control module is configured to control the terminal to only display the contents of the inaccessible area in the accessible area, or, through the floating window Displaying the content of the untouchable area, or simultaneously displaying the content of the accessible area and the untouchable area. 12. The terminal display control device according to claim 9, wherein the acquisition module is configured to use a pressure sensor to detect the pressure distribution when the user uses the terminal, and determine the user's grip according to the pressure distribution. Or, through the detection of the contact position and contact area by the touch screen, determine the grip mode of the user's hand. 13. The terminal display control device according to claim 9, wherein the dividing module is configured to determine the user's hand-holding position according to the holding mode, and obtain the operating range of the user's thumb when the user is in the holding position, The display area within the operating range is used as the accessible area, and the display area outside the operating range is used as the inaccessible area. 14. The terminal display control device according to claim 9, wherein the detection module is configured to detect changes in pressure/temperature/contact area when the user uses the terminal, or the distribution of 3D objects around the terminal , or the user's human brain consciousness activity, or the user's operation area selection result, to determine the operation intention. 15. The terminal display control device according to any one of claims 9 to 14, wherein the control module is further configured to control the terminal to display the content of the inaccessible area in the accessible area After that, it is detected whether the operation on the content of the inaccessible area is completed, and if so, the content of the inaccessible area is controlled to resume normal display. 16. The terminal display control device according to claim 15, wherein the control module is used to detect whether an operation on the content of the inaccessible area is received by the user, and if so, perform the operation and control the The content of the untouchable area resumes normal display; or, detect whether the duration of controlling the terminal to display the content of the untouchable area in the accessible area is greater than a threshold, and if so, control the recovery of the content of the untouchable area normal display. 17. A terminal, characterized by comprising the terminal display control device according to any one of claims 9 to 16, and the display of the terminal is controlled by the terminal display control device.