CN107656578A - terminal control method, device, terminal and storage medium - Google Patents

Abstract

The invention discloses a terminal control method, a terminal control device, a terminal and a storage medium, and belongs to the technical field of terminals. The method is applied to a terminal with a foldable display screen, wherein the display screen is positioned at the outer side after being folded, and the method comprises the following steps: when the display screen is in a folded state, determining a first half screen and a second half screen formed by folding; judging whether a preset touch operation on the first half screen is detected or not; and when the preset touch operation on the first half screen is detected, controlling the display content of the second half screen according to the preset touch operation. According to the method and the device, the display content of the second half screen is controlled according to the touch operation on the first half screen, so that the shielding of fingers on the display content of the second half screen when the second half screen is touched is avoided, and the flexibility of terminal control is improved.

Description

Terminal control method, device, terminal and storage medium

technical field

Embodiments of the present invention relate to the technical field of terminals, and in particular, to a terminal control method, device, terminal, and storage medium.

Background technique

At present, with the development of terminal technologies, terminals such as mobile phones and tablet computers are more and more widely used in people's daily life. People can use the terminals to surf the Internet, listen to music or play games. Moreover, currently, the display screen configured on the terminal is usually a touch screen, and the user can control the content displayed on the current display screen by touching the current display screen during the use of the terminal. For example, when the user reads the news page displayed on the display screen, the upward movement of the news page can be controlled by sliding the display screen up and down.

Contents of the invention

Embodiments of the present invention provide a terminal control method, device, terminal, and storage medium, which can be used to solve the problem that a finger will largely block half-screen display content when performing a touch operation on a folded half-screen. Described technical scheme is as follows:

In a first aspect, a terminal control method is provided, the method is applied to a terminal, the terminal has a foldable display screen, and the display screen is folded and located on the outside, the method includes:

When the display screen is in a folded state, determining a first half screen and a second half screen formed by folding;

judging whether a preset touch operation on the first half screen is detected;

When a preset touch operation on the first half-screen is detected, the display content of the second half-screen is controlled according to the preset touch operation.

Optionally, the determining the first half-screen and the second half-screen formed by folding includes:

Determining the top half-screen of the two half-screens formed by folding as the first half-screen, and determining the bottom half-screen as the second half-screen; or,

Of the two half-screens formed by folding, the half-screen in the black-screen state is determined as the first half-screen, and the half-screen in the bright-screen state is determined as the second half-screen; or,

When the two half-screens formed by folding are both in the bright state and display the same content, determine any half-screen of the two half-screens as the first half-screen, and determine the other half-screen as the second half-screen half screen; or,

Determine the half screen facing the user and the half screen facing away from the user from the two half screens formed by folding, determine the half screen facing away from the user as the first half screen, and set the half screen facing the user The screen is determined as the second half screen.

Optionally, the determining the half-screen facing the user and the half-screen facing away from the user from the two half-screens formed by folding includes:

Collect images through the configured camera, identify the collected images, and determine the half screen facing the user and the half screen facing away from the user from the two half screens formed by folding according to the recognition results; or,

When the terminal is in the handheld state, determine the handheld posture of the terminal, and determine the half-screen facing the user and the half-screen facing away from the user from the two half-screens formed by folding according to the handheld posture; or;

When the terminal is in the handheld state, determine the contact area between each of the two half-screens formed by the folding and the user, and determine the half-screen with the smallest contact area with the user as the half-screen facing the user, The half screen with the largest contact area with the user is determined as the half screen facing away from the user.

Optionally, the controlling the display content of the second half screen according to the preset touch operation includes:

determining a first touch position of the preset touch operation in the first half screen;

According to the first touch position and the stored position correspondence between the first half screen and the second half screen, determine a second touch of the preset touch operation in the second half screen Location;

determining a control instruction for display content of the second half-screen according to the preset touch operation and the second touch position;

The display content of the second half screen is controlled according to the control instruction.

Optionally, the preset touch operation includes at least one of a point touch operation and a slide operation, and the preset touch operation includes preset touch operations corresponding to a plurality of force levels.

In a second aspect, a terminal control device is provided, the device is applied to a terminal, the terminal has a foldable display screen, and the display screen is folded and located on the outside, the device method includes:

A determining module, configured to determine the first half-screen and the second half-screen formed by folding when the display screen is in the folded state;

A judging module, configured to judge whether a preset touch operation on the first half screen is detected;

A control module, configured to, when a preset touch operation on the first half-screen is detected, control the display content of the second half-screen according to the preset touch operation.

Optionally, the determination module is used for:

Determining the top half-screen of the two half-screens formed by folding as the first half-screen, and determining the bottom half-screen as the second half-screen; or,

Of the two half-screens formed by folding, the half-screen in the black-screen state is determined as the first half-screen, and the half-screen in the bright-screen state is determined as the second half-screen; or,

When the two half-screens formed by folding are both in the bright state and display the same content, determine any half-screen of the two half-screens as the first half-screen, and determine the other half-screen as the second half-screen half screen; or,

Determine the half screen facing the user and the half screen facing away from the user from the two half screens formed by folding, determine the half screen facing away from the user as the first half screen, and set the half screen facing the user The screen is determined as the second half screen.

Optionally, the determination module is used for:

Collect images through the configured camera, identify the collected images, and determine the half screen facing the user and the half screen facing away from the user from the two half screens formed by folding according to the recognition results; or,

When the terminal is in the handheld state, determine the handheld posture of the terminal, and determine the half-screen facing the user and the half-screen facing away from the user from the two half-screens formed by folding according to the handheld posture; or;

When the terminal is in the handheld state, determine the contact area between each of the two half-screens formed by the folding and the user, and determine the half-screen with the smallest contact area with the user as the half-screen facing the user, The half screen with the largest contact area with the user is determined as the half screen facing away from the user.

Optionally, the control module is used for:

determining a first touch position of the preset touch operation in the first half screen;

According to the first touch position and the stored position correspondence between the first half screen and the second half screen, determine a second touch of the preset touch operation in the second half screen Location;

determining a control instruction for display content of the second half-screen according to the preset touch operation and the second touch position;

The display content of the second half screen is controlled according to the control instruction.

Optionally, the preset touch operation includes at least one of a point touch operation and a slide operation, and the preset touch operation includes preset touch operations corresponding to a plurality of force levels.

In a third aspect, a terminal is provided, including a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor is configured to execute the above-mentioned first The steps of any terminal control method provided by the aspect.

In a fourth aspect, a computer-readable storage medium is provided, where instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is run on a computer, the computer executes any terminal control method provided in the above-mentioned first aspect.

The beneficial effects brought by the technical solution provided by the embodiments of the present invention are:

In the embodiment of the present invention, when the display screen of the terminal is in the folded state, the first half screen and the second half screen formed by folding can be determined, and the second half screen can be adjusted according to the preset touch operation on the first half screen. The display content of the second half of the screen is controlled, thereby avoiding the blocking of the display content of the second half of the screen by fingers when touching the second half of the screen, and improving the flexibility of terminal control.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained based on these drawings without creative effort.

FIG. 1 is a flowchart of a terminal control method provided by an embodiment of the present invention;

FIG. 2A is a flowchart of another terminal control method provided by an embodiment of the present invention;

FIG. 2B is a schematic folding diagram of a terminal provided by an embodiment of the present invention;

Fig. 3 is a schematic structural diagram of a terminal control device provided by an embodiment of the present invention;

FIG. 4 is a schematic structural diagram of a terminal 400 provided by an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a terminal 400 provided by an embodiment of the present invention;

FIG. 6A is a schematic structural diagram of a terminal provided by an embodiment of the present invention;

FIG. 6B is a schematic structural diagram of another terminal provided by an embodiment of the present invention;

FIG. 6C is a schematic structural diagram of another terminal provided by an embodiment of the present invention;

FIG. 6D is a schematic structural diagram of another terminal provided by an embodiment of the present invention.

Detailed ways

In order to make the object, technical solution and advantages of the present invention clearer, the implementation manner of the present invention will be further described in detail below in conjunction with the accompanying drawings.

Before explaining the embodiment of the present invention in detail, firstly, the application scenario provided by the embodiment of the present invention is introduced.

The embodiments of the present invention are applied in a scenario where a user wants to conveniently control display content of a display screen during a process of using a terminal. For example, when browsing the content of the webpage, slide the webpage up and down, or control the game character when playing the game, or open the corresponding application through the application icon on the main interface and wait.

For a terminal configured with a foldable screen, the user often controls the displayed content of the display screen after folding the display screen. In the related art, when the display screen of the terminal is in the folded state, for any half screen formed by folding, the display content of the current half screen can only be controlled by touch operation on the current half screen. However, when the display screen is a foldable screen, since the size of the half screen formed after folding is relatively small, when performing a touch operation on a half screen, the user's fingers will largely block the display of the half screen. Content that affects user viewing.

In order to prevent the user's finger from blocking the content displayed on the display screen during the process of the user controlling the terminal, an embodiment of the present invention provides a terminal control method, and the specific process will be described in detail in the embodiment of FIG. 1 or FIG. 2A below.

Secondly, the implementation environment of the embodiment of the present invention is introduced.

The embodiment of the present invention is applied to a terminal, and the terminal may specifically be a mobile phone or a tablet computer. Moreover, the display screen of the terminal is a foldable screen, that is, the display screen of the terminal can be folded, and the function of the terminal will not be affected after the display screen is folded. Specifically, the display screen may be folded toward the outside, that is, the display screen is positioned outside after folding, or may be folded toward the inside, that is, the display screen is positioned inside after folding, which is not limited in this embodiment of the present invention.

After introducing the application scenario and implementation environment of the embodiment of the present invention, the terminal control method provided by the embodiment of the present invention will be described in detail next with reference to the accompanying drawings.

Fig. 1 is a flow chart of a terminal control method provided by an embodiment of the present invention, the method is applied to a terminal, the terminal has a foldable display screen, and the display screen is folded and located on the outside, see Fig. 1, the method Including the following steps:

Step 101: When the display screen of the terminal is in a folded state, determine a first half screen and a second half screen formed by folding.

Step 102: Determine whether a preset touch operation on the first half screen is detected.

Step 103: When a preset touch operation on the first half-screen is detected, control the display content of the second half-screen according to the preset touch operation.

In the embodiment of the invention, when the display screen of the terminal is in the folded state, the first half screen and the second half screen formed by folding can be determined, and the second half screen can be adjusted according to the preset touch operation on the first half screen. The display content of the second half of the screen is controlled, thereby avoiding the blocking of the display content of the second half of the screen by fingers when touching the second half of the screen, and improving the flexibility of terminal control.

Optionally, determining the first half screen and the second half screen formed by folding includes:

Of the two half-screens formed by folding, the top half-screen is determined as the first half-screen, and the bottom half-screen is determined as the second half-screen; or,

Of the two half-screens formed by folding, the half-screen in the black-screen state is determined as the first half-screen, and the half-screen in the bright-screen state is determined as the second half-screen; or,

When the two half-screens formed by folding are both in the bright state and display the same content, determine any half-screen of the two half-screens as the first half-screen, and determine the other half-screen as the second half-screen; or,

Determine the half-screen facing the user and the half-screen facing away from the user from the two half-screens formed by folding, determine the half-screen facing away from the user as the first half-screen, and determine the half-screen facing the user as the first half-screen The second half screen.

Optionally, determining the half-screen facing the user and the half-screen facing away from the user from the two half-screens formed by folding includes:

Collect images through the configured camera, identify the collected images, and determine the half screen facing the user and the half screen facing away from the user from the two half screens formed by folding according to the recognition results; or,

When the terminal is in the handheld state, determine the handheld posture of the terminal, and determine the half-screen facing the user and the half-screen facing away from the user from the two half-screens formed by folding according to the handheld posture; or;

When the terminal is in the handheld state, determine the contact area between each of the two half-screens formed by the folding and the user, and determine the half-screen with the smallest contact area with the user as the half-screen facing the user. The half-screen with the largest contact area of the user is determined to be the half-screen facing away from the user.

Optionally, controlling the display content of the second half screen according to the preset touch operation includes:

determining a first touch position of the preset touch operation in the first half screen;

determining a second touch position of the preset touch operation in the second half-screen according to the first touch position and the stored corresponding relationship between the positions of the first half-screen and the second half-screen;

According to the preset touch operation and the second touch position, determine a control command for the display content of the second half screen;

The display content of the second half screen is controlled according to the control instruction.

Optionally, the preset touch operation includes at least one of a point touch operation and a slide operation, and the preset touch operation includes preset touch operations corresponding to multiple strength levels.

All the above optional technical solutions may be combined in any way to form optional embodiments of the present disclosure, which will not be described in detail in the embodiments of the present disclosure.

Fig. 2A is a flow chart of another terminal control method provided by an embodiment of the present invention, the method is applied to a terminal, the terminal has a foldable display screen, and the display screen is folded and located on the outside. Referring to Fig. 2A, this method comprises the steps:

Step 201: Detect whether the display screen of the terminal is in a folded state.

The display screen configured on this terminal is a foldable screen, and it can detect whether the display screen is in a folded state during the working process. Specifically, whether the display screen is in a folded state can be detected in real time, or whether the display screen is in a folded state can be detected periodically.

In actual implementation, the terminal can detect whether the display screen is in the folded state through the sensor configured in the display screen, or can detect whether the display screen is in the folded state through the system interface. The embodiment of the present invention does not limit the method of detecting the folded state of the display screen .

For example, taking the terminal detecting the folding state of the display screen through the sensor configured in the display screen as an example, when the sensor configured in the display screen detects that the display screen is folded, it can send a folding signal to the processor of the terminal, and when the terminal When the processor receives the folding signal, it can be determined that the display screen of the terminal is in the folding state.

Step 202: When the display screen of the terminal is in a folded state, determine a first half screen and a second half screen formed by folding.

Wherein, the first half screen and the second half screen are screens whose screen size is smaller than that of the display screen formed after the display screen of the terminal is folded, and the first half screen and the second half screen may be screens after the display screen is folded. Any two half-screens among the multiple half-screens formed.

In practical applications, the display screen can be folded to form two half screens, that is, the first half screen and the second half screen, or the display screen can be folded to form more than two half screens, such as three half screens. screen or 4 half screens, etc., the first half screen and the second half screen are any two half screens in the two or more half screens.

In the embodiment of the present invention, in order to avoid the blocking of the displayed content in the half-screen by fingers when touching any half-screen formed by folding, a method is proposed to control the other half-screen by touching one half-screen. Display content control methods. Wherein, the half screen to be touched is the first half screen, and the half screen to be controlled is the second half screen. That is, before controlling the displayed content of the folded half-screen, it is necessary to first determine the first half-screen to be touched and the second half-screen to be controlled.

Further, considering that only when the display screen is folded outward, the user can see the content displayed on the display screen, and then control the display content of the display screen. Therefore, in order to save power consumption of the terminal and improve accuracy, when it is detected that the display screen of the terminal is in a folded state and located on the outside, the first half screen and the second half screen formed by folding can be determined, and the second half screen Display content is controlled.

Of course, in another embodiment, when it is detected that the display screen of the terminal is in a folded state and located inside, the first half screen and the second half screen formed by folding can be determined, and the display content of the second half screen can be determined. control, which is not limited in this embodiment of the present invention.

Specifically, taking the display screen being folded to form two half-screens as an example, the ways to determine the first half-screen and the second half-screen formed by folding may include the following:

A first implementation manner: among the two half-screens formed by folding, the top half-screen is determined as the first half-screen, and the bottom half-screen is determined as the second half-screen.

In practical applications, when using a folding screen terminal, for convenience of operation, the user usually folds the upper part of the display screen to the outside, and then views and uses the lower display screen, that is, the half screen at the bottom of the display screen. For example, the user can fold the upper part of the display to the outer side so that the display is folded to form a half screen at the top and a half screen at the bottom, and then buckle the two half screens together so that the two half screens The back fits together so that users can hold it in hand. During the user's hand-held process, the user usually views and uses the bottom half screen.

Therefore, the half screen at the top can be determined as the first half screen to be touched, and the half screen at the bottom can be determined as the second half screen to be controlled, so that the bottom half screen can be controlled by touching the top half screen. Control the display content of the screen.

A second implementation manner: among the two half-screens formed by folding, the half-screen in a black-screen state is determined as the first half-screen, and the half-screen in a bright-screen state is determined as the second half-screen.

When the user uses the folding screen terminal, after the user folds the display screen, he usually only views the display content of a half screen formed by folding. Therefore, in order to save the power consumption of the terminal, only the half screen to be viewed can be lighted up. And close the other half of the screen. At this point, the half-screen in the black-screen state can be determined as the first half-screen to be touched, and the half-screen in the bright-screen state can be determined as the second half-screen to be controlled, so that the half-screen in the black-screen state can be touched Operation to control the display content of the half screen in the bright screen state.

In one embodiment, after the display screen is folded, when the two half-screens formed by folding are both in the bright screen state, when a black-screen display instruction for any half-screen of the two half-screens is received, the Half screen is set to black screen state. Wherein, the black screen display instruction may be triggered by the user through a designated operation, and the designated operation may be a pressing operation, a sliding operation, or a voice operation.

For example, the two half-screens formed by folding may display a black-screen shortcut key, and when a trigger operation on the black-screen shortcut key displayed in any half-screen is detected, it is determined that a black-screen display instruction for the half-screen is received.

The third implementation method: when the two half-screens formed by folding are in the bright screen state and display the same content, determine any half-screen of the two half-screens as the first half-screen, and determine the other half-screen as the The second half screen.

For folding screen terminals, after the user folds the display screen, the content displayed on the display screen may be reduced and displayed in each half screen formed by folding, that is, each half screen formed by folding displays the original display The content displayed on the screen is the same. When the display content of the two half-screens formed by folding is the same, the user can use either half-screen to view, so any half-screen can be used as the second half-screen to be controlled, that is, any half-screen can be controlled by touch operation The display content of the other half of the screen is controlled.

Further, in order to improve the accuracy, when receiving a control instruction for any half screen, this half screen can be determined as the second half screen to be controlled, and the other half screen can be determined as the first half screen to be touched Screen. Among them, the control command for any half screen can be triggered by the user through a specified operation, for example, the two half screens formed by folding can display control shortcut keys, when the trigger operation for the control shortcut keys displayed in any half screen is detected , to determine that a control command for the half-screen is received.

The fourth implementation method: determine the half screen facing the user and the half screen facing away from the user from the two half screens formed by folding, determine the half screen facing away from the user as the first half screen, and determine the half screen facing away from the user as the first half screen, and determine the half screen facing away from the user The user's half screen is determined as the second half screen.

Among them, the half screen facing the user is the half screen that the user is viewing and using, and the half screen facing away from the user is the half screen that the user is not viewing, so the half screen facing away from the user can be determined as the first half screen to be touched. For the half screen, the half screen facing the user is determined as the second half screen to be controlled, so as to control the display content of the half screen facing the user through a touch operation on the half screen facing away from the user.

Specifically, the methods of determining the half-screen facing the user and the half-screen facing away from the user from the two half-screens formed by folding may include the following:

1) Collect images through the configured camera, and recognize the collected images, and determine the half screen facing the user and the half screen facing away from the user from the two half screens formed by folding according to the recognition result.

The purpose of identifying the collected images is to determine whether there is a face image in the collected images, so as to determine the half screen facing the user and the half screen facing away from the user through face recognition technology.

Specifically, when there is a face image in the image collected by the half-screen configured with the camera, the half-screen may be determined as the half-screen facing the user, and the other half-screen may be determined as the half-screen facing away from the user. Or, when there is no face image in the image collected by the half-screen configured with the camera, the half-screen may also be determined as the half-screen facing away from the user, and the other half-screen may be determined as the half-screen facing the user.

2) When the terminal is in the handheld state, determine the handheld posture of the terminal, and determine the half-screen facing the user and the half-screen facing away from the user from the two half-screens formed by folding according to the handheld posture.

That is, according to the posture of the user holding the terminal, the half screen facing the user and the half screen facing away from the user may be determined. For example, the terminal may determine the upper half-screen and the lower half-screen according to the hand-holding posture of the terminal, and determine the upper half-screen as the half-screen facing the user, and the lower half-screen as facing away from the user. The user's half screen. Of course, the half-screen facing the user and the half-screen facing away from the user may also be determined through other hand-holding gestures, which is not limited in this embodiment of the present invention.

In practical applications, the terminal may determine the hand-holding posture of the terminal through at least one of the configured gravity sensor, gyroscope and light sensor. Certainly, it may also be determined in combination with other sensors, which is not limited in this embodiment of the present invention.

3) When the terminal is in the handheld state, determine the contact area between each of the two half-screens formed by the folding and the user, and determine the half-screen with the largest contact area with the user as the half-screen facing away from the user , determine the half screen with the smallest contact area with the user as the half screen facing the user.

Considering that when the user is holding the terminal, the contact area of the user's hand is usually smaller with the half-screen facing the user, while the contact area with the half-screen facing away from the user is larger. The half-screen facing the user is in contact with the four fingers and the half-screen facing away from the user. Therefore, the half-screen with the largest contact area with the user can be determined as the half-screen facing away from the user, and the half-screen with the user’s The half screen with the smallest contact area is determined as the half screen facing the user.

It should be noted that the embodiment of the present invention is only described by taking the above four methods to determine the first half-screen to be touched and the second half-screen to be controlled from the multiple half-screens formed by folding as an example. , the first half screen and the second half screen may also be determined in other ways according to actual needs, which is not limited in this embodiment of the present invention.

Step 203: The terminal judges whether a preset touch operation on the first half of the screen is detected.

Wherein, the preset touch operation includes at least one of a point touch operation and a slide operation, and the preset touch operation includes preset touch operations corresponding to multiple force levels, and the preset touch operations corresponding to the multiple force levels The touch operation corresponds to multiple control instructions, that is, the same preset touch operation corresponding to different strength levels is used to trigger different control instructions.

Wherein, the touch operation may include single-click operation, double-click operation, and long-press operation, etc., and the touch operation may also include touch operations corresponding to different strength levels, for triggering different control instructions. For example, the click operation of the first force level on the application icon can be used to trigger the selection instruction of the application icon, and the click operation of the second force level of the application icon can be used to trigger the opening instruction of the application icon , and the first intensity level is smaller than the second intensity level.

Wherein, the sliding operation may include sliding operations in different directions, such as upward sliding operation, downward sliding operation, left sliding operation, and right sliding operation, etc., and may include sliding operations corresponding to different strength levels for triggering different control commands. For example, the sliding operation of the first strength level is used to control the brightness, and the sliding operation of the second strength level is used to control the volume.

In practical applications, the terminal may detect a preset touch operation on the first half of the screen through a sensor configured in the first half of the screen. For example, it can be detected through the pressure signal fed back by the pressure sensor configured in the first half of the screen.

Step 204: When the terminal detects a preset touch operation on the first half of the screen, control the display content of the second half of the screen according to the preset touch operation.

Specifically, controlling the display content of the second half screen according to the preset touch operation may include the following two implementations:

A first implementation manner: determine a control instruction for the display content of the second half-screen according to the preset touch operation, and control the display content of the second half-screen according to the control instruction.

In an embodiment, when the preset touch operation is a sliding operation, the display content of the second half screen may be controlled using the first implementation manner. For example, when the second half-screen is displaying a web page or a client page, and the preset touch operation is a sliding operation, the page can be controlled to move up and down or to switch left and right according to the sliding operation.

As shown in Figure 2B, the user folds the upper display screen backwards according to the center line of the display screen, and buckles the two half-screens formed by folding together so that the backs of the two half-screens fit together to form a Take the front half-screen 10 and the rear half-screen 20 as examples. When the front half-screen 10 is displaying a web page, the user can control the front half-screen 10 by sliding up the back half-screen 20. Move up the page to refresh the page content in the half screen 10 .

The second implementation mode: determine the first touch position of the preset touch operation in the first half-screen; according to the first touch position and the stored positions of the first half-screen and the second half-screen According to the corresponding relationship, determine the second touch position of the preset touch operation in the second half screen; according to the preset touch operation and the second touch position, determine the display content for the second half screen A control instruction; the display content of the second half screen is controlled according to the control instruction.

That is, the touch position of the second half screen may be determined according to the touch position of the first half screen, and the display content of the second half screen may be controlled according to the determined touch position.

Wherein, the corresponding relationship between the positions of the first half screen and the second half screen can be set according to the equal ratio of the screen sizes of the first half screen and the second half screen, and can be set by default by the terminal, or can be set by the user according to actually needs to be set.

As shown in Figure 2B, when the user touches the upper position of the rear half screen 20, it is equivalent to touching the upper position corresponding to the front half screen 10, and the front half screen 10 can be adjusted according to the touch operation and the touch position. The display content in the screen 10 is controlled. For example, by clicking on the corresponding position of the rear half screen 20, the application icon at the corresponding position in the front half screen 10 or the virtual switch at the corresponding position can be controlled to be opened.

In the embodiment of the invention, when the display screen of the terminal is in the folded state, the first half screen and the second half screen formed by folding can be determined, and the second half screen can be adjusted according to the preset touch operation on the first half screen. The display content of the second half of the screen is controlled, thereby avoiding the blocking of the display content of the second half of the screen by fingers when touching the second half of the screen, and improving the flexibility of terminal control.

Fig. 3 is a schematic structural diagram of a terminal control device provided by an embodiment of the present invention, the device is applied in a terminal, the terminal has a foldable display screen, and the display screen is folded and located on the outside, see Fig. 3, the device It includes a determination module 301 , a judgment module 302 and a control module 303 .

A determining module 301, configured to determine the first half screen and the second half screen formed by folding when the display screen of the terminal is in a folded state;

A judging module 302, configured to judge whether a preset touch operation on the first half screen is detected;

The control module 303 is configured to, when a preset touch operation on the first half-screen is detected, control the display content of the second half-screen according to the preset touch operation.

Optionally, the determination module 301 is used for:

Of the two half-screens formed by folding, the top half-screen is determined as the first half-screen, and the bottom half-screen is determined as the second half-screen; or,

Of the two half-screens formed by folding, the half-screen in the black-screen state is determined as the first half-screen, and the half-screen in the bright-screen state is determined as the second half-screen; or,

When the two half-screens formed by folding are both in the bright state and display the same content, determine any half-screen of the two half-screens as the first half-screen, and determine the other half-screen as the second half-screen; or,

Determine the half-screen facing the user and the half-screen facing away from the user from the two half-screens formed by folding, determine the half-screen facing away from the user as the first half-screen, and determine the half-screen facing the user as the first half-screen The second half screen.

Optionally, the determination module 301 is used for:

Collect images through the configured camera, identify the collected images, and determine the half screen facing the user and the half screen facing away from the user from the two half screens formed by folding according to the recognition results; or,

When the terminal is in the handheld state, determine the handheld posture of the terminal, and determine the half-screen facing the user and the half-screen facing away from the user from the two half-screens formed by folding according to the handheld posture; or;

When the terminal is in the handheld state, determine the contact area between each of the two half-screens formed by the folding and the user, and determine the half-screen with the smallest contact area with the user as the half-screen facing the user. The half-screen with the largest contact area of the user is determined to be the half-screen facing away from the user.

Optionally, the control module 303 is used for:

determining a first touch position of the preset touch operation in the first half screen;

determining a second touch position of the preset touch operation in the second half-screen according to the first touch position and the stored corresponding relationship between the positions of the first half-screen and the second half-screen;

According to the preset touch operation and the second touch position, determine a control command for the display content of the second half screen;

The display content of the second half screen is controlled according to the control instruction.

Optionally, the preset touch operation includes at least one of a point touch operation and a slide operation, and the preset touch operation includes preset touch operations corresponding to multiple strength levels.

In the embodiment of the invention, when the display screen of the terminal is in the folded state, the first half screen and the second half screen formed by folding can be determined, and the second half screen can be adjusted according to the preset touch operation on the first half screen. The display content of the second half of the screen is controlled, thereby avoiding the blocking of the display content of the second half of the screen by fingers when touching the second half of the screen, and improving the flexibility of terminal control.

It should be noted that when the terminal control device provided in the above embodiment controls the terminal, it only uses the division of the above-mentioned functional modules as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional modules according to needs. , that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the terminal control device and the terminal control method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments, and will not be repeated here.

Referring to FIG. 4 and FIG. 5 , it shows a schematic structural diagram of a terminal 400 provided by an exemplary embodiment of the present application. The terminal 400 may be a smart phone, a tablet computer, an e-book, and the like. The terminal 400 in this application may include one or more of the following components: a processor 410 , a memory 420 and a touch screen 430 .

Processor 410 may include one or more processing cores. The processor 410 uses various interfaces and lines to connect various parts of the entire terminal 400, and executes the terminal by running or executing instructions, programs, code sets or instruction sets stored in the memory 420, and calling data stored in the memory 420. 400 various functions and process data. Optionally, the processor 410 may use at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable LogicArray, PLA). implemented in the form of hardware. The processor 410 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly processes the operating system, the user interface and application programs, etc.; the GPU is responsible for rendering and drawing the content that needs to be displayed on the touch screen 430; the modem is used for processing wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 410, but may be realized by a single chip.

The memory 420 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory). Optionally, the memory 420 includes a non-transitory computer-readable storage medium. Memory 420 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 420 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), It is used to implement instructions and the like of the various method embodiments described below; the storage data area can store data created according to the use of the terminal 400 (such as audio data, phone book) and the like.

Taking the operating system as an Android system as an example, the programs and data stored in the memory 420 are as shown in Figure 4, and the memory 420 is stored with a Linux kernel layer 520, a system runtime layer 540, an application framework layer 560 and an application layer 580 . The Linux kernel layer 520 provides underlying drivers for various hardware of the terminal 400, such as display drivers, audio drivers, camera drivers, Bluetooth drivers, Wi-Fi drivers, power management, and so on. The system runtime layer 540 provides main feature support for the Android system through some C/C++ libraries. For example, the SQLite library provides database support, the OpenGL/ES library provides 3D drawing support, and the Webkit library provides browser kernel support. The Android Runtime library (Android Runtime) is also provided in the system runtime library layer 540, which mainly provides some core libraries and can allow developers to write Android applications using the Java language. The application framework layer 560 provides various APIs that may be used when building applications. Developers can also use these APIs to build their own applications, such as activity management, window management, view management, notification management, content providers, Package management, call management, resource management, location management. There is at least one application program running in the application layer 580, and these application programs can be a contact program, a text message program, a clock program, a camera application, etc. Communication programs, photo beautification programs, etc.

Taking the operating system as the IOS system as an example, the programs and data stored in the memory 420 are as shown in Figure 5, and the IOS system includes: a core operating system layer 620 (Core OS layer), a core service layer 640 (Core Services layer), a media layer 660 (Media layer), touchable layer 680 (Cocoa Touch Layer). The core operating system layer 620 includes an operating system kernel, drivers, and underlying program frameworks. These underlying program frameworks provide functions closer to hardware for use by the program frameworks located in the core service layer 640 . The core service layer 640 provides system services and/or program frameworks required by applications, such as foundation framework, account framework, advertisement framework, data storage framework, network connection framework, geographic location framework, exercise framework and so on. The media layer 660 provides audio-visual interfaces for applications, such as interfaces related to graphics and images, interfaces related to audio technology, interfaces related to video technology, and wireless playback (AirPlay) interfaces of audio and video transmission technology. The touchable layer 680 provides various commonly used interface-related frameworks for application development, and the touchable layer 680 is responsible for the user's touch interaction operation on the terminal 400 . Such as local notification service, remote push service, advertisement framework, game tool framework, message user interface interface (User Interface, UI) framework, user interface UIKit framework, map framework and so on.

Among the frameworks shown in FIG. 5 , frameworks related to most applications include, but are not limited to: the basic framework in the core service layer 640 and the UIKit framework in the touchable layer 680 . The basic framework provides many basic object classes and data types, and provides the most basic system services for all applications, regardless of UI. The class provided by the UIKit framework is a basic UI class library for creating a touch-based user interface. iOS applications can provide UI based on the UIKit framework, so it provides the infrastructure of the application for building user interfaces, drawing , Handle and user interaction events, respond to gestures, and more.

The touch display screen 430 is used to receive user's touch operation on or near it with any suitable object such as a finger or a stylus, and to display user interfaces of various application programs. The touch display screen 430 is generally arranged on the front panel of the terminal 400 .

As shown in FIG. 6A, the terminal 400 includes a first housing 41, a second housing 42, and a connection assembly 43 connected between the first housing 41 and the second housing 42. The first housing 41 and the second housing The body 42 is flipped and folded through the connection assembly 43 .

The first housing 41 includes a first support surface connected to the back of the touch screen, and a first back opposite to the first support surface, and the second housing 42 includes a second support surface connected to the back of the touch screen, and a second support surface connected to the back of the touch screen. The second back surface opposite to the second supporting surface. Correspondingly, the touch display screen includes a first display area 131, a second display area 132 and a third display area 133, wherein the first display area 131 corresponds to the position of the first housing 41, and the second display area 132 corresponds to the position of the second The position of the housing 42 corresponds, and the third display area 133 corresponds to the position of the connecting component 43 . In one implementation, the first display area 131, the second display area 132, and the third display area 133 are all made of flexible materials, which have certain stretchability; in another implementation, only the third display The area 133 is made of flexible material, and the first display area 131 and the second display area 132 are made of non-flexible material.

In an optional implementation manner, the connection component 43 of the terminal 400 adopts a manual structure. When the user manually separates the first casing 41 and the second casing 42, the terminal 400 changes from the folded state to the unfolded state; when the user manually closes the first casing 41 and the second casing 42, the terminal 400 changes from the unfolded state to the folded state. state.

In another optional implementation manner, the connection assembly 43 of the terminal 400 adopts an electric structure, for example, the connection assembly 43 is provided with an electric rotating component such as an electric motor. Driven by the electric rotating part, the first casing 41 and the second casing 42 are automatically closed or separated, so that the terminal 400 has two states of unfolding and folding.

According to whether the touch display screen is exposed in the folded state, the terminal 400 can be divided into an outer folding screen terminal and an inner folding screen terminal. in:

External folding screen terminal

A terminal with an outer folding screen refers to a terminal that can be folded at an angle of 180°, and in the folded state, the entire touch screen is exposed. As shown in FIG. 6A , the terminal 400 is an external folding screen terminal. In the unfolded state, the first supporting surface of the first housing 41 of the terminal 400 is flush with the second supporting surface of the second housing 42 (that is, the included angle is 180°), and the first display area 131, The second display area 132 and the third display area 133 are located on the same plane; when the terminal 400 changes from the unfolded state to the folded state, as shown in FIG. The two backs are close together, and the angle between the first support surface and the second support surface changes from 180° to 0°; in the folded state, as shown in FIG. 6B , the first support surface and the second support surface of the first housing 41 of the terminal 400 The second supporting surfaces of the two housings 42 are parallel (the angle between the first housing 41 and the second housing 42 is 0°), so that the touch screen is in a U-shaped folded state, wherein the third display area of the touch screen 133 forms an exposed U-shaped arc surface.

In an optional implementation manner, in the folded state, all or part of the display area of the touch display screen is used to display a user interface. For example, as shown in FIG. 6B , in the folded state, only the second display area 132 is used to display the user interface, or only the third display area 133 is used to display the user interface.

Inner folding screen terminal

An inner folding screen terminal refers to a terminal that can be folded at an angle of 180°, and in the folded state, the touch screen (all or part) is restrained. As shown in FIG. 6C , the terminal 400 is an inner folding screen terminal. In the unfolded state, the first supporting surface of the first housing 41 of the terminal 400 is flush with the second supporting surface of the second housing 42 (that is, the included angle is 180°), so that the touch screen is in a planar unfolded state (first The display area 131, the second display area 132 and the third display area 133 are located on the same plane); during the terminal 400 changing from the unfolded state to the folded state, as shown in FIG. The second supporting surfaces of the two casings 42 are close together, that is, the angle between the first supporting surface and the second supporting surface changes from 180° to 0°; in the folded state, the first supporting surface of the first casing 41 of the terminal 400 and the The second supporting surfaces of the second housing 42 are parallel, so that the touch screen is in a U-shaped folded state, wherein the third display area 133 of the touch screen forms a restrained U-shaped arc. In an optional implementation manner, in the folded state, no user interface is displayed on the entire display area of the touch display screen.

In addition to setting a touch display screen on the supporting surface of the housing, a touch display screen may also be provided on the first back of the first housing 41 and/or the second back of the second housing 42 . When the inner folding screen terminal is in the folded state, the touch screen disposed on the back of the casing is used to display a user interface, which is the same as or different from the user interface displayed on the touch screen in the unfolded state.

In other possible implementations, the foldable angle of the terminal 400 can also be 360° (it can be folded inward or outward), and in the folded state, the touch screen is exposed or restrained. Not limited.

In the terminal 400 shown in FIGS. 6A to 6C , the first housing 41 and the second housing 42 have the same or similar dimensions, and the folding method of the terminal 400 is called symmetrical folding. In other possible implementation manners, the folding manner of the terminal 400 may also be asymmetric folding. When using asymmetric folding, the size of the first housing 41 and the second housing 42 can be different or the size difference is greater than a threshold (such as 50% or 60% or 70%), correspondingly, the first display area 131 in the touch screen The difference between the area of and the area of the second display region 132 is greater than the threshold.

Schematically, as shown in FIG. 6D , the terminal 400 is an asymmetrically folded outer folding screen terminal, and the size of the first casing 41 is larger than that of the second casing 42 . In the folded state, the area of the first display area 131 is larger than the area of the second display area 132 .

In Fig. 6A to Fig. 6D, only the terminal 400 includes two shells and a connection assembly for connecting the shells as an example for schematic illustration (the terminal is a two-fold structure). In other possible implementations, the terminal The 400 may include n parts of the housing and n-1 connection components. Correspondingly, the touch screen of the terminal 400 contains 2n-1 display areas, and the n-1 display areas corresponding to the connection components are made of flexible materials. In this way, a terminal with an n-fold structure is realized, which is not limited in this embodiment.

At least one other component is also provided in the terminal 400, and the at least one other component includes: a camera, a fingerprint sensor, a proximity light sensor, a distance sensor, and the like. In some embodiments, at least one other component is disposed on the front, side or back of the terminal 400 , for example, the fingerprint sensor is disposed on the back or side of the housing, and the camera is disposed above the touch display 430 .

In some other embodiments, at least one other component can be integrated inside or under the touch display screen 430 . In some embodiments, a bone conduction earpiece is placed inside the terminal 400; other components on the front panel of a traditional terminal are integrated into the entire or partial area of the touch display 430, such as the photosensitive element in the camera After splitting into multiple light-sensitive pixels, each light-sensitive pixel is integrated in the black area of each display pixel in the touch screen 430, so that the touch screen 430 has an image acquisition function. Since at least one other component is integrated inside or under the touch display screen 430, the terminal 400 has a higher screen-to-body ratio.

In some optional embodiments, a single side of the middle frame of the terminal 400, or two sides (such as left and right sides), or four sides (such as upper, lower, left and right sides) An edge touch sensor is arranged on two sides), and the edge touch sensor is used to detect at least one of the user's touch operation, click operation, press operation and slide operation on the middle frame. The edge touch sensor may be any one of a touch sensor, a thermal sensor, a pressure sensor, and the like. The user can perform operations on the edge touch sensor to control the application programs in the terminal 400 .

In addition, those skilled in the art can understand that the structure of the terminal 400 shown in the above drawings does not constitute a limitation on the terminal 400, and the terminal may include more or less components than those shown in the figure, or combine some components, or different component arrangements. For example, the terminal 400 also includes components such as a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (Wireless Fidelity, WiFi) module, a power supply, and a Bluetooth module, which will not be repeated here.

In another embodiment, a terminal is also provided, the terminal is provided with a fingerprint sensor under the screen, and the terminal includes a memory, a processor, and a computer program stored on the memory and operable on the processor, The processor is configured to execute the terminal control method provided in the above-mentioned embodiment in FIG. 1 or FIG. 2A .

In another embodiment, a computer-readable storage medium is also provided. Instructions are stored in the computer-readable storage medium. When the computer-readable storage medium is run on a computer, the computer executes the above-mentioned embodiment provided in FIG. 1 or FIG. 2A. Terminal control method.

Those of ordinary skill in the art can understand that all or part of the steps for implementing the above embodiments can be completed by hardware, and can also be completed by instructing related hardware through a program. The program can be stored in a computer-readable storage medium. The above-mentioned The storage medium mentioned may be a read-only memory, a magnetic disk or an optical disk, and the like.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included in the protection of the present invention. within range.

Claims (12)

1. A terminal control method, wherein the method is applied to a terminal having a foldable display screen and the display screen is located at the outer side after being folded, and the method comprises:

when the display screen is in a folded state, determining a first half screen and a second half screen formed by folding;

judging whether a preset touch operation on the first half screen is detected or not;

and when the preset touch operation on the first half screen is detected, controlling the display content of the second half screen according to the preset touch operation.

2. The method of claim 1, wherein determining the first half-panel and the second half-panel formed by the fold comprises:

determining the half screen positioned at the top of the two half screens formed by folding as the first half screen, and determining the half screen positioned at the bottom as the second half screen; or,

determining a half screen in a black screen state in the two half screens formed by folding as the first half screen, and determining a half screen in a bright screen state as the second half screen; or,

when the two half screens formed by folding are both in a bright screen state and display contents are the same, determining any one half screen of the two half screens as the first half screen and determining the other half screen as the second half screen; or,

determining a half screen facing a user and a half screen facing away from the user from the two half screens formed by folding, determining the half screen facing away from the user as the first half screen, and determining the half screen facing the user as the second half screen.

3. The method of claim 2, wherein determining the half-screen facing the user and the half-screen facing away from the user from the two half-screens formed by the folding comprises:

acquiring an image through a configured camera, identifying the acquired image, and determining a half screen facing a user and a half screen facing away from the user from two half screens formed by folding according to an identification result; or,

when the terminal is in a handheld state, determining a handheld gesture of the terminal, and determining a half screen facing a user and a half screen facing away from the user from two half screens formed by folding according to the handheld gesture; or;

when the terminal is in a handheld state, determining the contact area between each of the two half screens formed by folding and a user, determining the half screen with the minimum contact area with the user as the half screen facing the user, and determining the half screen with the maximum contact area with the user as the half screen facing away from the user.

4. The method of claim 1, wherein the controlling the display content of the second half-screen according to the preset touch operation comprises:

determining a first touch position of the preset touch operation in the first half screen;

determining a second touch position of the preset touch operation in the second half screen according to the first touch position and the stored corresponding relation between the first half screen and the second half screen;

determining a control instruction for the display content of the second half screen according to the preset touch operation and the second touch position;

and controlling the display content of the second half screen according to the control instruction.

5. The method according to any one of claims 1 to 4, wherein the predetermined touch operation includes at least one of a point touch operation and a slide operation, and the predetermined touch operation includes predetermined touch operations corresponding to a plurality of force levels.

6. The utility model provides a terminal control device, its characterized in that, the device is applied to in the terminal, the terminal has folding display screen, just the display screen is located the outside after being folded, the device includes:

the determining module is used for determining a first half screen and a second half screen formed by folding when the display screen is in a folded state;

the judging module is used for judging whether preset touch operation on the first half screen is detected or not;

and the control module is used for controlling the display content of the second half screen according to the preset touch operation when the preset touch operation on the first half screen is detected.

7. The apparatus of claim 6, wherein the determination module is to:

determining the half screen positioned at the top of the two half screens formed by folding as the first half screen, and determining the half screen positioned at the bottom as the second half screen; or,

determining a half screen in a black screen state in the two half screens formed by folding as the first half screen, and determining a half screen in a bright screen state as the second half screen; or,

when the two half screens formed by folding are both in a bright screen state and display contents are the same, determining any one half screen of the two half screens as the first half screen and determining the other half screen as the second half screen; or,

determining a half screen facing a user and a half screen facing away from the user from the two half screens formed by folding, determining the half screen facing away from the user as the first half screen, and determining the half screen facing the user as the second half screen.

8. The apparatus of claim 7, wherein the determination module is to:

acquiring an image through a configured camera, identifying the acquired image, and determining a half screen facing a user and a half screen facing away from the user from two half screens formed by folding according to an identification result; or,

when the terminal is in a handheld state, determining a handheld gesture of the terminal, and determining a half screen facing a user and a half screen facing away from the user from two half screens formed by folding according to the handheld gesture; or;

when the terminal is in a handheld state, determining the contact area between each of the two half screens formed by folding and a user, determining the half screen with the minimum contact area with the user as the half screen facing the user, and determining the half screen with the maximum contact area with the user as the half screen facing away from the user.

9. The apparatus of claim 6, wherein the control module is to:

determining a first touch position of the preset touch operation in the first half screen;

determining a second touch position of the preset touch operation in the second half screen according to the first touch position and the stored corresponding relation between the first half screen and the second half screen;

determining a control instruction for the display content of the second half screen according to the preset touch operation and the second touch position;

and controlling the display content of the second half screen according to the control instruction.

10. The apparatus according to any one of claims 6-9, wherein the predetermined touch operation comprises at least one of a point touch operation and a slide operation, and the predetermined touch operation comprises a predetermined touch operation corresponding to a plurality of force levels.

11. A terminal comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor is configured to perform the steps of any of the methods of claims 1-5.

12. A computer-readable storage medium having stored therein instructions which, when executed on a computer, cause the computer to perform the method of any one of claims 1-5.