WO2023078211A1 - Application control method and device, terminal, storage medium, and computer program product - Google Patents

Abstract

An application control method and device, a terminal, a storage medium, and a computer program product, relating to the field of human-computer interaction. The method comprises: in a hover state, displaying an application interface of an application on a second screen area, in the hover state, an included angle between a first screen area and the second screen area being less than a first included angle threshold and greater than a second included angle threshold (501); and upon receiving a trigger operation for the first screen area, controlling the application on the basis of the trigger operation (502). By using the method, a user can implement application control without performing a trigger operation on a screen area that displays an application interface, thereby improving the flexibility of application control.

Description

Application control method, device, terminal, storage medium and computer program product

This application claims the priority of the Chinese patent application with the application number 202111313561.3 and the title of the invention "application control method, device, terminal, storage medium and computer program product" filed on November 08, 2021, the entire contents of which are incorporated by reference in this application.

technical field

The embodiments of the present application relate to the field of human-computer interaction, and in particular to an application control method, device, terminal, storage medium, and computer program product.

Background technique

With the continuous development of terminal screen manufacturing technology, more and more folding screen terminals have emerged as the times require. Since the screen of the folding screen terminal is foldable, it also has the advantages of large-screen display and portability.

However, in the process of running applications using a folding screen terminal, the flexibility of application control is relatively poor.

Contents of the invention

Embodiments of the present application provide an application control method, device, terminal, storage medium, and computer program product. Described technical scheme is as follows:

On the one hand, an embodiment of the present application provides an application control method, the method is used in a folding screen terminal, and the folding screen of the folding screen terminal includes a first screen area and a second screen area, and the method includes:

In the hovering state, an application interface of the application is displayed in the second screen area, and in the hovering state, the angle between the first screen area and the second screen area is less than a first angle threshold and greater than The second included angle threshold;

If a touch operation on the first screen area is received, the application is controlled based on the touch operation.

On the other hand, an embodiment of the present application provides an application control device, the device is used in a folding screen terminal, the folding screen of the folding screen terminal includes a first screen area and a second screen area, and the device includes:

a display module, configured to display an application interface of an application in the second screen area in a hovering state, and in the hovering state, the included angle between the first screen area and the second screen area is smaller than the first The included angle threshold is greater than the second included angle threshold;

A control module, configured to control the application based on the touch operation when the touch operation on the first screen area is received.

On the other hand, an embodiment of the present application provides a terminal, the terminal includes a processor and a memory; the memory stores at least one instruction, and the at least one instruction is used to be executed by the processor to implement the above aspects The application control method described above.

In another aspect, a computer-readable storage medium is provided, the storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the application control method as described in the above aspect.

On the other hand, an embodiment of the present application provides a computer program product, where the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the application control method provided by the above aspects.

Description of drawings

FIG. 1 shows a structural block diagram of a terminal provided by an exemplary embodiment of the present application;

Fig. 2 shows a structural block diagram of a terminal provided by another exemplary embodiment of the present application;

Fig. 3 shows a schematic structural diagram of a folding screen terminal provided by an exemplary embodiment of the present application;

Fig. 4 shows a schematic structural diagram of a folding screen terminal provided by another exemplary embodiment of the present application;

Fig. 5 is a flowchart of an application control method shown in an exemplary embodiment of the present application;

Fig. 6 is an implementation schematic diagram of a video application control process shown in an exemplary embodiment of the present application;

Fig. 7 is an implementation schematic diagram of the process of switching from the expanded state to the hovering state shown in an exemplary embodiment of the present application;

Fig. 8 is an implementation schematic diagram of the process of switching from the folded state to the hovering state shown in an exemplary embodiment of the present application;

Fig. 9 is a schematic diagram of an application interface display mode under different postures shown in an exemplary embodiment of the present application;

Fig. 10 is a flowchart of an application control method shown in another exemplary embodiment of the present application;

Fig. 11 is a schematic diagram of the coordinate mapping relationship between the first screen area and the second screen area shown in an exemplary embodiment of the present application;

Fig. 12 is a schematic diagram of an anti-mistouch area shown in an exemplary embodiment of the present application;

Fig. 13 is a schematic diagram of a touch area division method shown in an exemplary embodiment of the present application;

Fig. 14 is an implementation schematic diagram of a state switching process of a touch mapping mode shown in an exemplary embodiment of the present application;

Fig. 15 is a schematic diagram of an application interface adaptation process shown in an exemplary embodiment of the present application;

Fig. 16 shows a structural block diagram of an application control device provided by an exemplary embodiment of the present application.

Detailed ways

In order to make the purpose, technical solutions and advantages of the application clearer, the following will further describe the implementation of the application in detail in conjunction with the accompanying drawings.

Referring to FIG. 1 and FIG. 2 , it shows a structural block diagram of a terminal 100 provided by an exemplary embodiment of the present application. The terminal 100 can be a smart phone, a tablet computer, an e-book, and so on. The terminal 100 in this application may include one or more of the following components: a processor 110 , a memory 120 and a display screen 130 .

Processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire terminal 100, and executes the terminal by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. 100's of various functions and processing data. Optionally, the processor 110 may adopt at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). implemented in the form of hardware. The processor 110 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly processes the operating system, user interface and application programs, etc.; the GPU is responsible for rendering and drawing the content that needs to be displayed on the touch screen 130 ; the modem is used for processing wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 110, but implemented by a single chip.

The memory 120 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory, ROM). Optionally, the memory 120 includes a non-transitory computer-readable storage medium. The memory 120 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions and the like for implementing the following method embodiments; the storage data area can store data created according to the use of the terminal 100 (such as audio data, phonebook) and the like.

Taking the operating system as an Android system as an example, the programs and data stored in the memory 120 are as shown in Figure 1, and the memory 120 is stored with a Linux kernel layer 220, a system runtime layer 240, an application framework layer 260 and an application layer 280 . The Linux kernel layer 220 provides underlying drivers for various hardware of the terminal 100, such as display drivers, audio drivers, camera drivers, Bluetooth drivers, Wi-Fi drivers, power management, and so on. The system runtime layer 240 provides main feature support for the Android system through some C/C++ libraries. For example, the SQLite library provides database support, the OpenGL/ES library provides 3D drawing support, and the Webkit library provides browser kernel support. An Android Runtime library (Android Runtime) is also provided in the system runtime layer 240, which mainly provides some core libraries and can allow developers to use the Java language to write Android applications. The application framework layer 260 provides various application programming interfaces (Application Programming Interface, API) that may be used when building applications. Developers can also use these APIs to build their own applications, such as activity management, window management, view management, notification management, content provider, package management, call management, resource management, location management. There is at least one application program running in the application layer 280, and these application programs can be contact programs, SMS programs, clock programs, camera applications, etc. Communication programs, photo beautification programs, etc.

Taking the operating system as the IOS system as an example, the programs and data stored in the memory 120 are as shown in Figure 2, and the IOS system includes: a core operating system layer 320 (Core OS layer), a core service layer 340 (Core Services layer), a media layer 360 (Media layer), touchable layer 380 (Cocoa Touch Layer). The core operating system layer 320 includes an operating system kernel, drivers, and underlying program frameworks. These underlying program frameworks provide functions closer to hardware for use by the program frameworks located in the core service layer 340 . The core service layer 340 provides system services and/or program frameworks required by applications, such as foundation framework, account framework, advertisement framework, data storage framework, network connection framework, geographic location framework, exercise framework and so on. The media layer 360 provides audio-visual interfaces for applications, such as interfaces related to graphics and images, interfaces related to audio technology, interfaces related to video technology, and wireless playback (AirPlay) interfaces of audio and video transmission technologies. The touchable layer 380 provides various commonly used interface-related frameworks for application development, and the touchable layer 380 is responsible for the user's touch interaction operation on the terminal 100 . Such as local notification service, remote push service, advertising framework, game tool framework, message user interface interface (User Interface, UI) framework, user interface UIKit framework, map framework and so on.

In the framework shown in FIG. 2 , frameworks related to most applications include but not limited to: the basic framework in the core service layer 340 and the UIKit framework in the touchable layer 380 . The basic framework provides many basic object classes and data types, and provides the most basic system services for all applications, regardless of UI. The class provided by the UIKit framework is a basic UI class library for creating a touch-based user interface. iOS applications can provide UI based on the UIKit framework, so it provides the infrastructure of the application for building user interfaces, drawing , Handle and user interaction events, respond to gestures, and more.

The display screen 130 is used to display the application interface of each application program; when the display screen 130 also has a touch function, it is also used to receive a user's touch operation on or near it using any suitable object such as a finger or a touch pen.

In the embodiment of the present application, the display screen 130 is a folding screen, including a first screen area and a second screen area. Optionally, when the terminal is an inner folding screen terminal, the first screen area and the second screen area are two screen areas of the inner folding screen. When the inner folding screen terminal is in the unfolded state, both the first screen area and the second screen area are exposed; when the inner folding screen terminal is in the folded state, neither the first screen area nor the second screen area is exposed.

The hovering state in the embodiment of the present application is an intermediate state between the expanded state and the folded state. In some application scenarios, a folding screen terminal in a hovering state is usually placed horizontally with the housing corresponding to the screen area on one side, while the housing corresponding to the screen area on the other side is in a vertical state, that is, the screen areas on both sides have a An included angle, the included angle may be an angle greater than 0 degrees and less than 180 degrees.

In a possible implementation manner, the folding screen terminal can control the folding screen to maintain an arbitrary angle or a specific angle through a hinge provided at the rotating shaft, so as to maintain a hovering state.

Schematically, as shown in Figure 3, when the inner folding screen terminal is in the unfolded state, both the first screen area 301 and the second screen area 302 are in the exposed state; when the inner folding screen terminal is in the folded state, the first screen area 301 and the second screen area 302 are in a closed state; when the angle between the first screen area 301 and the second screen area 302 is 120°, the folding screen terminal is in a hovering state. Users can switch the foldable screen between the unfolded state and the folded state according to their own needs. For example, when the user does not have a need to use the terminal, the terminal may be in a folded state, making the terminal more portable. For another example, when the user needs to watch a video, the terminal can be placed in an expanded state or a hovering state.

In a possible implementation manner, besides the folding screen, the folding screen terminal further includes an auxiliary display screen independent of the folding screen. In some embodiments, the auxiliary display screen is arranged opposite to the folding screen, the size of the auxiliary display screen is smaller than the size of the folding screen in an unfolded state, and the auxiliary display screen does not support folding. For example, the auxiliary display screen is set opposite to the first screen area of the folding screen, or is set opposite to the second screen area of the folding screen, and the size of the auxiliary display screen is smaller than or equal to the size of the first screen area or the second screen area .

Optionally, the auxiliary display screen is exposed in different states. Schematically, as shown in FIG. 4, when the folding screen terminal is in the unfolded state, the first screen area 401, the second screen area 402, and the auxiliary display screen 403 are all in an exposed state; when the folding screen terminal is in the folded state, the second screen area 401 The first screen area 401 and the second screen area 402 are in a closed state, and the auxiliary display screen 403 is exposed.

Optionally, the folding screen and the secondary display support independent display. In some embodiments, when the folding screen terminal is in the folded state, images can be displayed on the auxiliary display screen (the folding screen does not display); when the folding screen terminal is in the unfolded state or hovering state, images can be displayed on the folding screen (Auxiliary display does not display). In order to realize the folding of the display screen, in a possible implementation manner, the folding screen is made of a flexible material (with a certain stretchability), or the bending area of the folding screen is made of a flexible material.

In Fig. 3 and Fig. 4, only the form (folded in half) of the display screen 130 is schematically illustrated. In other possible implementations, the display screen 130 may include n (n≥3) screen areas, so as to realize n - A folding screen terminal with a 1-fold structure, which is not limited in this embodiment.

Optionally, at least one other component is further disposed in the terminal 100, and the at least one other component includes: a camera, a fingerprint sensor, a proximity light sensor, a distance sensor, and the like. In some embodiments, at least one other component is disposed on the front, side or back of the terminal 100 , such as disposing the fingerprint sensor on the back cover or the side, and disposing the camera on one side of the display screen 130 .

In other embodiments, at least one other component may be integrated inside or under the display screen 130 . In some embodiments, a bone conduction earpiece is placed inside the terminal 100; other components on the front panel of a traditional terminal are integrated into all or part of the display 130, such as removing the photosensitive element in the camera After being divided into a plurality of photosensitive pixels, each photosensitive pixel is integrated in the black area of each display pixel in the display screen 130 , so that the display screen 130 has an image acquisition function. Since at least one other component is integrated inside or under the display screen 130, the terminal 100 has a higher screen-to-body ratio.

In addition, those skilled in the art can understand that the structure of the terminal 100 shown in the above drawings does not constitute a limitation on the terminal 100, and the terminal may include more or less components than those shown in the figure, or combine some components, or different component arrangements. For example, the terminal 100 also includes components such as a radio frequency circuit, an input unit, an audio circuit, a wireless fidelity (Wireless Fidelity, WiFi) module, a power supply, and a Bluetooth module, which will not be repeated here.

Please refer to FIG. 5 , which shows a flowchart of an application control method shown in an embodiment of the present application. This embodiment uses the application control method for a folding screen terminal, and the folding screen of the folding screen terminal includes a first screen area and a second screen area. The second screen area is taken as an example for description, and the method includes the following steps.

Step 501, in the hovering state, display the application interface of the application in the second screen area, and in the hovering state, the angle between the first screen area and the second screen area is less than the first angle threshold and greater than the second angle threshold .

In a possible implementation manner, the folding screen terminal displays the application interface of the application in other states, and when the other state is switched to the hovering state, the folding screen terminal controls the second screen area to display the application interface of the application. Wherein, other states may be unfolded state or collapsed state.

In a possible implementation, in the hovering state, a part of the folding screen terminal can be placed flat on a desktop or other places, and the other part can be erected, that is, the two parts have an included angle, and the included angle can be greater than 0 degrees and less than 180 degrees. At this time, the folding screen terminal displays the application interface on the upright part, and does not display the application interface on the horizontal part. Generally, the folding screen terminal identifies the screen area of the upright part as the second screen area, and identifies the screen area of the horizontal part as the first screen area.

Optionally, the application can be any application, or an application that supports display in the hover state, and the application type of the application can be video playback type, music playback type, photo album type, reading type, etc. The embodiment of the application does not limit this.

In some embodiments, when the angle between the first screen area and the second screen area is greater than or equal to the first angle threshold, the folding screen terminal is in the unfolded state; when the angle between the first screen area and the second screen area When the included angle is less than or equal to the second included angle threshold, the folding screen terminal is in the folded state; when the included angle between the first screen area and the second screen area is greater than the second included angle threshold and smaller than the first included angle threshold, The folding screen terminal is in the hovering state. For example, the first included angle threshold is 120° or 150°, etc., and the second included angle threshold is 60°, 30°, etc., which is not limited in this embodiment of the present application.

Optionally, the angle between the first screen area and the second screen area may be measured by an angle sensor in the hinge connecting the two screen areas, or by introducing an infrared measuring device. In the embodiment of the present application, There is no limit to this.

Step 502, in the case of receiving a touch operation on the first screen area, control the application based on the touch operation.

In related technologies, when a user wants to control an application, a touch operation needs to be performed on a screen area where the application is displayed. In the hovering state, the second screen area of the display application is in a vertical screen state. Direct operations on the second screen area may easily cause the folding screen terminal to topple and affect the user experience, while the first screen area of the horizontal part is relatively Stable, the touch operation on the first screen area is not easy to cause the folding screen terminal to fall. Therefore, in the embodiment of the present application, the folding screen terminal can receive the touch operation through the first screen area, and map the received touch operation to the second screen area, so as to realize the control through the touch operation in the first screen area. Apps in the second screen area.

In addition, the user can still directly perform touch operations on the second screen area to control the application. Through the two response modes of touch operation, it can meet the needs of different users and improve the flexibility of application control. In the hovering state, the control of the application can be realized without blocking the application interface, making the user more comfortable. Tend to use the folding screen terminal in the hover state.

Optionally, the touch operation may be touch operations such as click, long press, and slide, which are not limited in this embodiment of the present application.

It should be noted that, unlike the touchpad of a laptop computer, it is used to control a specific object in the display screen, such as controlling the movement of the cursor, clicking, etc. In the embodiment of this application, the touch function of the second screen area is Copy and transfer to the first screen area, and map the touch operation in the first screen area to the touch operation in the second screen area, instead of controlling a specific object based on the touch operation in the first screen area. In addition, different from the same touch operation located in different touch areas on the touch panel to achieve the same function, that is, the function controlled by the touch operation has nothing to do with the touch area. In the embodiment of the present application, the function controlled by the touch operation is different from The touch area is related, that is, the same touch operation located in different touch areas in the first screen area may implement different functions.

In some embodiments, when the application is a multimedia application, when the folding screen terminal receives a horizontal sliding operation on the first screen area, the folding screen terminal controls the multimedia content of the multimedia application based on the sliding direction and sliding distance of the horizontal sliding operation. playback progress. Optionally, when the sliding direction is the first horizontal sliding direction (for example, it is consistent with the forward direction of the progress bar), the folding screen terminal controls the multimedia application to fast forward; when the sliding direction is the second horizontal sliding direction (same as the first horizontal sliding direction), opposite direction), the folding screen terminal controls the multimedia application to rewind; and, the fast-forward duration or rewind duration is positively correlated with the sliding distance.

In the case of receiving a vertical sliding operation on the first screen area, the folding screen terminal controls the multimedia playback parameters of the multimedia application based on the sliding direction and the sliding distance of the vertical sliding operation, and the multimedia playback parameters include at least one of playback volume or display brightness. kind. Optionally, when the vertical sliding operation is located in the first sub-area (such as the left area) of the first screen area, the vertical sliding operation is used to control the playback volume; when the vertical sliding operation is located in the second sub-area of the first screen area ( For example, the right area), the vertical sliding operation is used to control the display brightness, and the adjustment range of the playback parameters is positively correlated with the sliding distance.

In the case of receiving a click operation on the first screen area, the folding screen terminal controls the multimedia state based on the click operation, and the multimedia state includes a play state and a pause state. Wherein, when the multimedia application is in the playing state, the folding screen terminal sets the multimedia application to the pause state based on the click operation; when the multimedia application is in the pause state, the folding screen terminal sets the multimedia application to the playing state based on the click operation.

In the case of receiving a long press operation on the first screen area, the folding screen terminal controls the multimedia playback speed based on the long press operation. Optionally, the folding screen terminal can adjust the multimedia playback speed according to a fixed ratio, for example, adjust the multimedia playback speed to 3 times; or, the folding screen terminal can dynamically adjust the change ratio of the multimedia playback speed according to the duration of the long press.

Schematically, as shown in FIG. 6, when the application is a video application, sliding up and down on the left side of the first screen area 601 can adjust the brightness of the video displayed in the second screen area 602; Sliding up and down on the right side can adjust the volume of the video displayed in the second screen area 602 ;

It should be noted that the above touch operations and touch functions are for illustrative purposes only, the same touch operation can implement different touch functions in different types of applications, and different types of applications can correspond to different touch operations , which is not limited in this embodiment.

To sum up, in the embodiment of the present application, when the folding screen terminal is in the hovering state, the application interface of the terminal control application is only displayed in the second screen area, and receives touch operations acting on the first screen area, so that based on The touch operation controls the applications displayed in the second screen area. By adopting the solution provided by the embodiment of the present application, the user can realize application control without performing touch operations on the screen area where the application interface is displayed, which improves the flexibility of application control; and, compared with directly performing touch operations on the second screen area Touch operation in the first screen area helps to improve the stability of the folding screen terminal in the hovering state, and reduces the probability of the folding screen terminal tipping over during the touch process.

Optionally, in the case of receiving a touch operation on the first screen area, controlling the application based on the touch operation includes:

When a touch operation on the first screen area is received and the touch operation is located outside the false touch prevention area, the application is controlled based on the touch operation, and the false touch prevention area is located at an edge area of the first screen area.

Optionally, the method also includes:

When a touch operation on the first screen is received and the touch operation is located in the false touch prevention area, the touch operation is shielded.

Optionally, when a touch operation on the first screen area is received and the touch operation is outside the false touch prevention area, controlling the application based on the touch operation includes:

When a touch operation on the first screen area is received and the touch operation is located outside the false touch prevention area, determine the target operation type corresponding to the operation area on which the touch operation is applied, and the target operation type is support response in the operation area type of operation;

When the operation type of the touch operation belongs to the target operation type, the application is controlled based on the touch operation.

Optionally, the method also includes:

When the operation type of the touch operation does not belong to the target operation type, the touch operation is shielded.

Optionally, when a touch operation on the first screen area is received and the touch operation is outside the false touch prevention area, controlling the application based on the touch operation includes:

When a touch operation on the first screen area is received, and the touch operation is located outside the false touch prevention area and the event shielding area, control the application based on the touch operation, and display the controls in the event shielding area and the second screen area corresponding to the region.

Optionally, the method includes:

In the expanded state, the application interface of the application is displayed on the first screen area and the second screen area, and in the expanded state, the angle between the first screen area and the second screen area is greater than the first angle threshold;

In the hovering state, the application interface of the application is displayed in the second screen area, including:

In the case of switching from the expanded state to the hovering state, the application interface of the application is displayed in the second screen area, and the first screen area is controlled to stop displaying the application interface of the application.

Optionally, the folding screen terminal also includes an auxiliary display screen, and the auxiliary display screen is independent of the folding screen;

The method includes:

In the folded state, the application interface of the application is displayed on the auxiliary display screen, in the folded state, the auxiliary display screen is exposed, and the angle between the first screen area and the second screen is smaller than the second angle threshold;

In the hovering state, the application interface of the application is displayed in the second screen area, including:

In the case of switching from the folded state to the hovering state, the application interface of the application is displayed in the second screen area, and the auxiliary display screen is controlled to stop displaying the application interface of the application.

Optionally, control applications based on touch operations, including:

generating a first touch event based on a touch operation;

converting the first touch event into a second touch event based on the mapping relationship between the first screen area and the second screen area;

The application is controlled based on the second touch event.

Optionally, the first touch event includes touch coordinates of the touch operation;

Converting the first touch event into a second touch event based on the mapping relationship between the first screen area and the second screen area includes:

Based on the mapping relationship between the first screen area and the second screen area, coordinate conversion is performed on the touch coordinates in the first touch event, and the second touch event is determined according to the converted touch coordinates, wherein the converted touch Control coordinates are located in the second screen area.

Optionally, the first screen area has a touch mapping mode, in which touch operations on the first screen area are mapped to the second screen area, so as to realize the touch operation control application based on the first screen area; Methods also include:

In the hovering state, set the touch mapping mode of the first screen area to active state.

Optionally, after setting the touch mapping mode of the first screen area to an active state, the method further includes:

If no touch operation on the first screen area is received within a preset time period, the touch mapping mode is switched from an active state to a dormant state.

Optionally, after the touch mapping mode is switched from the active state to the dormant state, it also includes:

When the activation operation on the first screen area is received, the touch mapping mode is switched from the dormant state to the active state.

Optionally, the application interface of the application is displayed in the second screen area, including:

Get the application interface in the horizontal screen state;

Adapting the application interface in the horizontal screen state based on the size of the second screen area to obtain an adapted application interface;

The adapted application interface is displayed in the second screen area.

Optionally, in the hovering state, the first screen area is in a screen-off state; or, a target interface is displayed, and the target interface is different from the application interface.

Optionally, the first screen area is a screen area in a flat posture in a hovering state, and the second screen area is a screen area in a vertical screen posture in a hovering state.

Optionally, the method also includes:

In the case that the first screen area is switched to the portrait orientation, and the second screen area is switched to the horizontal orientation, displaying the application interface of the application in the first screen area;

In the case of receiving a touch operation on the second screen area, the application is controlled based on the touch operation.

Optionally, the application is a multimedia application;

In the case of receiving a touch operation on the first screen area, controlling the application based on the touch operation includes:

In the case of receiving a horizontal sliding operation on the first screen area, controlling the multimedia playback progress of the multimedia application based on the sliding direction and sliding distance of the horizontal sliding operation; or,

In the case of receiving a vertical sliding operation on the first screen area, control multimedia playback parameters of the multimedia application based on the sliding direction and sliding distance of the vertical sliding operation, where the multimedia playback parameters include at least one of playback volume or display brightness; or ,

In the case of receiving a click operation on the first screen area, controlling the multimedia state based on the click operation, where the multimedia state includes a play state and a pause state; or,

In the case of receiving a long press operation on the first screen area, the multimedia playback speed is controlled based on the long press operation.

In a possible application scenario, when the folding screen of the folding screen terminal is an inner folding screen, in the unfolded state, the folding screen terminal displays the application interface of the application in the first screen area and the second screen area, wherein, in the unfolded state , the angle between the first screen area and the second screen area is greater than a first angle threshold.

In the case of switching from the unfolded state to the hovering state, since the first screen area and the second screen area are not on the same plane in the hovering state, if the application interface continues to be displayed in full screen, the screen will be deformed. In the hovering state, the folding screen terminal controls the second screen area to continue displaying the application interface of the application, and controls the first screen area to stop displaying the application screen of the application (that is, the folding screen terminal only displays the application interface on half the screen).

It should be noted that the application interface continuously displayed in the second screen area is adapted so as to match the size of the second screen area and ensure the integrity of the displayed content.

Schematically, as shown in FIG. 7, in the unfolded state, the first screen area 601 and the second screen area 602 of the folding screen display the video playback interface in full screen; when the user folds the folding screen from the unfolded state to the hovering state, the second The second screen area 602 continues to display the video playback interface, while the first screen area 601 stops displaying the video playback interface.

In another possible application scenario, in addition to the folding screen, the folding screen terminal is also provided with an auxiliary display screen independent of the folding screen. Wherein, in the folded state, the application interface of the application is displayed on the auxiliary display screen, and in the folded state, the auxiliary display screen is exposed, and the angle between the first screen area and the second screen is smaller than the second angle threshold.

In the case of switching from the folding state to the hovering state, it indicates that the user expects to view the content through the folding screen instead of viewing the content through the auxiliary display screen, so the folding screen terminal displays the application interface in the second screen area and controls the auxiliary display screen to stop Display the application interface.

Schematically, as shown in FIG. 8 , in the folded state, the first screen area 601 and the second screen area 602 of the foldable screen are not exposed, and the foldable screen terminal displays a video playback interface through the auxiliary display screen 603 . When the user unfolds the folding screen terminal from the folded state to the hovering state, the second screen area 602 continues to display the video playback interface, the first screen area 601 does not display the video playback interface, and the auxiliary display screen 603 is in an off state.

In a possible implementation manner, the first screen area is a screen area in a horizontal position in a hovering state, and the second screen area is a screen area in a vertical position in a hovering state. Correspondingly, in the hovering state, the folding screen terminal needs to determine the screen area for displaying the application interface and the screen area for touching according to the current posture. Optionally, the process for the folding screen terminal to determine the screen area for interface display and touch mapping may include the following steps.

1. In the hovering state, obtain the posture of the first screen area and the posture of the second screen area.

In a possible implementation manner, the folding screen terminal can determine the attitudes of the first screen area and the second screen area respectively (for example, determine the attitude according to the direction of the acceleration of gravity) according to the acceleration of gravity data collected by the built-in gravity sensor. It can be in a portrait posture or a flat posture. The embodiment of the present application does not limit the manner of determining the attitude of the screen area.

Among them, the flat posture is a state in which the angle between the screen area and the plane is smaller than the angle threshold (for example, 10°), and the vertical screen state is a state in which the angle between the screen area and the plane is greater than the angle threshold.

Schematically, as shown in FIG. 7 or 8 , in the hovering state, the first screen area 601 is in a flat state, and the second screen area 602 is in a vertical state.

2. When the first screen area is in the horizontal position and the second screen area is in the vertical position, display the application interface of the application on the second screen area.

When users use a folding screen terminal in the hovering state, they usually hope that the folding screen terminal displays content through the screen area in the vertical screen state. gesture, the terminal displays the application interface (after interface adaptation) in the second screen area.

As shown in Figure 7 or 8, the folding screen terminal detects that the first screen area 601 is in a flat position and the second screen area 602 is in a vertical position, thereby controlling the second screen area 602 to display the video playback interface and controlling the first screen area 602 Area 601 stops displaying the video playback interface.

In a possible scenario, the user may flip the folding screen terminal in the hovering state, resulting in changes in the postures of the first screen area and the second screen area. Correspondingly, the folding screen terminal needs to Changes, dynamically switching the display state of the screen area, optionally, the method may also include the following steps:

1. When the first screen area is switched to the portrait posture and the second screen area is switched to the horizontal posture, display the application interface of the application in the first screen area, and set the second screen area to touch mapping mode .

After turning over the folding screen terminal, if the first screen area that was originally in the horizontal position becomes the vertical screen state, and the second screen area that was originally in the vertical screen state becomes the flat state, the folding screen terminal exchanges the first screen area and the second screen area. The display state of the two screen areas is to display the application interface in the first screen area, and control the second screen area to stop displaying the application interface and enter the touch mapping mode.

Schematically, as shown in FIG. 9 , when the first screen area 901 is switched from the flat posture to the vertical posture, and the vertical posture corresponding to the second screen region 902 is switched to the flat posture, the folding screen terminal can support the application The display of the interface is adjusted, the first screen area 901 displays the application interface, and the second screen area 902 is controlled to stop displaying the application interface.

2. When a touch operation on the second screen area is received, the application is controlled based on the touch operation.

After the display status of the screen area changes, the control method of the application also changes accordingly. In addition to being able to directly perform a touch operation on the application through the first screen area, it is also possible to perform a touch operation on the application through the second screen area.

In a possible implementation manner, the folding screen terminal receives the touch operation through the second screen area, and maps the received touch operation to the first screen area through mapping, so as to realize the touch operation in the second screen area. Actions control apps within the first screen area.

Please refer to FIG. 10 , which shows a flowchart of an application control method according to another embodiment of the present application.

Step 1001, in the hovering state, display the application interface of the application in the second screen area, and in the hovering state, the angle between the first screen area and the second screen area is smaller than the first angle threshold and greater than the second angle threshold .

This step is the same as the above-mentioned step 501, and will not be repeated here in this embodiment of the application.

Step 1002, in the case of receiving a touch operation on the first screen area, generate a first touch event based on the touch operation.

In a possible implementation manner, when the first screen area receives a touch operation, the folding screen terminal generates a first touch event according to the received touch operation, and the event acts on the first screen area. Wherein, the first touch event includes touch coordinates of the touch operation.

Optionally, the first touch event may further include information such as the operation type of the touch operation, the number of touch points, and the touch time, which is not limited in this embodiment.

Step 1003: Convert the first touch event into a second touch event based on the mapping relationship between the first screen area and the second screen area.

In a possible implementation manner, there is a certain mapping relationship between the first screen area and the second screen area of the folding screen terminal, and by establishing a mapping coordinate system between the first screen area and the second screen area, the first The touch event is converted, and a second touch event is determined according to the converted touch coordinates, wherein the second touch event is a touch event acting on the second screen area. Wherein, when converting the first touch event, the touch coordinates corresponding to the first touch event will also be converted according to the mapping relationship to obtain the touch coordinates corresponding to the second touch event, and the obtained touch coordinates in the second screen area.

Optionally, the touch types of the touch operations in the first touch event and the second touch event are the same.

Schematically, as shown in FIG. 11 , the first screen area 1101 and the second screen area 1102 are two display areas of the display screen 1100 . When the user wants to control the video being played in the second screen area 1102 through the first screen area 1101, the folding screen terminal can base the mapping coordinate system between the first screen area 1101 and the second screen area 1102 to The touch coordinates in the touch event are mapped to the touch coordinates in the second screen area 1102 to obtain the second touch event. For example, the coordinates of the touch operation acting on the first screen area 1101 are (x, y). The height of the area 1102, the width of the first screen area 1101 is equal to the width of the second screen area), according to the mapping relationship, the mapping point coordinates (x1, y1) of the touch operation can be obtained in the second screen area 1102, that is, the second The touch coordinates corresponding to the touch event are (x1, y1), where x1=x, y1=y−h, h is the height of the first screen area 1101 or the second screen area 1102 .

It should be noted that when the heights of the first screen area and the second screen area are different, for example, when the height of the first screen area is h1 and the height of the second screen area is h2, if the touch operation acts on the first screen The coordinates of the area are (x, y), and the coordinates of the mapping point in the second screen area are (x2, y2), where x2=x1, y2=h2(y−h2)/h1.

Step 1004, controlling the application based on the second touch event.

In a possible implementation manner, based on the second touch event, the folding screen terminal simulates the touch operation in the first screen area in the second screen area, so as to realize the control of the application.

Schematically, when the application is a video playback application, if the operation type indicated by the second touch event slides up, and the touch coordinates are located in the left display area of the second screen area, the folding screen terminal based on the second touch event Increase the brightness of the video; if the operation type indicated by the second touch event slides up, and the touch coordinates are located in the right display area of the second screen area, the folding screen terminal increases the video volume based on the second touch event.

When using the folding screen terminal in the hovering state, there may be accidental touches, such as: accidentally touching the screen area when clearing the screen area block, accidentally touching the screen area when picking up or putting down the folding screen terminal, etc. Therefore, in order to avoid false touches, the embodiment of the present application introduces an anti-mistouch mechanism. When receiving a touch operation on the first screen area, the folding screen terminal will further determine whether the touch operation is a false touch operation. , if the touch operation is a false touch operation, then do not respond to the touch operation; if the touch operation is not a false touch operation, control the application displayed in the second screen area according to the touch operation.

In a possible implementation manner, when a touch operation on the first screen area is received and the touch operation is outside the false touch prevention area, the folding screen terminal controls the application based on the touch operation. The area is located at the edge area of the first screen area.

Since the misoperation of the screen is usually located at the edge of the screen, in this embodiment, the edge area of the first screen area is set as an anti-mistouch area. For example, the false touch prevention area may be a rectangular frame area with a preset width. The embodiment of the present application does not limit the shape, position and size of the false touch prevention area.

Optionally, the anti-mistouch area can be set by default by the folding screen terminal, or can be set based on the user's usage habits, which is not limited in this embodiment of the present application.

Optionally, when a touch operation on the first screen is received and the touch operation is located in the false touch prevention area, the folding screen terminal shields the touch operation, that is, does not respond to the touch operation.

In some embodiments, when the touch operation is outside the false touch prevention area, the folding screen terminal generates a first touch event based on the touch operation, so as to subsequently generate a second touch event based on the first touch event; When the operation is within the false touch prevention area, the folding screen terminal will not generate the first touch event based on the touch operation.

Regarding the specific method of determining whether the touch operation is located in the false touch prevention area, in a possible implementation manner, in response to the touch operation on the first screen area, the folding screen terminal acquires the touch coordinates of the touch operation, and detects Whether the touch coordinates are within the range of anti-mis-touch coordinates corresponding to the anti-mis-touch area.

For different types of touch operations, the folding screen terminal has different ways of identifying false touches based on touch coordinates. In a possible implementation manner, when the touch operation is a click touch operation, if the touch coordinates of the touch operation are outside the false touch prevention area, it is determined that the touch operation is not a false touch operation; If the touch coordinates of the touch operation are within the false touch prevention area, it is determined that the touch operation is a false touch operation.

When the touch operation is a sliding touch operation, if the coordinates of the touch starting point of the touch operation are outside the false touch prevention area, it is determined that the touch operation is not a false touch operation; if the coordinates of the touch starting point of the touch operation are If it is located in the false touch prevention area, it is determined that the touch operation is a false touch operation.

Of course, in other possible implementation manners, if the touch coordinates of the touch operation overlap with the false touch prevention area, the folding screen terminal determines that the touch operation is a false touch operation, which is not limited in this embodiment.

Schematically, as shown in FIG. 12 , the rectangular frame area located at the edge of the first screen area 1201 is the false touch prevention area 1202 . If the touch position of the click operation is in the false touch prevention area 1202, the folding screen terminal determines the click operation as a false touch operation and does not generate a touch event; if the touch starting point of the sliding operation is in the false touch prevention area 1202, the folding screen terminal The sliding operation is determined as a false touch operation, and no touch event is generated.

Since the user usually performs a specific type of touch operation in a specific area, for example, sliding the finger on the left side of the screen to control the volume, and tapping the middle of the screen to control the playback or pause of the video, in order to further reduce the probability of false touches, in a possible In the implementation manner, the areas outside the false touch prevention area in the first screen area are further subdivided into several sub-areas, and each sub-area only supports a specific type of touch operation.

In a possible implementation manner, when a touch operation on the first screen area is received and the touch operation is outside the false touch prevention area, the folding screen terminal determines the target corresponding to the operation area on which the touch operation is applied. Operation type, the target operation type is the operation type that supports the response in the operation area.

If the operation type of the touch operation belongs to the target operation type, the folding screen terminal controls the application based on the touch operation; if the operation type of the touch operation does not belong to the target operation type, the folding screen terminal blocks the touch operate.

Optionally, after determining that the touch operation is not a false touch operation based on the touch coordinates, the folding screen terminal needs to further determine whether the area on which the touch operation is applied supports responding to the touch operation. In some embodiments, the folding screen terminal determines the target area on which the touch operation acts based on the touch coordinates, and determines the target operation type supported by the target area based on the correspondence between the area and the operation type. Wherein, the corresponding relationship between the region and the operation type may be set by default by the terminal, or may be customized by the user according to the user's own needs, or may be set based on the touch operation support of the application itself, which is not limited in this embodiment.

Optionally, when the operation type of the touch operation belongs to the target operation type, the folding screen terminal generates a first touch event based on the touch operation, so as to subsequently generate a second touch event based on the first touch event; when the touch operation When the operation type does not belong to the target operation type, the folding screen terminal will not generate the first touch event based on the touch operation.

Schematically, as shown in FIG. 13 , the first screen area 1301 is divided into an anti-mistouch area 1302, a sliding response area 1303 and a global response area 1304, wherein the sliding response area 1303 only supports responding to sliding operations, and the global response area 1304 Supports responding to all types of touch operations (including slide operations, tap operations, long press operations, etc.).

When the user performs a click operation on the slide response area 1303, since the slide response area 1303 does not support a click operation, no click touch event will be generated; when the user performs a slide operation on the slide response area 1303, since the slide response area 1303 supports In response to the sliding operation, the folding screen terminal generates a sliding touch event. When the user performs a click operation or a slide operation in the global response area 1304, since the global response area 1304 supports various types of touch operations, the folding screen terminal generates a corresponding click touch event or a slide touch event.

It should be noted that, the above-mentioned embodiment only schematically illustrates the area division method and the corresponding touch operations supported by the area, but does not constitute a limitation thereto.

Optionally, when the folding screen terminal cannot control the application based on the touch operation in the first screen area, a prompt message may be displayed in the first screen area (incorrect touch or an unsupported touch operation performed in the touch area ), prompting the user how to correctly perform touch operations in the first screen area.

In this embodiment, by setting an anti-mistouch area at the edge of the first screen area, and shielding touch operations in the anti-mistouch area, the influence of user mistouch on the application is avoided, and the accuracy of human-computer interaction is improved. sex.

In addition, by dividing the first screen area and setting the type of response operation supported by each area, the response to specific operations in the touch area is realized, the probability of responding to user misoperation is further reduced, and the accuracy of application control is improved. sex.

Since the application interface is not displayed in the first screen area, only some simple gesture operations can be realized in the first screen area, and precise operations on the content displayed in the second screen area cannot be realized (such as clicking on specific controls displayed in the second screen area) ). In order to avoid misoperations, the folding screen terminal needs to further shield specific operations in the first screen area.

In a possible implementation manner, when a touch operation on the first screen area is received, and the touch operation is located outside the false touch prevention area and the event shielding area, the folding screen terminal controls the application based on the touch operation, The event mask area corresponds to the display area of the controls in the second screen area. If the touch operation is within the event screen area, the folding screen terminal will not respond to the touch operation.

Optionally, the event shielding area may be a fixed static area or a non-fixed dynamic area, which is not limited in this embodiment of the present application.

When the event shielding area is a dynamic area, the folding screen terminal needs to determine the corresponding touch area mapped to the first screen area according to the touch area corresponding to the control in the second screen area, and then determine the event for the mapped touch area shielded area.

Optionally, when the application is a video playback application, the control can be a selection control, a like control, a reward control, etc.; when the application is a music playback application, the control can be a next song control, a download control, a cycle Playing controls, etc., the embodiment of the present application does not limit the specific types of controls.

For example, when a jump control is displayed in the second screen area (click to jump to play the next episode), the folding screen terminal determines the display area of the jump control in the second screen area, and sets the display area in the first screen area. A corresponding area in the screen area is determined as an event shielding area, and touch operations in the event shielding area are set to be shielded (for example, click operations are shielded). In the future, if the user performs a click operation in the event shielding area, the folding screen terminal will not generate a touch event (the user may just want to stop the playback, if a touch event is generated, the application responds to the touch event and will cause jump playback next episode).

In a possible implementation manner, the first screen area has a touch mapping mode, and in the touch mapping mode, touch operations on the first screen area are mapped to the second screen area, so as to realize control application. Moreover, the touch mapping mode has an active state and a dormant state, and in the hovering state, the folding screen terminal sets the touch mapping mode of the first screen area to the active state.

Optionally, when the touch mapping mode is activated, the touch function of the first screen area is on, and the display function of the first screen area is off, that is, the screen of the first screen area is off, or the second screen area Both the touch and display functions of the area are turned on, and the content displayed on the first screen area is different from the application interface displayed on the second screen area.

In the embodiment of the present application, in the touch mapping mode, the folding screen terminal receives touch operations through the first screen area, and the touch operations in the first screen area will be mapped to the second screen area. To put it simply, the touch function of the second screen area is transferred to the first screen area (the touch function of the second screen area is still valid), and the user performs a touch operation on the first screen area, which is equivalent to the touch operation in the second screen area. Perform touch operations on the screen area.

After setting the touch mapping mode of the first screen area to active state, the user may not control the application through the first screen area for a long time. In order to reduce the power consumption of the folding screen terminal and avoid false touches, the touch mapping mode of the first screen area can be switched to the dormant state, and the user can switch the touch mapping mode to the active state again through the activation operation. The process is as follows:

One, if no touch operation on the first screen area is received within a preset time period, the touch mapping mode is switched from an active state to a dormant state.

In a possible implementation manner, when the touch mapping mode of the first screen area is set to the active state and no touch operation is received within a preset period of time, in order to reduce power consumption, the folding screen terminal uses the first screen area The touch mapping mode of the area is switched from the active state to the dormant state.

Optionally, when the touch mapping mode is in the dormant state, the touch function of the first screen area is turned off, and cannot respond to any touch operation in the first screen area (at this time, the activation operation for activating the touch mapping mode is non-touch operation); or, the touch function of the first screen is turned on, but it can only respond to a specific touch operation in the area of the first screen (such as an activation operation of a specific touch gesture).

Schematically, when the first screen area is in the touch mapping mode and does not receive a touch operation within one minute after being activated, the touch mapping mode is switched from the active state to the dormant state.

Optionally, the preset duration can be set by the system, or can be set by the user according to their own habits, which is not limited in this embodiment of the present application.

Second, when an activation operation on the first screen area is received, the touch mapping mode is switched from a dormant state to an active state.

In a possible implementation manner, in the sleep state, the user cannot control the second screen area by performing a touch operation on the first screen area. When the user wants to control the application displayed in the second screen area through the touch operation of the first screen area, it is necessary to activate the first screen area first, and change the touch mapping mode of the first screen area from the dormant state to Switch to active state.

Optionally, when the first screen area is switched from the dormant state to the active state, the first screen area may display a switching screen to prompt the user that the first screen area has been activated; when the first screen area is switched from the dormant state to After the activated state, the first screen area can be displayed as a touchpad background to remind the user that in this state, the first screen area can be used as a touchpad.

Optionally, the activation operation on the first screen area is a preset touch gesture in the first screen area, for example: double-tap, three-finger slide, and the like. Alternatively, the user may also activate the touch mapping mode of the first screen area through voice or physical keys, which is not limited in this embodiment of the present application.

Optionally, the switching screen and the background of the touchpad may be the default setting of the folding screen terminal, or may be set by the user according to his own preference, which is not limited in this embodiment of the present application.

Schematically, please refer to FIG. 14 , in the hovering state, the second screen area 1402 displays an application interface, and the first screen area 1401 is in a dormant state (screen off). When the user wants to control the application interface through the first screen area 1401 , he can double-tap with two fingers in the first screen area 1401 to activate the first screen area 1401 . In the activated state, the first screen area 1401 displays touch operation prompt information (prompting touch functions in different areas). If the first screen area 1401 does not receive a touch operation within one minute after being activated, the first screen area 1401 will switch to the dormant state again.

In a possible implementation manner, the folding screen terminal displays the application interface in full screen (including horizontal screen and vertical screen) in the unfolded state, while in the hovering state, the folding screen terminal only uses the first screen area or the second screen area. The screen area displays the application interface, and there are differences between the two display methods, and the display ratio of the application interface is also different. Therefore, it is necessary to process the application interface so that it can adapt to the display requirements in the hovering state. The specific steps are as follows:

1. Obtain the application interface in the horizontal screen state.

Second, based on the size of the second screen area, the application interface in the horizontal screen state is adapted to obtain an adapted application interface.

In a possible implementation, before adapting the application interface in the hovering state, the folding screen terminal obtains the size of the application interface when it is displayed in full screen (including horizontal screen and vertical screen), and then the application interface Perform adaptation, that is, scale the application interface proportionally according to the size of the second screen area to obtain an application interface adapted to be displayed in the second screen area in the hovering state, and then adjust the adapted application interface in the second screen area The application interface is displayed.

In some embodiments, when adapting the application interface, the second screen area of the folding screen terminal will display an adaptation prompt, which is used to prompt the user to switch the folding screen terminal from the expanded state to the hovering state, and the application interface is adapting. sexual adjustment.

Third, the adapted application interface is displayed in the second screen area.

In a possible implementation manner, in the hovering state, the adapted application interface is displayed on the second screen area, and the first screen area stops displaying the application interface, and the folding screen terminal can control the first screen area to be in a screen-off state or The first screen area is controlled to display a target interface (an application interface different from an application). Wherein, controlling the first screen area to be in a screen-off state can reduce the power consumption of the folding screen terminal.

Optionally, the target interface displayed in the first screen area may include an interface with a preset pattern or a solid color interface, which is not limited in this embodiment of the present application.

Schematically, as shown in Figure 15, when the user folds the folding screen terminal in the vertical screen unfolded state so that it is in the hovering state, the folding screen terminal obtains the display size of the application in the horizontal screen state, and then based on the second screen The size of the area 1502 scales the application interface in the landscape state, so that the application interface in the landscape state adapts to the area size of the second screen area 1502. When the adaptation is performed, the second screen area 1502 will display a prompt screen , indicating that the user terminal is adapting the hover mode to the application interface of the application. After the adaptation of the application interface is completed, the second screen area 1502 will display the adapted application interface, while the first screen area 1501 is in a screen-off state.

Please refer to FIG. 16 , which shows a structural block diagram of an application control device provided by an embodiment of the present application. The device is used in a folding screen terminal. The folding screen of the folding screen terminal includes a first screen area and a second screen area. The device includes:

The display module 1601 is configured to display the application interface of the application in the second screen area in the hovering state, and in the hovering state, the angle between the first screen area and the second screen area is smaller than the first screen area An included angle threshold value greater than a second included angle threshold value;

The control module 1602 is configured to control the application based on the touch operation in the case of receiving the touch operation on the first screen area.

Optionally, the control module 1602 is configured to:

When a touch operation on the first screen area is received and the touch operation is located outside the false touch prevention area, the application is controlled based on the touch operation, and the false touch prevention area is located in the false touch prevention area. edge area of the first screen area.

Optionally, the device also includes:

The shielding module is configured to shield the touch operation when the touch operation on the first screen is received and the touch operation is located in the false touch prevention area.

Optionally, the control module 1602 is also used for:

When a touch operation on the first screen area is received and the touch operation is located outside the false touch prevention area, determine a target operation type corresponding to the operation area on which the touch operation is applied, and The target operation type mentioned above is the operation type that supports the response in the operation area;

When the operation type of the touch operation belongs to the target operation type, the application is controlled based on the touch operation.

Optionally, the device also includes:

A shielding module, configured to shield the touch operation when the operation type of the touch operation does not belong to the target operation type.

Optionally, the control module 1602 is also used for:

When a touch operation on the first screen area is received, and the touch operation is located outside the false touch prevention area and the event shielding area, control the application based on the touch operation, the The event shielding area corresponds to the display area of the controls in the second screen area.

Optionally, the device includes:

A full-screen display module, configured to display the application interface of the application in the first screen area and the second screen area in the expanded state, and in the expanded state, the first screen area and the second screen area The included angle of the screen area is greater than the first included angle threshold;

The display module 1601 is also used for:

When switching from the expanded state to the hovering state, display the application interface of the application in the second screen area, and control the first screen area to stop displaying the application interface of the application.

Optionally, the folding screen terminal further includes an auxiliary display screen, and the auxiliary display screen is independent of the folding screen;

The device also includes:

The folding display module is configured to display the application interface of the application on the auxiliary display screen in the folded state, the auxiliary display screen is exposed in the folded state, and the first screen area and the second screen area The included angle is smaller than the second included angle threshold;

The display module 1601 is also used for:

In the case of switching from the folded state to the hovering state, the application interface of the application is displayed in the second screen area, and the auxiliary display screen is controlled to stop displaying the application interface of the application.

Optionally, the control module 1602 includes:

a generating unit, configured to generate a first touch event based on the touch operation;

a conversion unit, configured to convert the first touch event into a second touch event based on the mapping relationship between the first screen area and the second screen area;

A control unit, configured to control the application based on the second touch event.

Optionally, the first touch event includes touch coordinates of the touch operation;

The conversion unit is used for:

Based on the mapping relationship between the first screen area and the second screen area, perform coordinate conversion on the touch coordinates in the first touch event, and determine the second touch coordinates according to the converted touch coordinates. A touch event, wherein the converted touch coordinates are located in the second screen area.

Optionally, the first screen area has a touch mapping mode, and in the touch mapping mode, touch operations on the first screen area are mapped to the second screen area, so as to realize The touch operation of the screen area controls the application; the device also includes:

A setting module, configured to set the touch mapping mode of the first screen area to an active state in the hovering state.

Optionally, the device also includes:

The first switching module is configured to switch the touch mapping mode from an active state to a dormant state if the touch operation on the first screen area is not received within a preset time period.

Optionally, the device also includes:

The second switching module is configured to switch the touch mapping mode from a dormant state to an active state when an activation operation on the first screen area is received.

Optionally, the display module 1601 is configured to:

Obtain the application interface in the horizontal screen state;

Adapting the application interface in the horizontal screen state based on the size of the second screen area to obtain the adapted application interface;

The adapted application interface is displayed in the second screen area.

Optionally, in the hovering state, the first screen area is in a screen-off state; or, a target interface is displayed, and the target interface is different from the application interface.

Optionally, the first screen area is a screen area in a flat posture in the hovering state, and the second screen area is a screen area in a vertical screen posture in the hovering state.

Optionally, the display module 1601 is also used for:

When the first screen area is switched to a vertical screen posture, and the second screen area is switched to a flat posture, displaying the application interface of the application on the first screen area;

The control module 1602 is further configured to, in the case of receiving a touch operation on the second screen area, control the application based on the touch operation.

Optionally, the application is a multimedia application;

The control module 1602 includes:

A first control unit, configured to control the multimedia playing progress of the multimedia application based on the sliding direction and the sliding distance of the horizontal sliding operation when receiving a horizontal sliding operation on the first screen area; or,

The second control unit is configured to control the multimedia playing parameters of the multimedia application based on the sliding direction and the sliding distance of the vertical sliding operation in the case of receiving a vertical sliding operation on the first screen area, the multimedia The playback parameters include at least one of playback volume or display brightness; or,

A third control unit, configured to, in the case of receiving a click operation on the first screen area, control a multimedia state based on the click operation, where the multimedia state includes a play state and a pause state; or,

The fourth control unit is configured to, in the case of receiving a long press operation on the first screen area, control the multimedia playback speed based on the long press operation.

To sum up, in the embodiment of the present application, when the folding screen terminal is in the hovering state, the application interface of the terminal control application is only displayed in the second screen area, and receives touch operations acting on the first screen area, so that based on The touch operation controls the applications displayed in the second screen area. By adopting the solution provided by the embodiment of the present application, the user can realize application control without performing touch operations on the screen area where the application interface is displayed, which improves the flexibility of application control; and, compared with directly performing touch operations on the second screen area Touch operation in the first screen area helps to improve the stability of the folding screen terminal in the hovering state, and reduces the probability of the folding screen terminal tipping over during the touch process.

The embodiment of the present application also provides a computer-readable medium, the computer-readable medium stores at least one instruction, and the at least one instruction is loaded and executed by a processor to implement the application control method described in each of the above embodiments.

An embodiment of the present application provides a computer program product or computer program, where the computer program product or computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the application control method provided by the above aspect.

Those skilled in the art should be aware that, in the foregoing one or more examples, the functions described in the embodiments of the present application may be implemented by hardware, software, firmware or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.

The above are only optional embodiments of the application, and are not intended to limit the application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the application shall be included in the protection of the application. within range.

Claims (22)

An application control method, the method is used in a folding screen terminal, the folding screen of the folding screen terminal includes a first screen area and a second screen area, the method includes: In the hovering state, an application interface of the application is displayed in the second screen area, and in the hovering state, the angle between the first screen area and the second screen area is less than a first angle threshold and greater than The second included angle threshold; If a touch operation on the first screen area is received, the application is controlled based on the touch operation. The method according to claim 1, wherein in the case of receiving a touch operation on the first screen area, controlling the application based on the touch operation comprises: When a touch operation on the first screen area is received and the touch operation is located outside the false touch prevention area, the application is controlled based on the touch operation, and the false touch prevention area is located in the false touch prevention area. edge area of the first screen area. The method according to claim 2, wherein the method further comprises: When a touch operation on the first screen is received and the touch operation is located in the false touch prevention area, the touch operation is shielded. The method according to claim 2, wherein when the touch operation on the first screen area is received and the touch operation is outside the false touch prevention area, based on the touch operation Control said applications, including: When a touch operation on the first screen area is received and the touch operation is located outside the false touch prevention area, determine a target operation type corresponding to the operation area on which the touch operation is applied, and The target operation type mentioned above is the operation type that supports the response in the operation area; When the operation type of the touch operation belongs to the target operation type, the application is controlled based on the touch operation. The method according to claim 4, wherein the method further comprises: If the operation type of the touch operation does not belong to the target operation type, shield the touch operation. The method according to claim 2, wherein when the touch operation on the first screen area is received and the touch operation is outside the false touch prevention area, based on the touch operation Control said applications, including: When a touch operation on the first screen area is received, and the touch operation is located outside the false touch prevention area and the event shielding area, control the application based on the touch operation, the The event shielding area corresponds to the display area of the controls in the second screen area. The method according to any one of claims 1 to 6, wherein the method comprises: In the expanded state, the application interface of the application is displayed on the first screen area and the second screen area, and in the expanded state, the included angle between the first screen area and the second screen area is greater than the specified The first included angle threshold; In the hovering state, the application interface of the application is displayed in the second screen area, including: When switching from the expanded state to the hovering state, display the application interface of the application in the second screen area, and control the first screen area to stop displaying the application interface of the application. The method according to any one of claims 1 to 6, wherein the folding screen terminal further includes an auxiliary display screen, and the auxiliary display screen is independent of the folding screen; The methods include: In the folded state, the application interface of the application is displayed on the auxiliary display screen, in the folded state, the auxiliary display screen is exposed, and the included angle between the first screen area and the second screen is smaller than the first screen area. Two angle thresholds; In the hovering state, the application interface of the application is displayed in the second screen area, including: In the case of switching from the folded state to the hovering state, the application interface of the application is displayed in the second screen area, and the auxiliary display screen is controlled to stop displaying the application interface of the application. The method according to any one of claims 1 to 6, wherein the controlling the application based on the touch operation comprises: generating a first touch event based on the touch operation; converting the first touch event into a second touch event based on a mapping relationship between the first screen area and the second screen area; The application is controlled based on the second touch event. The method according to claim 9, wherein the first touch event includes touch coordinates of the touch operation; The converting the first touch event into a second touch event based on the mapping relationship between the first screen area and the second screen area includes: Based on the mapping relationship between the first screen area and the second screen area, perform coordinate conversion on the touch coordinates in the first touch event, and determine the second touch coordinates according to the converted touch coordinates. A touch event, wherein the converted touch coordinates are located in the second screen area. The method according to any one of claims 1 to 6, wherein the first screen area has a touch mapping mode, and in the touch mapping mode, touch operations on the first screen area are mapped to the second Two screen areas, so as to control the application based on the touch operation of the first screen area; the method further includes: In the hovering state, the touch mapping mode of the first screen area is set to an active state. The method according to claim 11, wherein, after setting the touch mapping mode of the first screen area to an active state, the method further comprises: If no touch operation on the first screen area is received within a preset time period, the touch mapping mode is switched from an active state to a dormant state. The method according to claim 12, wherein, after switching the touch mapping mode from the active state to the dormant state, the method further comprises: Switching the touch mapping mode from a dormant state to an active state when an activation operation on the first screen area is received. The method according to any one of claims 1 to 6, wherein the displaying the application interface of the application in the second screen area comprises: Obtain the application interface in the horizontal screen state; Adapting the application interface in the horizontal screen state based on the size of the second screen area to obtain the adapted application interface; The adapted application interface is displayed in the second screen area. The method according to any one of claims 1 to 6, wherein, in the hovering state, the first screen area is in a screen-off state; or, a target interface is displayed, and the target interface is different from the application interface. The method according to any one of claims 1 to 6, wherein the first screen area is a screen area in a flat posture in the hovering state, and the second screen area is a screen area in the hovering state The area of the screen in portrait orientation. The method according to claim 16, wherein the method further comprises: When the first screen area is switched to a vertical screen posture, and the second screen area is switched to a flat posture, displaying the application interface of the application on the first screen area; If a touch operation on the second screen area is received, the application is controlled based on the touch operation. The method according to any one of claims 1 to 6, wherein the application is a multimedia application; In the case of receiving a touch operation on the first screen area, controlling the application based on the touch operation includes: In the case of receiving a horizontal sliding operation on the first screen area, controlling the multimedia playback progress of the multimedia application based on the sliding direction and sliding distance of the horizontal sliding operation; or, In the case of receiving a vertical sliding operation on the first screen area, control the multimedia playing parameters of the multimedia application based on the sliding direction and sliding distance of the vertical sliding operation, the multimedia playing parameters include playing volume or display at least one of brightness; or, In the case of receiving a click operation on the first screen area, controlling a multimedia state based on the click operation, the multimedia state includes a play state and a pause state; or, In a case where a long press operation on the first screen area is received, the multimedia playback speed is controlled based on the long press operation. An application control device, the device is used in a folding screen terminal, the folding screen of the folding screen terminal includes a first screen area and a second screen area, and the device includes: a display module, configured to display an application interface of an application in the second screen area in a hovering state, and in the hovering state, the included angle between the first screen area and the second screen area is smaller than the first The included angle threshold is greater than the second included angle threshold; A control module, configured to control the application based on the touch operation in the case of receiving the touch operation on the first screen area. A terminal, the terminal comprising a processor and a memory; the memory stores at least one instruction, and the at least one instruction is used to be executed by the processor to implement the application control according to any one of claims 1 to 18 method. A computer-readable storage medium, the storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the application control method according to any one of claims 1 to 18. A computer program product, the computer program product comprising computer instructions stored in a computer-readable storage medium; a processor of a computer device reading the computer instructions from the computer-readable storage medium, the processor Executing the computer instructions enables the computer device to implement the application control method according to any one of claims 1 to 18.

Images