CN107707953B - A resource data display method and mobile terminal - Google Patents

Abstract

The present invention provides a resource data display method and a mobile terminal. The method is applied to a mobile terminal, and includes: if a display operation of a suspension container is detected while playing video data through a display interface of the mobile terminal, displaying the suspension container in the display interface; wherein, the display position of the suspension container is adjustable; The image currently displayed in the target area is displayed in the display interface; wherein, the target area is the area surrounded by the edge of the floating container in the display interface; if the first predetermined operation on the floating container is detected, the browser is called to search and display the image in the floating container Associated resource data; display the searched resource data in the display interface. The present invention can conveniently and quickly realize the search and display of the associated information.

Description

A resource data display method and mobile terminal

technical field

The present invention relates to the field of communication technologies, and in particular, to a resource data display method and a mobile terminal.

Background technique

At present, the popularity of mobile terminals is getting higher and higher, and their display screens are getting bigger and bigger. Compared with traditional TVs or computers, they are lighter and more convenient to carry. Therefore, more and more people are accustomed to using mobile terminals to watch videos. data.

In the process of viewing video data using a mobile terminal, a user may have certain requirements, such as a requirement to know in detail a certain object (for example, a certain character) in a video picture corresponding to the video data. Generally, the mobile terminal needs to interrupt the playing video data and start the browser first. Next, the mobile terminal needs to obtain the information related to the character entered by the user in the search box of the browser (for example, the name of the character played by the character or the real name of the character), and then the mobile terminal can search for the relevant information of the character , and display the search results to the user. It is easy to see that, in the process of playing the video data, the mobile terminal needs to realize the search and display of the associated information, which has the problem of complicated operation.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a resource data display method, a mobile terminal, and a computer-readable storage medium, so as to solve the problem of cumbersome operations in searching and displaying associated information in the process of playing video data by a mobile terminal.

In order to solve the above-mentioned technical problems, the present invention is achieved in this way:

In a first aspect, an embodiment of the present invention provides a resource data display method, which is applied to a mobile terminal, and the method includes:

If a display operation of the floating container is detected while the video data is played through the display interface of the mobile terminal, the floating container is displayed on the display interface; wherein the display position of the floating container is adjustable;

Displaying the image currently displayed in the target area in the floating container; wherein, the target area is an area surrounded by the edge of the floating container in the display interface;

If a first predetermined operation on the suspension container is detected, call a browser to search for resource data associated with the image displayed in the suspension container;

The searched resource data is displayed in the display interface.

In a second aspect, an embodiment of the present invention provides a mobile terminal, including:

The first display module is used to display the floating container in the display interface if the display instruction of the floating container is detected while playing the video data through the display interface of the mobile terminal; wherein the display position of the floating container is adjustable ;

The second display module is used to display the image currently displayed in the target area in the floating container; wherein, the target area is the area surrounded by the edge of the floating container in the display interface;

a search module, configured to call a browser to search for resource data associated with an image displayed in the floating container if a first predetermined operation on the floating container is detected;

The first display module is used for displaying the searched resource data in the display interface.

In a third aspect, an embodiment of the present invention provides a mobile terminal, including a processor, a memory, and a computer program stored in the memory and executable on the processor, when the computer program is executed by the processor The steps of implementing the above resource data display method.

In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above resource data display method are implemented.

In this solution, during the process of playing the video data on the mobile terminal through the display interface, if the user needs to know in detail about an object in the video screen corresponding to the video data, such as a certain character, the user can input the floating container to the mobile terminal to display the instruction. In this way, the mobile terminal displays the suspension container in the display interface according to the suspension container display instruction. Next, the user drags the position-adjustable floating container to an area where the edge of the mobile terminal can enclose the object that the user wants to know. Then, the image of the object that the user wants to know is displayed in the floating container. Afterwards, the user may input a first predetermined operation on the floating container to the mobile terminal, so as to trigger the mobile terminal to invoke the browser to search for resource data associated with the image displayed in the floating container. After the mobile terminal searches and obtains resource data associated with the object the user wants to know, it will display the resource data on the display interface.

It can be seen that in this solution, in the process of playing the video data on the mobile terminal, the user only needs to input the floating container display instruction to the mobile terminal, and when the image of the object the user wants to know is displayed in the floating container, send the mobile terminal to the mobile terminal. By inputting the first predetermined operation on the suspension container, the mobile terminal can automatically realize the search and display of the associated information according to the image displayed in the suspension container. Therefore, compared with the prior art, the embodiments of the present invention can more conveniently and quickly realize the search and display of the associated information.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments of the present invention. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

1 is a first flow chart of a method for displaying resource data provided by an embodiment of the present invention;

Fig. 2 is the first page schematic diagram of the display interface of the mobile terminal;

3 is a second flow chart of a method for displaying resource data provided by an embodiment of the present invention;

Fig. 4 is the second kind of page schematic diagram of the display interface of the mobile terminal;

Fig. 5 is the third page schematic diagram of the display interface of the mobile terminal;

6 is a first structural schematic diagram of a mobile terminal provided by an embodiment of the present invention;

7 is a schematic diagram of a second structure of a mobile terminal according to an embodiment of the present invention;

8 is a third schematic structural diagram of a mobile terminal provided by an embodiment of the present invention;

9 is a fourth schematic structural diagram of a mobile terminal provided by an embodiment of the present invention;

FIG. 10 is a fifth schematic structural diagram of a mobile terminal provided by an embodiment of the present invention;

11 is a sixth schematic structural diagram of a mobile terminal according to an embodiment of the present invention;

FIG. 12 is a seventh schematic structural diagram of a mobile terminal according to an embodiment of the present invention;

13 is a schematic diagram of an eighth structure of a mobile terminal according to an embodiment of the present invention;

FIG. 14 is a schematic diagram of a hardware structure of another mobile terminal provided by an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

The following first describes the resource data display method provided by the embodiment of the present invention.

It should be noted that the resource data display method provided in the embodiment of the present invention is applied to a mobile terminal. Specifically, the mobile terminal may be any device with a communication function, such as a mobile phone, a tablet computer (Tablet PersonalComputer), a laptop computer (Laptop Computer), a personal digital assistant (PDA for short), a mobile Internet access electronic device (Mobile Internet Device, MID), wearable device (Wearable Device), etc.

Referring to FIG. 1 , the figure shows a first flow chart of a method for displaying resource data provided by an embodiment of the present invention. As shown in Figure 1, the method is applied to a mobile terminal, and the method includes the following steps:

Step 101 , if a display instruction of the floating container is detected while the video data is played through the display interface of the mobile terminal, the floating container is displayed on the display interface; wherein the display position of the floating container is adjustable.

The suspension container may be a 3D bubble or a suspension window (for example, a rectangular suspension window in which an avatar of a certain person is surrounded by an edge in FIG. 2 ).

For the mobile terminal, while playing the video data through the display interface, it can detect whether the user inputs the display instruction of the floating container periodically or irregularly. There are various specific implementation forms for the user to input the floating container display instruction to the mobile terminal, and one of the implementation forms is described below with an example.

Specifically, a floating container display button may be added to the slide-up control panel of the mobile terminal. In the process of viewing video data using a mobile terminal, if the user needs to know in detail an object in the video screen corresponding to the video data (the object can be a person, animal or plant, etc.), the user can perform the above operation on the display interface. Swipe operation.

In this way, after the mobile terminal detects the slide-up operation, the mobile terminal displays the slide-up control panel in the display interface. Next, the user can click the display button of the floating container in the slide-up control panel to input the display instruction of the floating container to the mobile terminal. Afterwards, the mobile terminal displays the floating container in the display interface according to the display instruction of the floating container; wherein, the floating container can be displayed in the middle area, the edge area or any other area of the display interface.

Since the display position of the suspension container is adjustable, when the suspension container is displayed on the display interface, the suspension container can be dragged to any position in the display interface according to actual requirements.

Step 102: Display the image currently displayed in the target area in the floating container; wherein, the target area is an area surrounded by the edge of the floating container in the display interface.

Specifically, the mobile terminal may display the image currently displayed in the target area in the floating container under the condition that the preset container image display conditions are satisfied. It should be noted that, there may be various preset container image display conditions, which are described below with examples.

In one case, the preset container image display condition is that the display position of the suspended container does not change within a set time period (eg, 5 seconds, 8 seconds, or 10 seconds). Assuming that the user wants to know the relevant information about the characters appearing in the video screen shown in FIG. 2, such as so-and-so, then, after the mobile terminal displays the floating container on the display interface, the user can quickly drag the floating container to the display in FIG. 2. The indicated position (that is, the position where the edge of the floating container can enclose the avatar of so-and-so). After that, the user does not change the display position of the floating container within the set time period. Since the display position of the floating container is always maintained at the position shown in FIG. 2 within the set period of time, the mobile terminal will determine that the preset container image display conditions are satisfied, and at this time, the mobile terminal will display the target area in the floating container ( That is, the image of the area enclosed by the edge of the floating container).

In another case, there is a selection button in the floating container, and the preset container image display condition is that the selection button is clicked. Assuming that the user wants to know the relevant information about the characters appearing in the video screen shown in FIG. 2 , such as so-and-so, then, after the mobile terminal displays the floating container in the display interface, the user can drag the floating container to the image in FIG. 2 . After the indicated position (that is, the position where the edge of the floating container can enclose the avatar of so-and-so), click the selection button. Since the selection button is clicked, the mobile terminal will determine that the preset container image display conditions are satisfied. At this time, the mobile terminal displays the image of the target area (ie, the area surrounded by the edge of the floating container) in the floating container.

It can be seen that in both cases, the images displayed in the floating container include the avatar of so-and-so, that is, the images displayed in the floating container include images of objects that the user wants to know in detail.

Step 103 , if the first predetermined operation on the suspension container is detected, a browser is invoked to search for resource data associated with the image displayed in the suspension container.

The first predetermined operation may be an operation for triggering the mobile terminal to perform a search. Specifically, the first predetermined operation may be a long-press operation, or a long-press operation+drag operation, or the like.

For the mobile terminal, after displaying the image currently displayed in the target area in the floating container, it may detect whether the user inputs the first predetermined operation on the floating container periodically or irregularly. If the first predetermined operation on the floating container is detected, the mobile terminal invokes the browser to search for resource data associated with the images displayed in the floating container. During the search process, the floating container may be in a fluctuating state to inform the user that the search is in progress. Assuming that the image displayed in the floating container is the avatar of so-and-so, the resource data associated with the image can specifically be the personal introduction of so-and-so, the personal work of so-and-so, etc. The type of the resource data can be text type, picture Types, etc., will not be repeated here.

Step 104, displaying the searched resource data on the display interface.

It should be noted that there are various specific implementation forms for the mobile terminal to display the searched resource data on the display interface. For the sake of clear layout, examples will be introduced later.

In this solution, during the process of playing the video data on the mobile terminal through the display interface, if the user needs to know in detail about an object in the video screen corresponding to the video data, such as a certain character, the user can input the floating container to the mobile terminal to display the instruction. In this way, the mobile terminal displays the suspension container in the display interface according to the suspension container display instruction. Next, the user drags the position-adjustable floating container to an area where the edge of the mobile terminal can enclose the object that the user wants to know. Then, the image of the object that the user wants to know is displayed in the floating container. Afterwards, the user may input a first predetermined operation on the floating container to the mobile terminal, so as to trigger the mobile terminal to invoke the browser to search for resource data associated with the image displayed in the floating container. After the mobile terminal searches and obtains resource data associated with the object the user wants to know, it will display the resource data on the display interface.

It can be seen that in this solution, in the process of playing the video data on the mobile terminal, the user only needs to input the floating container display instruction to the mobile terminal, and when the image of the object the user wants to know is displayed in the floating container, send the mobile terminal to the mobile terminal. By inputting the first predetermined operation on the suspension container, the mobile terminal can automatically realize the search and display of the associated information according to the image displayed in the suspension container. Therefore, compared with the prior art, the embodiments of the present invention can more conveniently and quickly realize the search and display of the associated information.

Optionally, step 103, that is, if the first predetermined operation on the suspension container is detected, calling a browser to search for resource data associated with the image displayed in the suspension container, including:

If a first predetermined operation on the suspension container is detected, the target type of the resource data to be searched is determined according to the operation information of the first predetermined operation; wherein the operation information of the first predetermined operation includes the type and/or input of the first predetermined operation The fingerprint information of the finger of the first predetermined operation.

It should be noted that the corresponding relationship between the operation information of the first predetermined operation and the type of resource data may be pre-stored in the mobile terminal. In this way, after detecting the first predetermined operation on the floating container, the mobile terminal can identify the operation information of the first predetermined operation, and then, based on the pre-stored correspondence, the mobile terminal can determine the resource data corresponding to the identified operation information type, which is the target type of the resource data to be searched.

Invoke the browser to search for resource data associated with the image displayed in the floating container, where the resource data type is the target type.

The specific implementation process of this embodiment is described below with two specific examples.

In the first example, it is assumed that the operation information of the first predetermined operation includes the type of the first predetermined operation. There are two types of the first predetermined operation, the first type is a long-press operation, the second type is a long-press operation + drag operation, and the resource data corresponding to the first type pre-stored by the mobile terminal The type is a text type, and the type of resource data corresponding to the second type pre-stored and stored by the mobile terminal is a picture type.

After the mobile terminal detects the first predetermined operation on the floating container, the mobile terminal identifies the type of the first predetermined operation. Assuming that the type identified by the mobile terminal is a drag operation, the mobile terminal can determine that the target type of the resource data to be searched is a text type. After that, when invoking the browser to search for resource data associated with the image displayed in the floating container, the mobile terminal only searches for resource data of text type.

In the second example, it is assumed that the operation information of the first predetermined operation includes the fingerprint information of the finger inputting the first predetermined operation, then, the fingerprint information and resource data of ten fingers of the user to which the mobile terminal belongs can be pre-stored in the mobile terminal The correspondence between the types. The type of resource data corresponding to the fingerprint information of the user's right thumb may be a text type, and the type of resource data corresponding to the fingerprint information of the user's right index finger may be a picture type.

After the mobile terminal detects the first predetermined operation on the floating container, the mobile terminal identifies the fingerprint information of the finger that inputs the first predetermined operation. Assuming that the mobile terminal identifies that the fingerprint information is the fingerprint information of the user's right thumb, the mobile terminal can determine that the target type of the resource data to be searched is a text type. After that, when invoking the browser to search for resource data associated with the image displayed in the floating container, the mobile terminal only searches for resource data of text type.

It should be noted that the operation information of the first predetermined operation is not limited to the type of the first predetermined operation and/or the fingerprint information of the finger inputting the first predetermined operation, and the operation information may also be a pressing value based on 3Dtouch, that is, different It is also feasible that the range of the pressing value of the corresponding to different types of resource data.

It can be seen that, in this embodiment, if the user wants the mobile terminal to only search for a specific type of resource data when performing step 103, the user can perform a first predetermined operation with specific operation information. In this way, the mobile terminal will only search for and display the resource data of the type desired by the user in the future, which can bring a better use experience to the user.

Referring to FIG. 3 , the figure shows a second flow chart of the resource data display method provided by the embodiment of the present invention. As shown in Figure 3, the method is applied to a mobile terminal, and the method includes the following steps:

Step 301 , if a display instruction of the floating container is detected while playing the video data through the display interface of the mobile terminal, the floating container is displayed in the display interface; wherein the display position of the floating container is adjustable.

Step 302: Display the image currently displayed in the target area in the floating container; wherein, the target area is an area surrounded by the edge of the floating container in the display interface.

Step 303 , if the first predetermined operation on the suspension container is detected, the browser is invoked to search for resource data associated with the image displayed in the suspension container.

The specific implementation process of steps 301 to 303 may refer to the description of steps 101 to 103 in the embodiment shown in FIG. 1 , which will not be repeated here.

Step 304: Display the searched resource data in the display interface in a target display manner; wherein, the target display manner is a display manner corresponding to the resource data.

In a specific implementation of the embodiment of the present invention, the searched resource data is displayed on the display interface in a target display manner, including:

If the type of the searched resource data is a text type, while playing the video data through the display interface, the resource data is displayed on the display interface as a bullet screen.

Specifically, as shown in FIG. 4 , the resource data as a bullet screen can be displayed at the top of the display interface, and of course, the resource data can also be displayed at the bottom of the display interface or other positions.

If the type of the searched resource data is a picture type, control the display interface to perform screen splitting, so that the display interface enters a split screen state; wherein, the display interface in the split screen state includes a first display window and a second display window, and the first display interface is in the split screen state. The display window is used to play video data;

The resource data is loaded into the second display window for display.

Wherein, when controlling the display interface of the mobile terminal to perform screen splitting so that the display interface is in a split screen state, the mobile terminal can split the screen along the up and down directions. Of course, as shown in FIG. 5 , the mobile terminal can also split the screen along the left and right directions. Screen. In addition, the area of the first display window and the second display window generated after the display interface is divided into a screen may be the same or different.

It should be noted that the mobile terminal may pre-store the correspondence between the types of resource data and the presentation manner. The types of resource data may include text types and image types, the display method corresponding to the text type may be a bullet screen display, and the display method corresponding to the image type may be a split-screen display.

In this embodiment, after performing step 303 to search for resource data associated with the image displayed in the floating container, the mobile terminal can identify the type of the resource data.

Assuming that the type of the resource data identified by the mobile terminal is a text type, the mobile terminal can determine that the display method corresponding to the resource data is a bullet screen display. Therefore, the mobile terminal will play the video data through the display interface while displaying the The resource data is displayed in the display interface as a bullet screen. It can be seen that this display method can clearly and intuitively display the searched resource data to the user, and at the same time, the display of the resource data can avoid blocking the video image corresponding to the video data as much as possible.

Assuming that the type of the resource data identified by the mobile terminal is a picture type, the mobile terminal can determine that the display mode corresponding to the resource data is split-screen display. Therefore, the mobile terminal will control the display interface to split-screen to generate two Display window, in this way, the mobile terminal can display the resource data through another display window while playing video data through one display window. It can be seen that this display form can also clearly and intuitively display the searched resource data to the user, and at the same time avoid the display of the resource data from obscuring the video image corresponding to the video data.

Optionally, after displaying the resource data in the display interface as a bullet screen, the method further includes:

If the resource data includes a link address, and a second predetermined operation to the link address is detected, it is determined whether the display interface is in a split-screen state.

If the judgment result is yes, load the page corresponding to the link address to the second display window for display;

If the judgment result is no, the display interface is controlled to perform screen splitting, and the page corresponding to the link address is loaded into the second display window obtained after the split screen is displayed for display.

The second predetermined operation may be a click operation.

It can be understood that, after calling the browser to search for resource data associated with the image displayed in the floating container, if the type of the resource data obtained by the search is a text type, then there may be a link address in the resource data of the text type. If the user wants to know the specific content in the page corresponding to the link address, the user can input a second predetermined operation for the link address. After detecting the second predetermined operation, the mobile terminal determines whether the display interface is in a split screen state.

If the display interface is currently in a split-screen state, the mobile terminal can directly load the page corresponding to the link address to the second display window for display. After that, the user can know the specific content of the page corresponding to the link address through the second display window.

If the display interface is not currently in a split screen state, the mobile terminal can control the display interface to split the screen, and after the display interface is split, the page corresponding to the link address is loaded into the second display window obtained after the split screen is displayed for display. After that, the user can know the specific content of the page corresponding to the link address through the second display window.

It can be seen that, in this embodiment, when a link address is included in the resource data, if the user wishes to know the specific content of the page corresponding to the link address, the mobile terminal can display the specific content through the second display window. Bring a better user experience to users.

Optionally, after displaying the image currently displayed in the target area in the floating container, if the first predetermined operation on the floating container is detected, before calling the browser to search for resource data associated with the image displayed in the floating container, the method further includes: :

Determine whether the floating container is located in the target corner area in each corner area of the display interface; wherein, the distance from any point in the corner area to the two sides of the display interface is not greater than the preset distance, and the image displayed in the target corner area does not include the predetermined distance. set image;

If the judgment result is no, and the target corner area currently exists, move the floating container to the target corner area for display.

The preset distance threshold may be 1 cm, 2 cm, 3 cm or other values. Optionally, the preset image includes a plant image, an animal image and a person image, that is, the preset image is a biological image.

It can be understood that the number of corner areas in the display interface is generally four, and the four corner areas are respectively located at four corners of the display interface. Since the images displayed in the target corner area do not include preset images (ie, human images, animal images, and plant images), it can be considered that no important content is displayed in the target corner area.

In this embodiment, after displaying the image currently displayed in the target area in the floating container, the mobile terminal determines whether the floating container is located in the target corner area.

If the mobile terminal is currently located in the target corner area, although a floating container is displayed on the display interface, the image displayed in the floating container will only block some unimportant content in the video picture corresponding to the video data, and the video picture The more important content in the video can be better presented, so as to bring a better video viewing experience to the user.

If the mobile terminal is not currently located in the target corner area, the mobile terminal may determine whether the display interface is currently in the target corner area. If there is currently a target corner area, the mobile terminal can automatically move the floating container to the target corner area for display. In this way, the more important content in the video picture corresponding to the video data can be better presented, so as to bring better benefits to the user. video viewing experience. If the target corner area does not currently exist, the mobile terminal cannot automatically move the floating container. In this case, the user can manually operate to drag the floating container to a position that does not affect video viewing as much as possible.

It can be seen that, in this embodiment, the suspension container can avoid blocking important content in the video image as much as possible, thereby bringing a better video viewing experience to the user.

Optionally, before displaying the image currently displayed in the target area in the floating container, the method further includes:

If an adjustment instruction for the size of the suspension container is detected, the size of the suspension container is adjusted according to the adjustment instruction.

It can be understood that the size difference of each object in the video picture corresponding to the video data may be relatively large. Therefore, when the mobile terminal displays the floating container in the display interface, and the floating container is dragged to the area where the edge of the floating container can enclose the object that the user wants to know, the mobile terminal can pull the border of the floating container up, down, left and right to adjust the size of the floating container. Therefore, on the premise of ensuring that the edge of the floating container can surround the objects that the user wants to know, the size of the floating container is made as small as possible, so as to minimize the occurrence of the objects that the user wants to know in the image displayed by the floating container. the possibility of remaining objects outside.

After adjusting the size of the floating container, the user can input a first predetermined operation on the floating container, so that the mobile terminal will call the browser to search for resource data associated with the images displayed in the floating container. Since the image displayed by the floating container is less likely to appear other objects than the object the user wants to know, when searching for resource data subsequently, the mobile terminal searches for the resource data irrelevant to the object the user wants to know. The possibility is greatly reduced, so that the resource consumption caused by the mobile terminal searching for irrelevant resource data can be avoided.

Optionally, after invoking the browser to search for resource data associated with the image displayed in the floating container, the method further includes:

After searching for the resource data, cancel the display of the floating container.

In this embodiment, after the resource data is searched, the mobile terminal cancels the display of the floating container, so as to avoid blocking the video image corresponding to the video data by the floating container as much as possible, thereby bringing a better video viewing experience to the user.

Optionally, after invoking the browser to search for resource data associated with the image displayed in the floating container, the method further includes:

During the searching process of the resource data, if a third predetermined operation on the suspension container is detected, the search for the resource data is cancelled, and the display of the suspension container is cancelled.

The third predetermined operation may be a preset operation for canceling the search for resource data.

In this embodiment, in the process of searching for resource data, if the user does not want to continue searching for the resource data due to some reasons (for example, the search time is too long), the user can input a third predetermined operation on the floating container. When the mobile terminal detects the third predetermined operation, the mobile terminal will cancel the search for the resource data according to the user's instruction; in addition, the mobile terminal will also cancel the display of the floating container, so as to avoid as much as possible the floating container corresponding to the video data. The video picture is blocked, thereby bringing a better video viewing experience to the user.

To sum up, compared with the prior art, this embodiment can more conveniently and quickly realize the search and display of the associated information.

Referring to FIG. 6, the figure shows a schematic structural diagram of a mobile terminal (mobile terminal 100) provided by an embodiment of the present invention. As shown in FIG. 6, the mobile terminal 100 includes:

The first display module 61 is used to display the floating container in the display interface if the display instruction of the floating container is detected while playing the video data through the display interface of the mobile terminal; wherein, the display position of the floating container is adjustable;

The second display module 62 is used to display the image currently displayed in the target area in the floating container; wherein, the target area is the area surrounded by the edge of the floating container in the display interface;

A search module 63, configured to call a browser to search for resource data associated with the image displayed in the floating container if the first predetermined operation on the floating container is detected;

The first display module 64 is configured to display the searched resource data in the display interface.

Optionally, on the basis of the embodiment shown in FIG. 6 , as shown in FIG. 7 , the search module 63 includes:

The determination sub-module 631 is configured to determine the target type of the resource data to be searched according to the operation information of the first predetermined operation if the first predetermined operation on the suspension container is detected; wherein, the operation information of the first predetermined operation includes the first predetermined operation The type of operation and/or the fingerprint information of the finger inputting the first predetermined operation;

The search sub-module 632 is used for invoking the browser to search for resource data associated with the image displayed in the floating container, where the type of the resource data is the target type.

Optionally, the first display module 64 is specifically used for:

The searched resource data is displayed on the display interface in a target display mode; wherein, the target display mode is a display mode corresponding to the resource data.

Optionally, on the basis of the embodiment shown in FIG. 6 , as shown in FIG. 8 , the first display module 64 includes:

The first display sub-module 641 is used to display the resource data as a bullet screen in the display interface while playing the video data through the display interface if the type of the resource data is found to be a text type;

The screen splitting sub-module 642 is used to control the display interface to perform screen splitting if the type of the searched resource data is a picture type, so that the display interface enters a split screen state; wherein, the display interface in the split screen state includes a first display window and a second display window, the first display window is used to play video data;

The second display sub-module 643 is configured to load the resource data into the second display window for display.

Optionally, based on the embodiment shown in FIG. 6 , as shown in FIG. 9 , the mobile terminal 100 further includes:

The first judging module 65 is used for, after displaying the resource data as a bullet screen in the display interface, if the resource data includes a link address and a second predetermined operation on the link address is detected, determine whether the display interface is In a split screen state; if the judgment result is yes, the second display module 66 is triggered, and if the judgment result is no, the third display module 67 is triggered;

The second display module 66 is configured to load the page corresponding to the link address into the second display window for display;

The third display module 67 is configured to control the display interface to perform screen splitting, and load the page corresponding to the link address to the second display window obtained after the split screen is displayed for display.

Optionally, on the basis of the embodiment shown in FIG. 6 , as shown in FIG. 10 , the mobile terminal 100 further includes:

The second judging module 71 is configured to display the image currently displayed in the target area in the floating container, and before calling the browser to search for resource data associated with the image displayed in the floating container if the first predetermined operation on the floating container is detected , judging whether the floating container is located in the target corner area in each corner area of the display interface; wherein, the distance from any point in the corner area to the two sides of the display interface is not greater than the preset distance, and the image displayed in the target corner area does not include preset image;

The third display module 72 is configured to move the floating container to the target corner area for display if the determination result of the second determination module 71 is no and the target corner area currently exists.

Optionally, the preset images include: plant images, animal images and person images.

Optionally, based on the embodiment shown in FIG. 6 , as shown in FIG. 11 , the mobile terminal 100 further includes:

The adjustment module 73 is configured to adjust the size of the suspension container according to the adjustment instruction if an adjustment instruction for the size of the suspension container is detected before the image currently displayed in the target area is displayed in the suspension container.

Optionally, on the basis of the embodiment shown in FIG. 6 , as shown in FIG. 12 , the mobile terminal 100 further includes:

The first canceling module 68 is configured to cancel the display of the floating container after the resource data associated with the image displayed in the floating container is searched after calling the browser, and after the resource data is searched.

Optionally, on the basis of the embodiment shown in FIG. 6 , as shown in FIG. 13 , the mobile terminal 100 further includes:

The second canceling module 69 is configured to cancel the search if a third predetermined operation on the floating container is detected during the search process of the resource data after calling the browser to search for the resource data associated with the image displayed in the floating container. the resource data, and cancel the display of the floating container.

It should be noted that the mobile terminal 100 provided in the embodiment of the present invention can implement each process implemented by the mobile terminal in the foregoing method embodiments, and to avoid repetition, details are not repeated here. It can be seen that in this solution, when the mobile terminal 100 plays the video data, the user only needs to input the floating container display instruction to the mobile terminal 100, and when the image of the object the user wants to know is displayed in the floating container, When the mobile terminal 100 inputs the first predetermined operation on the suspension container, the mobile terminal 100 can automatically search and display the associated information according to the image displayed in the suspension container. Therefore, compared with the prior art, the embodiments of the present invention can more conveniently and quickly realize the search and display of the associated information.

Referring to FIG. 14, the figure shows a schematic diagram of the hardware structure of a mobile terminal (ie, the mobile terminal 200) implementing various embodiments of the present invention. As shown in FIG. 14 , the mobile terminal 200 includes but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, The processor 610, the power supply 611 and other components. Those skilled in the art can understand that the structure of the mobile terminal shown in FIG. 14 does not constitute a limitation to the mobile terminal 200, and the mobile terminal 200 may include more or less components than the one shown, or combine some components, or different component layout. In this embodiment of the present invention, the mobile terminal 200 includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a handheld computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

The processor 610 is used for:

If the suspension container display instruction is detected while playing the video data through the display interface of the mobile terminal, the suspension container is displayed in the display interface; wherein, the display position of the suspension container is adjustable;

Display the image currently displayed in the target area in the floating container; wherein, the target area is the area surrounded by the edge of the floating container in the display interface;

If the first predetermined operation on the suspension container is detected, the browser is invoked to search for resource data associated with the image displayed in the suspension container;

Display the searched resource data in the display interface.

It can be seen that in this solution, when the mobile terminal 200 plays the video data, the user only needs to input the floating container display instruction to the mobile terminal 200, and when the image of the object the user wants to know is displayed in the floating container, When the mobile terminal 200 inputs the first predetermined operation on the floating container, the mobile terminal 200 can automatically search and display the associated information according to the image displayed in the floating container. Therefore, compared with the prior art, the embodiments of the present invention can more conveniently and quickly realize the search and display of the associated information.

Optionally, the processor 610 is specifically configured to:

If a first predetermined operation on the suspension container is detected, the target type of the resource data to be searched is determined according to the operation information of the first predetermined operation; wherein the operation information of the first predetermined operation includes the type and/or input of the first predetermined operation The fingerprint information of the finger of the first predetermined operation;

Invoke the browser to search for resource data associated with the image displayed in the floating container, where the resource data type is the target type.

Optionally, the processor 610 is specifically configured to:

The searched resource data is displayed on the display interface in a target display mode; wherein, the target display mode is a display mode corresponding to the resource data.

Optionally, the processor 610 is specifically configured to:

If the type of resource data found is text type, while playing the video data through the display interface, the resource data is displayed on the display interface as a bullet screen;

If the type of the searched resource data is a picture type, control the display interface to perform screen splitting, so that the display interface enters a split screen state; wherein, the display interface in the split screen state includes a first display window and a second display window, and the first display interface is in the split screen state. The display window is used to play video data;

The resource data is loaded into the second display window for display.

Optionally, the processor 610 is further configured to:

After the resource data is displayed on the display interface as a bullet screen, if the resource data includes a link address, and a second predetermined operation to the link address is detected, determine whether the display interface is in a split-screen state;

If the judgment result is yes, load the page corresponding to the link address to the second display window for display;

If the judgment result is no, the display interface is controlled to perform screen splitting, and the page corresponding to the link address is loaded into the second display window obtained after the split screen is displayed for display.

Optionally, the processor 610 is further configured to:

After displaying the image currently displayed in the target area in the floating container, and before calling the browser to search for resource data associated with the image displayed in the floating container if the first predetermined operation on the floating container is detected, determine whether the floating container is located on the display interface The target corner area in each corner area of the target corner area; wherein, the distance from any point in the corner area to the two sides of the display interface is not greater than the preset distance, and the image displayed in the target corner area does not include the preset image;

If the judgment result is no, and the target corner area currently exists, move the floating container to the target corner area for display.

Optionally, the preset images include: plant images, animal images and person images.

Optionally, the processor 610 is further configured to:

Before the image currently displayed in the target area is displayed in the suspension container, if an adjustment instruction for the size of the suspension container is detected, the size of the suspension container is adjusted according to the adjustment instruction.

Optionally, the processor 610 is further configured to:

After calling the browser to search for the resource data associated with the image displayed in the floating container, after searching for the resource data, the floating container is canceled.

Optionally, the processor 610 is further configured to:

After calling the browser to search for the resource data associated with the image displayed in the floating container, during the search process of the resource data, if a third predetermined operation on the floating container is detected, the search for the resource data is cancelled, and the display of the floating container is cancelled. container.

It should be understood that, in this embodiment of the present invention, the radio frequency unit 601 may be used for receiving and sending signals during sending and receiving of information or during a call. Specifically, after receiving the downlink data from the base station, it is processed by the processor 610; The uplink data is sent to the base station. Generally, the radio frequency unit 601 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 601 can also communicate with the network and other devices through a wireless communication system.

The mobile terminal provides the user with wireless broadband Internet access through the network module 602, such as helping the user to send and receive emails, browse web pages, and access streaming media.

The audio output unit 603 may convert audio data received by the radio frequency unit 601 or the network module 602 or stored in the memory 609 into audio signals and output as sound. Also, the audio output unit 603 may also provide audio output related to a specific function performed by the mobile terminal 200 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 603 includes a speaker, a buzzer, a receiver, and the like.

The input unit 604 is used to receive audio or video signals. The input unit 604 may include a graphics processor (Graphics Processing Unit, GPU) 6041 and a microphone 6042, and the graphics processor 6041 captures images of still pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode data is processed. The processed image frames may be displayed on the display unit 606 . The image frames processed by the graphics processor 6041 may be stored in the memory 609 (or other storage medium) or transmitted via the radio frequency unit 601 or the network module 602 . The microphone 6042 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 601 for output in the case of a telephone call mode.

The mobile terminal 200 also includes at least one sensor 605, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 6061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 6061 and the proximity sensor when the mobile terminal 200 is moved to the ear. / or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of mobile terminals (such as horizontal and vertical screen switching, related games , magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 605 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, Infrared sensors, etc., are not repeated here.

The display unit 606 is used to display information input by the user or information provided to the user. The display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

The user input unit 607 may be used to receive input numerical or character information, and generate key signal input related to user setting and function control of the mobile terminal. Specifically, the user input unit 607 includes a touch panel 6071 and other input devices 6072 . The touch panel 6071, also referred to as a touch screen, can collect the user's touch operations on or near it (such as the user's finger, stylus, etc., any suitable object or accessory on or near the touch panel 6071). operate). The touch panel 6071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor 610, the command sent by the processor 610 is received and executed. In addition, the touch panel 6071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 6071 , the user input unit 607 may also include other input devices 6072 . Specifically, other input devices 6072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which are not described herein again.

Further, the touch panel 6071 can be covered on the display panel 6061. When the touch panel 6071 detects a touch operation on or near it, it transmits it to the processor 610 to determine the type of the touch event, and then the processor 610 determines the type of the touch event according to the touch The type of event provides a corresponding visual output on the display panel 6061. Although in FIG. 14, the touch panel 6071 and the display panel 6061 are used as two independent components to realize the input and output functions of the mobile terminal, in some embodiments, the touch panel 6071 and the display panel 6061 can be integrated The input and output functions of the mobile terminal are implemented, which is not specifically limited here.

The interface unit 608 is an interface for connecting an external device to the mobile terminal 200 . For example, external devices may include wired or wireless headset ports, external power (or battery charger) ports, wired or wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 608 may be used to receive input (eg, data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 200 or may be used between the mobile terminal 200 and the external Transfer data between devices.

The memory 609 may be used to store software programs as well as various data. The memory 609 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data created by the use of the mobile phone (such as audio data, phone book, etc.), etc. Additionally, memory 609 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 610 is the control center of the mobile terminal, uses various interfaces and lines to connect various parts of the entire mobile terminal, runs or executes the software programs and/or modules stored in the memory 609, and calls the data stored in the memory 609. , perform various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. The processor 610 may include one or more processing units; preferably, the processor 610 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem The processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 610.

The mobile terminal 200 may also include a power supply 611 (such as a battery) for supplying power to various components. Preferably, the power supply 611 may be logically connected to the processor 610 through a power management system, so as to manage charging, discharging, and power consumption management through the power management system. and other functions.

In addition, the mobile terminal 200 includes some functional modules not shown, which will not be repeated here.

Preferably, an embodiment of the present invention further provides a mobile terminal, including a processor 610 , a memory 609 , a computer program stored in the memory 609 and running on the processor 610 , when the computer program is executed by the processor 610 The various processes of the above resource data display method embodiments are implemented, and the same technical effect can be achieved. In order to avoid repetition, details are not described here.

Embodiments of the present invention further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each process of the foregoing resource data display method embodiment can be achieved, and the same can be achieved. The technical effect, in order to avoid repetition, will not be repeated here. The computer-readable storage medium is, for example, a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk, or an optical disk.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present invention.

The embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of the present invention, without departing from the spirit of the present invention and the scope protected by the claims, many forms can be made, which all belong to the protection of the present invention.

Claims (10)

1. A resource data display method is applied to a mobile terminal, and comprises the following steps:

if the display operation of the suspension container is detected while video data is played through a display interface of the mobile terminal, displaying the suspension container in the display interface; wherein the display position of the suspension container is adjustable;

displaying the currently displayed image of the target area in the suspension container; the target area is an area surrounded by the edge of the suspension container in the display interface;

if the first preset operation on the suspension container is detected, calling a browser to search resource data related to the image displayed in the suspension container;

displaying the searched resource data in the display interface;

the displaying the searched resource data in the display interface comprises:

displaying the searched resource data in the display interface in a target display mode; the target display mode is a display mode corresponding to the resource data;

the displaying the searched resource data in the display interface in a target display mode comprises the following steps:

if the type of the resource data is a character type, displaying the resource data in the display interface as a bullet screen while playing the video data through the display interface;

if the type of the searched resource data is a picture type, controlling the display interface to perform screen splitting so as to enable the display interface to enter a screen splitting state; the display interface in the split screen state comprises a first display window and a second display window, and the first display window is used for playing the video data;

loading the resource data to the second display window for displaying;

if the resource data comprise a link address and a second preset operation on the link address is detected, judging whether the display interface is in the split screen state;

if the judgment result is yes, loading the page corresponding to the link address to the second display window for displaying;

and if the judgment result is negative, controlling the display interface to split the screen, and loading the page corresponding to the link address to a second display window obtained after the split screen for displaying.

2. The method of claim 1, wherein invoking a browser to search for resource data associated with the image displayed in the hover container if the first predetermined operation on the hover container is detected comprises:

if a first preset operation on the suspension container is detected, determining a target type of resource data to be searched according to operation information of the first preset operation; wherein the operation information of the first predetermined operation includes a type of the first predetermined operation and/or fingerprint information of a finger inputting the first predetermined operation;

and calling a browser to search resource data associated with the image displayed in the suspension container, wherein the type of the resource data is the target type.

3. The method of claim 1, wherein after displaying the currently displayed image of the target area in the hover container, and before invoking a browser to search resource data associated with the image displayed in the hover container if the first predetermined operation on the hover container is detected, the method further comprises:

judging whether the suspension container is located in a target corner area in each corner area of the display interface; the distance from any point in the corner area to the two edges of the display interface is not greater than a preset distance, and the image displayed in the target corner area does not include a preset image;

and if the judgment result is negative and a target corner area exists currently, moving the suspension container to the target corner area for displaying.

4. The method of claim 3, wherein the preset image comprises: plant images, animal images, and human images.

5. The method of claim 1, wherein after the invoking a browser searches resource data associated with the image displayed in the hover container, the method further comprises:

and after the resource data are searched, canceling the display of the suspension container.

6. A mobile terminal, comprising:

the first display module is used for displaying the floating container in a display interface if a floating container display instruction is detected while video data is played through the display interface of the mobile terminal; wherein the display position of the suspension container is adjustable;

the second display module is used for displaying the currently displayed image of the target area in the suspension container; the target area is an area surrounded by the edge of the suspension container in the display interface;

the search module is used for calling a browser to search resource data related to the image displayed in the floating container if a first preset operation on the floating container is detected;

the first display module is used for displaying the searched resource data in the display interface;

the first display module is specifically configured to:

displaying the searched resource data in the display interface in a target display mode; the target display mode is a display mode corresponding to the resource data; the first display module, comprising:

the first display sub-module is used for displaying the resource data as a bullet screen in the display interface while playing the video data through the display interface if the type of the searched resource data is a character type;

the screen splitting sub-module is used for controlling the display interface to split the screen if the type of the searched resource data is the picture type so as to enable the display interface to enter a screen splitting state; the display interface in the split screen state comprises a first display window and a second display window, and the first display window is used for playing the video data;

the second display submodule is used for loading the resource data to the second display window for displaying;

the first judgment module is used for judging whether the display interface is in the split screen state or not if the resource data comprises a link address and a second preset operation on the link address is detected after the resource data is used as a bullet screen to be displayed in the display interface; if the judgment result is yes, triggering a second display module, and if the judgment result is no, triggering a third display module;

the second display module is configured to load the page corresponding to the link address to the second display window for display;

and the third display module is used for controlling the display interface to split the screen, and loading the page corresponding to the link address to a second display window obtained after the split screen is displayed.

7. The mobile terminal of claim 6, wherein the search module comprises:

the determining submodule is used for determining the target type of the resource data to be searched according to the operation information of the first preset operation if the first preset operation on the suspension container is detected; wherein the operation information of the first predetermined operation includes a type of the first predetermined operation and/or fingerprint information of a finger inputting the first predetermined operation;

and the searching submodule is used for calling a browser to search resource data related to the image displayed in the suspension container, and the type of the resource data is the target type.

8. The mobile terminal of claim 6, further comprising:

the second judgment module is used for judging whether the suspension container is positioned in a target corner area in each corner area of the display interface or not after the currently displayed image of the target area is displayed in the suspension container and before a browser is called to search resource data associated with the image displayed in the suspension container if a first preset operation on the suspension container is detected; the distance from any point in the corner area to the two edges of the display interface is not greater than a preset distance, and the image displayed in the target corner area does not include a preset image;

and the third display module is used for moving the suspension container to the target corner area for displaying if the judgment result of the second judgment module is negative and the target corner area exists currently.

9. The mobile terminal of claim 8, wherein the preset image comprises: plant images, animal images, and human images.

10. The mobile terminal of claim 6, further comprising:

and the first canceling module is used for canceling the display of the floating container after the browser is called to search the resource data associated with the image displayed in the floating container and the resource data is searched.

Images