CN120316289A - Search result display method and device - Google Patents

Search result display method and device

Info

Publication number
CN120316289A
CN120316289A CN202410066230.1A CN202410066230A CN120316289A CN 120316289 A CN120316289 A CN 120316289A CN 202410066230 A CN202410066230 A CN 202410066230A CN 120316289 A CN120316289 A CN 120316289A
Authority
CN
China
Prior art keywords
electronic device
search
video stream
search result
virtual screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202410066230.1A
Other languages
Chinese (zh)
Inventor
张立恒
张苏弦
陈培链
康嘉昊
黄亮智
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Guangzhou Mobile R&D Center
Samsung Electronics Co Ltd
Original Assignee
Samsung Guangzhou Mobile R&D Center
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Guangzhou Mobile R&D Center, Samsung Electronics Co Ltd filed Critical Samsung Guangzhou Mobile R&D Center
Priority to CN202410066230.1A priority Critical patent/CN120316289A/en
Priority to PCT/KR2024/021141 priority patent/WO2025154976A1/en
Publication of CN120316289A publication Critical patent/CN120316289A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/532Query formulation, e.g. graphical querying
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/538Presentation of query results
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth®, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for programme selection
    • H04N21/4828End-user interface for programme selection for searching programme descriptors
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Signal Processing (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

提供一种搜索结果显示方法及装置。应用于第一电子设备的搜索结果显示方法包括:响应于在显示第一应用的页面时接收到用户触发的搜索操作,创建用于显示包括搜索对象和搜索结果的虚拟屏;将所述虚拟屏进行录制和编码,生成视频流;将所述视频流发送到第二电子设备,以在第二电子设备上显示,从而在第一电子设备处实现边播放边搜索的搜索结果显示。应用于第二电子设备的搜索结果显示方法包括:接收由第一电子设备发送的与虚拟屏有关的视频流;对所述视频流进行解码并播放,从而在第二电子设备处实现边播放边搜索的搜索结果显示。

A search result display method and device are provided. The search result display method applied to a first electronic device includes: in response to receiving a search operation triggered by a user when displaying a page of a first application, creating a virtual screen for displaying a search object and search results; recording and encoding the virtual screen to generate a video stream; sending the video stream to a second electronic device to be displayed on the second electronic device, thereby realizing the search result display of playing while searching at the first electronic device. The search result display method applied to a second electronic device includes: receiving a video stream related to the virtual screen sent by the first electronic device; decoding and playing the video stream, thereby realizing the search result display of playing while searching at the second electronic device.

Description

Search result display method and device
Technical Field
The present disclosure relates to the field of display technology. More particularly, the disclosure relates to a search result display method and device.
Background
With the increasing popularization and application of tablet computer mobile phones, the situation that lovers, family members and friends watch movies/watch videos together by using tablet computers often happens, and people can want to pursue personal viewing experience while enjoying family friends together.
Almost everyone has the experience of watching the video together with friends or family, when watching a person and an object of interest in the video, if one person wants to search the content of a certain picture at this time, the current video is paused, the search result is jumped to, and after the search result is checked, the video is returned to continue playing, so that the watching experience of another person not interested in the search content is affected.
Disclosure of Invention
An exemplary embodiment of the disclosure provides a method and an apparatus for displaying search results, so that when a search target object is triggered in a display screen on a first electronic device, the search results on the first electronic device are recorded through a virtual screen and projected onto a second electronic device to display and reversely control the first electronic device, so that a user can continue to search and view on the second electronic device, and other users can continue to view videos on the first electronic device.
According to an exemplary embodiment of the disclosure, a search result display method is provided, and is applied to a first electronic device, wherein the search result display comprises the steps of responding to a search operation triggered by a user when a page of the first application is displayed, creating a virtual screen for displaying a search object and a search result, recording and encoding the virtual screen to generate a video stream, and sending the video stream to a second electronic device to be displayed on the second electronic device.
Optionally, the search result display method can further comprise the steps of suspending playing of the first application in response to receiving a search operation triggered by a user when the page of the first application is displayed, and resuming playing of the first application in response to receiving feedback of the second electronic device determining to accept screen casting.
Optionally, the step of creating a virtual screen for displaying the search object and the search result may include requesting a screen cast to the second electronic device, and creating a virtual screen for displaying the search object and the search result in response to receiving feedback from the second electronic device determining to accept the screen cast.
Optionally, the search result display method may further include responding to the operation of the user on the video stream display interface received from the second electronic device, and responding to the operation by the virtual screen of the first electronic device.
Optionally, the search result display method can further comprise connecting with a second electronic device in response to receiving a search operation triggered by a user when displaying a page of the first application, wherein the second electronic device is connected with the first electronic device through the same wireless communication network.
Optionally, the step of connecting with the second electronic device may include searching for the second electronic device by scanning for user datagram protocol, UDP, broadcasts, and establishing a socket connection with the searched second electronic device.
According to an exemplary embodiment of the present disclosure, a search result display method is provided, which is applied to a second electronic device, and includes receiving a video stream related to a virtual screen transmitted by a first electronic device, and decoding and playing the video stream.
Optionally, the method for displaying the search results can further comprise the steps of receiving operation of a user on the video stream display interface, sending the operation to the first electronic device, and receiving and updating video stream data for displaying the result of the virtual screen of the first electronic device after responding to the operation.
Alternatively, a socket connection may be established between the second electronic device and the first electronic device.
According to an exemplary embodiment of the present disclosure, there is provided a search result display apparatus including a virtual screen creation unit configured to create a virtual screen for displaying a search object and a search result in response to receiving a search operation triggered by a user when displaying a page of a first application, a virtual screen processing unit configured to record and encode the virtual screen to generate a video stream, and a virtual screen transmission unit configured to transmit the video stream to a second electronic device to be displayed on the second electronic device.
Optionally, the search result display device further comprises a play control unit configured to pause playing of the first application in response to receiving a search operation triggered by a user when displaying the page of the first application, and resume playing of the first application in response to receiving feedback of the second electronic device determining to accept screen casting.
Alternatively, the virtual screen creation unit may be configured to request a screen cast to the second electronic device, and create a virtual screen for displaying the search object and the search result in response to receiving feedback of the second electronic device that determines to accept the screen cast.
Optionally, the search result display device may further comprise a back control unit configured to respond to the operation of the user on the video stream display interface received from the second electronic device, wherein the virtual screen of the first electronic device responds to the operation.
Optionally, the search result display apparatus may further include a connection unit configured to connect with a second electronic device in response to receiving a search operation triggered by a user while displaying a page of the first application, wherein the second electronic device is connected with the same wireless communication network as the first electronic device.
Alternatively, the connection unit may be configured to search for the second electronic device by scanning for user datagram protocol, UDP, broadcasts and to establish a socket connection with the searched second electronic device.
According to an exemplary embodiment of the present disclosure, there is provided a search result display apparatus including a video stream receiving unit configured to receive a video stream related to a virtual screen transmitted by a first electronic device, and a video stream playing unit configured to decode and play the video stream.
Optionally, the search result display device further comprises a reverse control unit configured to receive operation of a user on the video stream display interface, send the operation to the first electronic device, and receive and update video stream data showing a result of the virtual screen of the first electronic device after responding to the operation.
Alternatively, a socket connection may be established between the second electronic device and the first electronic device.
According to an exemplary embodiment of the present disclosure, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a search result display method according to an exemplary embodiment of the present disclosure.
According to an exemplary embodiment of the present disclosure, there is provided a computing device including at least one processor, at least one memory storing a computer program that, when executed by the at least one processor, implements a search result display method according to an exemplary embodiment of the present disclosure.
According to an exemplary embodiment of the present disclosure, a computer program product is provided, instructions in which are executable by a processor of a computer device to perform a search result display method according to an exemplary embodiment of the present disclosure.
According to the search result display method and the search result display device, a virtual screen for displaying a search object and a search result is created through response to receiving a search operation triggered by a user when a page of a first application is displayed by a first electronic device, the virtual screen is recorded and encoded to generate a video stream, and the video stream is sent to a second electronic device to be displayed on the second electronic device, so that search result display of searching while playing is achieved at the first electronic device.
According to the search result display method and the search result display device, the second electronic device receives the video stream which is sent by the first electronic device and related to the virtual screen, decodes and plays the video stream, and therefore search result display which is performed while the search is performed is achieved at the second electronic device.
Additional aspects and/or advantages of the present general inventive concept will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the general inventive concept.
Drawings
The foregoing and other objects and features of exemplary embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings which illustrate the embodiments by way of example, in which:
FIG. 1 shows a schematic diagram of a search results display according to the related art;
FIG. 2 illustrates a flowchart of a search result display method applied to a first electronic device, according to an exemplary embodiment of the present disclosure;
FIG. 3 illustrates a flowchart of a search result display method applied to a second electronic device according to an exemplary embodiment of the present disclosure;
FIG. 4 shows a schematic diagram of a search result display performed by device A and device B, according to an example embodiment of the present disclosure;
FIG. 5 illustrates a block diagram of a search result display device according to an exemplary embodiment of the present disclosure;
FIG. 6 shows a block diagram of a search result display apparatus according to an exemplary embodiment of the present disclosure, and
Fig. 7 shows a schematic diagram of a computing device according to an exemplary embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to the exemplary embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The embodiments will be described below in order to explain the present disclosure by referring to the figures.
Fig. 1 shows a schematic diagram of search result display according to the related art. Fig. 1 illustrates an example in which a plurality of users watch a movie together at home.
As shown in fig. 1, the first user and the second user watch a movie together with a device (e.g. a tablet computer), and a beautiful and novel clothing picture appears on the picture, the second user is attracted by the clothing at a time, and wants to know what brand and what style of clothing is available, and whether he wears the same as in the video or not, and because of personal preference, the first user is not interested in the clothing of the style, but is interested in the movie scenario, and wants to watch the movie continuously.
Based on the care of friend experience, at this time, the first user usually waits for the second user to start the function of the tablet personal computer, directly selects and searches for new types of clothes in the video, and based on the current technology, when the second user searches, the current video is paused and covered by the search screen, so that the viewing experience of the first user is directly affected.
Because the first user is not interested in the style of clothing, but for objective reasons, the first user either waits for the second user to search for clothing before continuing to watch the movie, which wastes time for the first user. Or the second user holds the curiosity without searching for clothing and continues to watch the movie with the first user, so that the curiosity of the second user is not satisfied.
Fig. 2 illustrates a flowchart of a search result display method applied to a first electronic device according to an exemplary embodiment of the present disclosure. Here, the search result display method may be performed by, for example, an application installed on the first electronic device that supports the circle map search function. In this disclosure, the search function or the circle map search function is not limited to a specific application, and all applications supporting the search function or the circle map search function are included. In the description of the present disclosure, an application for supporting searching of a circle chart is described as an example.
Referring to fig. 2, in response to receiving a user-triggered search operation while displaying a page of a first application, a virtual screen for displaying a search object and a search result is created at step S201. Here, the page of the first application may include an image, and the user-triggered search operation may be an operation for selecting a target object in the page (e.g., image, video, etc.) of the first application. The first electronic device may initiate a search function (e.g., without limitation, a video circle map search function, an image circle map search function, a long press search, etc.), which may allow a user to circle a target object in a page by hand-scribing a circle. The user may search for information related to the target object (which may include, for example, but is not limited to, shopping, navigation, encyclopedia, etc.) by looping or clicking on the selected target object (target content) with a finger at any location on the screen.
In an exemplary embodiment of the present disclosure, the search result display method may further include connecting with the second electronic device in response to receiving a search operation triggered by a user while displaying the page of the first application, so as to facilitate data transmission between the first electronic device and the second electronic device. Here, the second electronic device is connected to the same wireless communication network as the first electronic device. For example, the wireless communication network may be, for example, but not limited to, 4G, 5G, 6G, zigBee, wireless Local Area Network (WLAN), wiFi, bluetooth, etc.
In an exemplary embodiment of the present disclosure, the step of connecting with the second electronic device may include searching for the second electronic device by scanning for user datagram protocol (User Datagram Protocol, abbreviated as UDP) broadcasts, and establishing a Socket connection with the searched second electronic device, thereby allowing two programs to communicate over a network on different apparatuses (the first electronic device and the second electronic device) and improving a data transmission speed. For example, a first electronic device first searches for a user datagram protocol broadcast and then connects to a second electronic device under the same WIFI.
In particular, the user datagram protocol is a connectionless, simple transport layer protocol that is datagram-oriented. The user datagram protocol does not need to establish a connection between the client and the server before transmitting the datagram, and has no mechanism such as timeout retransmission, etc., so the transmission speed is very fast. Since communication does not require connection, broadcast transmission can be realized.
In particular, a socket connection is a communication mechanism in a computer network that allows two programs to communicate over the network on different computers. When using a socket for communication, one program acts as a client and the other program acts as a server, which perform data transfer by creating and using the socket.
As an example, when the first electronic device plays the video, the user may start the circle map search function by pressing a home key for a long time, at which time the video play is suspended, the interface information of the first electronic device is screen-captured, and the circle map search function of the first electronic device applies the screen capture to obtain the target object selected by the user. For example, scanning a user datagram protocol broadcast search for a second electronic device begins after a user is detected to be circled or a target search object is clicked through a circle map search function application. After the second electronic device is found, a wireless socket connection is established between the first electronic device and the second electronic device.
In an exemplary embodiment of the present disclosure, the step of creating a virtual screen for displaying a search object and a search result may include requesting a screen to be projected to a second electronic device, and creating a virtual screen for displaying a search object and a search result in response to receiving feedback of the determination of accepting the screen projected by the second electronic device, thereby improving the effectiveness of creating the virtual screen. For example, the user may click on the second electronic device confirming that the user would like to accept the screen, indicating that the user agrees to enable the search-while-broadcast function. In an exemplary embodiment of the present disclosure, both the first electronic device and the second electronic device have a screen-casting function, for example, a screen-casting application is installed.
In this case, the first electronic device is now running with two screens simultaneously:
Screen 1 (home screen) for continuing to play the previous video when the user on the first electronic device sees the video content of screen 1 (excluding the search results);
screen 2 (virtual screen) for the circle map search application searches for video function logic and display.
In an exemplary embodiment of the present disclosure, the search result display method performed by the first electronic device may further include suspending playing of the first application in response to receiving a search operation triggered by a user while displaying a page of the first application, and resuming playing of the first application in response to receiving feedback of the second electronic device determining to accept the screen casting. Here, the first application may include, for example, but not limited to, at least one of a video application, a slide application, and a picture application.
In step S202, the virtual screen is recorded and encoded, and a video stream is generated.
In step S203, the video stream is sent to the second electronic device for display on the second electronic device.
Here, the video stream may be transmitted to the second electronic device by a transmission manner such as wireless transmission, which is not limited by the present disclosure.
As an example, in response to a user confirming acceptance of a screen cast on a second electronic device, the first electronic device creates a virtual screen for displaying a circle map search at step S201 (e.g., through a circle map search application on the first electronic device), encodes the virtual screen at step S202, and transmits the encoded virtual screen to the second electronic device by way of the screen cast at step S203, thereby transmitting the search result to the second electronic device.
In an exemplary embodiment of the disclosure, the search result display method may further include, in response to receiving an operation of the user on the video stream display interface from the second electronic device, responding to the operation by the virtual screen of the first electronic device, so as to realize back control of the virtual screen without affecting playing of the application.
As an example, when multiple users watch the video of the first electronic device together, when one user wants to search for related content in the video, the circle diagram search function triggers a search target object, the first electronic device and the second electronic device under the same WIFI network establish wireless connection, and the search result on the first electronic device is recorded through a virtual screen and is projected onto the second electronic device to display and reversely control the first electronic device, so that the user can continue searching and viewing, and other users can continue watching the video on the first electronic device.
Fig. 3 illustrates a flowchart of a search result display method applied to a second electronic device according to an exemplary embodiment of the present disclosure.
Referring to fig. 3, a video stream related to a virtual screen transmitted by a first electronic device is received at step S301.
In an exemplary embodiment of the present disclosure, the second electronic device may establish a socket connection with the first electronic device, thereby facilitating data transmission.
In an exemplary embodiment of the present disclosure, the step of receiving a video stream related to a virtual screen transmitted by a first electronic device may include receiving, by a screen casting application, the video stream related to the virtual screen transmitted by the first electronic device so as not to affect continued playback by the first electronic device.
In step S302, the video stream is decoded and played.
After the second electronic device receives the video stream related to the virtual screen (i.e., virtual screen information) in step S301, decoding is started in step S302, and the decoded screen contents (i.e., virtual screen) are played and displayed on the second electronic device after decoding, so that the user can view the search result of the circle map search on the second electronic device.
In an exemplary embodiment of the disclosure, the search result display method may further include receiving an operation of a user on the video stream display interface, sending the operation to the first electronic device, and receiving and updating video stream data of a result of the virtual screen of the first electronic device after the virtual screen responds to the operation, so that the reverse control of the virtual screen is achieved.
As an example, the user may also back-control the circle map search function application on the second electronic device, e.g., the user may further click on the second electronic device to view the search details and may direct the search results.
Fig. 4 shows a schematic diagram of a search result display performed by device a and device B according to an exemplary embodiment of the present disclosure.
As shown in fig. 4, the first user and the second user watch the video (e.g. a movie) together with the device a (e.g. a tablet computer), and a beautiful and novel-style clothing is shown on the screen, and the second user is attracted by the clothing at a glance, and wants to know what brand and what style of clothing is available, and whether he wears himself or herself as beautiful as in the video, and because of personal preference, the first user has no great interest in the clothing of the style, but is interested in movie episodes, and wants to continue watching the movie. The second user starts a circle map search function by pressing a home key on the device a for a long time, at this time, the video playing is paused, the second user circles or clicks a target object in the video in a selected manner by hand, at this time, screen information of clothes of the first electronic device is screen-captured, and a circle map search function application (for example, a circle map search app in fig. 4) acquires the screen-captured, so that a screen of clothes selected by the second user is acquired as the target object.
After the screen of the clothing selected by the second user is acquired, a communication connection is established between the device a and the device B. For example, device a may initiate a user datagram protocol search, search for device B of the second user, and establish a Socket connection with the searched device B.
After establishing a socket connection with device B, device a requests a screen-cast to device B by sending a message "accept screen-cast. In this case device a creates a virtual screen for searching for the target object, the picture of the clothing, where the first electronic device is running with both screens at the same time, screen 1 (main screen) is used to continue playing the previous video, where the user on the first electronic device sees the video content of screen 1 (excluding the search results), screen 2 (virtual screen) is used to search the video function logic and display by the circle map search application.
After creating the virtual screen, device a encodes the created virtual screen and transmits the encoded virtual screen data to device B, which receives the virtual screen data. After receiving the virtual screen data, device B may decode the virtual screen data, obtain a virtual screen, and display the obtained virtual screen. The second user may back-control the virtual screen on device B. And then, the device A obtains an operation virtual screen according to the reverse control operation, and sends the operation virtual screen comprising the result of the reverse control operation to the device B so as to display the operation virtual screen on the device B, thereby realizing the reverse control of the virtual screen.
A search result display method according to an exemplary embodiment of the present disclosure has been described above in connection with fig. 1 to 4. Hereinafter, a search result display apparatus and units thereof according to an exemplary embodiment of the present disclosure will be described with reference to fig. 5 and 6.
Fig. 5 illustrates a block diagram of a search result display apparatus according to an exemplary embodiment of the present disclosure.
Referring to fig. 5, the search result display apparatus includes a virtual screen creation unit 51, a virtual screen processing unit 52, and a virtual screen transmission unit 53.
The virtual screen creation unit 51 is configured to create a virtual screen for displaying a search object and a search result in response to receiving a search operation triggered by a user when displaying a page of the first application.
In an exemplary embodiment of the present disclosure, the search result display apparatus may further include a connection unit (not shown) configured to connect with the second electronic device in response to receiving a user-triggered search operation while displaying the page of the first application. Here, the second electronic device is connected to the same wireless communication network as the first electronic device.
In an exemplary embodiment of the present disclosure, the connection unit is configured to search for the second electronic device by scanning for user datagram protocol, UDP, broadcasts and establish a socket connection with the searched second electronic device.
In an exemplary embodiment of the present disclosure, the search result display apparatus may further include a play control unit (not shown) configured to pause the play of the first application in response to receiving a search operation triggered by a user while the page of the first application is displayed, and resume the play of the first application in response to receiving feedback of the second electronic device determining to accept the screen casting. Here, the first application may include, for example, but not limited to, at least one of a video application, a slide application, and a picture application.
The virtual screen processing unit 52 is configured to record and encode the virtual screen to generate a video stream.
In an exemplary embodiment of the present disclosure, the virtual screen creation unit 52 may be configured to request a screen cast to the second electronic device, and create a virtual screen for displaying a search object and a search result in response to receiving feedback of the second electronic device that determines to accept the screen cast.
The virtual screen transmitting unit 53 is configured to transmit the video stream to the second electronic device for display on the second electronic device.
In an exemplary embodiment of the present disclosure, the search result display apparatus may further include a countercontrol unit (not shown) configured to respond to an operation of the video stream display interface received from the second electronic device by the user.
Fig. 6 illustrates a block diagram of a search result display apparatus according to an exemplary embodiment of the present disclosure.
Referring to fig. 6, the search result display apparatus includes a video stream receiving unit 61 and a video stream playing unit 62.
The video stream receiving unit 61 is configured to receive a video stream related to a virtual screen transmitted by the first electronic device.
In an exemplary embodiment of the present disclosure, a socket connection is established between a second electronic device and a first electronic device.
In an exemplary embodiment of the present disclosure, the virtual screen receiving unit 61 may be configured to receive, through the screen casting application, a video stream related to the virtual screen transmitted by the first electronic device.
The video stream playing unit 62 is configured to decode and play the video stream.
In an exemplary embodiment of the present disclosure, the search result display apparatus may further include a reverse control unit (not shown) configured to receive an operation of a user with respect to the video stream display interface, transmit the operation to the first electronic device, and receive and update video stream data displaying a result of the virtual screen of the first electronic device in response to the operation.
Further, according to an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium having stored thereon a computer program which, when executed, implements a search result display method according to an exemplary embodiment of the present disclosure.
In an exemplary embodiment of the present disclosure, the computer-readable storage medium may carry one or more programs that when executed perform the steps of creating a virtual screen for displaying a search object and a search result in response to receiving a user-triggered search operation while displaying a page of a first application, recording and encoding the virtual screen, generating a video stream, and transmitting the video stream to a second electronic device for display on the second electronic device, thereby enabling a search result display that searches while playing at the first electronic device.
In an exemplary embodiment of the present disclosure, the computer-readable storage medium may carry one or more programs that when executed perform the steps of receiving a video stream related to a virtual screen transmitted by a first electronic device, decoding and playing the video stream, thereby enabling a search result display of a search while playing at a second electronic device.
The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of a computer-readable storage medium may include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer program embodied on a computer readable storage medium may be transmitted using any appropriate medium, including but not limited to electrical wiring, fiber optic cable, RF (radio frequency), and the like, or any suitable combination of the foregoing. The computer readable storage medium may be included in any apparatus or may exist alone without being assembled into the apparatus.
Further, according to an exemplary embodiment of the present disclosure, there is also provided a computer program product in which instructions are executable by a processor of a computer device to perform a method of search result display according to an exemplary embodiment of the present disclosure.
A search result display apparatus according to an exemplary embodiment of the present disclosure has been described above in connection with fig. 5 and 6. Next, a computing device according to an exemplary embodiment of the present disclosure is described in connection with fig. 7.
Fig. 7 shows a schematic diagram of a computing device according to an exemplary embodiment of the present disclosure.
Referring to fig. 7, a computing device 7 according to an exemplary embodiment of the present disclosure includes a memory 71 and a processor 72, the memory 71 having stored thereon a computer program which, when executed by the processor 72, implements a search result display method according to an exemplary embodiment of the present disclosure.
In an exemplary embodiment of the present disclosure, the computer program, when executed by the processor 72, may implement the steps of creating a virtual screen for displaying a search object and search results in response to receiving a user-triggered search operation while displaying a page of a first application, recording and encoding the virtual screen to generate a video stream, and transmitting the video stream to a second electronic device for display on the second electronic device to enable display of search results while playing at the first electronic device.
In an exemplary embodiment of the present disclosure, the computer program, when executed by the processor 72, may implement the steps of receiving a video stream related to a virtual screen transmitted by a first electronic device, decoding and playing the video stream, thereby enabling a search result display of a search while playing at a second electronic device.
Computing devices in embodiments of the present disclosure may include, but are not limited to, devices such as mobile phones, notebook computers, PDAs (personal digital assistants), PADs (tablet computers), desktop computers, and the like. The computing device illustrated in fig. 7 is merely an example and should not be taken as limiting the functionality and scope of use of embodiments of the present disclosure.
Search result display methods and apparatuses according to exemplary embodiments of the present disclosure have been described above with reference to fig. 1 to 7. However, it should be understood that the search result display apparatus and units thereof shown in FIGS. 5 through 6, respectively, may be configured as software, hardware, firmware, or any combination thereof that performs a specific function, the computing apparatus shown in FIG. 7 is not limited to include the components shown above, but some components may be added or deleted as needed, and the above components may also be combined.
According to the search result display method and the search result display device, a virtual screen for displaying a search object and a search result is created through response to receiving a search operation triggered by a user when a page of a first application is displayed by a first electronic device, the virtual screen is recorded and encoded to generate a video stream, and the video stream is sent to a second electronic device to be displayed on the second electronic device, so that search result display of searching while playing is achieved at the first electronic device.
According to the search result display method and the search result display device, the second electronic device receives the video stream which is sent by the first electronic device and related to the virtual screen, decodes and plays the video stream, and therefore search result display which is performed while the search is performed is achieved at the second electronic device.
While the present disclosure has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present disclosure as defined by the following claims.

Claims (10)

1.一种搜索结果显示方法,应用于第一电子设备,其特征在于,包括:1. A search result display method, applied to a first electronic device, comprising: 响应于在显示第一应用的页面时接收到用户触发的搜索操作,创建用于显示包括搜索对象和搜索结果的虚拟屏;In response to receiving a search operation triggered by a user when displaying a page of the first application, creating a virtual screen for displaying a search object and search results; 将所述虚拟屏进行录制和编码,生成视频流;Recording and encoding the virtual screen to generate a video stream; 将所述视频流发送到第二电子设备,以在第二电子设备上显示。The video stream is sent to a second electronic device for display on the second electronic device. 2.根据权利要求1所述的搜索结果显示方法,其特征在于,还包括:2. The search result display method according to claim 1, further comprising: 响应于在显示所述第一应用的页面时接收到用户触发的搜索操作,暂停所述第一应用的播放;In response to receiving a search operation triggered by a user when displaying the page of the first application, pausing the playing of the first application; 响应于接收到第二电子设备的确定接受投屏的反馈,恢复所述第一应用的播放。In response to receiving feedback from the second electronic device confirming that the screen projection is accepted, resuming the playback of the first application. 3.根据权利要求1所述的搜索结果显示方法,其特征在于,所述创建用于显示包括搜索对象和搜索结果的虚拟屏的步骤包括:3. The search result display method according to claim 1, wherein the step of creating a virtual screen for displaying the search object and the search results comprises: 请求向第二电子设备进行投屏;Requesting screen projection to a second electronic device; 响应于接收到第二电子设备的确定接受投屏的反馈,创建用于显示包括搜索对象和搜索结果的虚拟屏。In response to receiving feedback from the second electronic device confirming that the screen projection is accepted, a virtual screen is created for displaying the search object and search results. 4.根据权利要求1所述的搜索结果显示方法,其特征在于,还包括:4. The search result display method according to claim 1, further comprising: 响应于从第二电子设备接收到用户针对所述视频流显示界面的操作,第一电子设备的虚拟屏响应所述操作。In response to receiving a user operation on the video stream display interface from the second electronic device, the virtual screen of the first electronic device responds to the operation. 5.一种搜索结果显示方法,应用于第二电子设备,其特征在于,包括:5. A search result display method, applied to a second electronic device, comprising: 接收由第一电子设备发送的与虚拟屏有关的视频流;Receiving a video stream related to a virtual screen sent by a first electronic device; 对所述视频流进行解码并播放。The video stream is decoded and played. 6.根据权利要求5所述的搜索结果显示方法,其特征在于,还包括:6. The search result display method according to claim 5, further comprising: 接收用户针对所述视频流显示界面的操作;Receiving a user's operation on the video stream display interface; 将所述操作发送到第一电子设备;sending the operation to the first electronic device; 接收并更新显示第一电子设备的所述虚拟屏响应所述操作后的结果的视频流数据。The video stream data showing the result after the virtual screen of the first electronic device responds to the operation is received and updated. 7.一种搜索结果显示装置,其特征在于,包括:7. A search result display device, comprising: 虚拟屏创建单元,被配置为响应于在显示第一应用的页面时接收到用户触发的搜索操作,创建用于显示包括搜索对象和搜索结果的虚拟屏;a virtual screen creation unit configured to, in response to receiving a search operation triggered by a user when displaying a page of the first application, create a virtual screen for displaying a search object and a search result; 虚拟屏处理单元,被配置为将所述虚拟屏进行录制和编码,生成视频流;和a virtual screen processing unit, configured to record and encode the virtual screen to generate a video stream; and 虚拟屏发送单元,被配置为将所述视频流发送到第二电子设备,以在第二电子设备上显示。The virtual screen sending unit is configured to send the video stream to the second electronic device for display on the second electronic device. 8.一种搜索结果显示装置,其特征在于,包括:8. A search result display device, comprising: 视频流接收单元,被配置为接收由第一电子设备发送的与虚拟屏有关的视频流;A video stream receiving unit, configured to receive a video stream related to the virtual screen sent by the first electronic device; 视频流播放单元,被配置为对所述视频流进行解码并播放。The video stream playing unit is configured to decode and play the video stream. 9.一种存储有计算机程序的计算机可读存储介质,其特征在于,当所述计算机程序被处理器执行时,实现权利要求1至6中任一项所述的搜索结果显示方法。9. A computer-readable storage medium storing a computer program, characterized in that when the computer program is executed by a processor, the search result display method according to any one of claims 1 to 6 is implemented. 10.一种计算装置,其特征在于,包括:10. A computing device, comprising: 至少一个处理器;at least one processor; 至少一个存储器,存储有计算机程序,当所述计算机程序被所述至少一个处理器执行时,实现权利要求1至6中任一项所述的搜索结果显示方法。At least one memory stores a computer program, and when the computer program is executed by the at least one processor, the search result display method according to any one of claims 1 to 6 is implemented.
CN202410066230.1A 2024-01-15 2024-01-15 Search result display method and device Pending CN120316289A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202410066230.1A CN120316289A (en) 2024-01-15 2024-01-15 Search result display method and device
PCT/KR2024/021141 WO2025154976A1 (en) 2024-01-15 2024-12-26 Method and device for displaying search result

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202410066230.1A CN120316289A (en) 2024-01-15 2024-01-15 Search result display method and device

Publications (1)

Publication Number Publication Date
CN120316289A true CN120316289A (en) 2025-07-15

Family

ID=96334498

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202410066230.1A Pending CN120316289A (en) 2024-01-15 2024-01-15 Search result display method and device

Country Status (2)

Country Link
CN (1) CN120316289A (en)
WO (1) WO2025154976A1 (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101952170B1 (en) * 2011-10-24 2019-02-26 엘지전자 주식회사 Mobile device using the searching method
KR102099086B1 (en) * 2013-02-20 2020-04-09 삼성전자주식회사 Method of providing user specific interaction using user device and digital television and the user device and the digital television
KR102077237B1 (en) * 2014-09-17 2020-02-13 삼성전자주식회사 Method and system for providing searching informatiom of a captured image on a display device to a mobile device
KR20170055948A (en) * 2017-05-12 2017-05-22 삼성전자주식회사 Image processing apparatus, user terminal apparatus and image processing method, control method thereof
US10180983B1 (en) * 2018-06-18 2019-01-15 Rovi Guides, Inc. Methods and systems for sharing a user interface of a search engine

Also Published As

Publication number Publication date
WO2025154976A1 (en) 2025-07-24

Similar Documents

Publication Publication Date Title
US11997150B2 (en) Media asset streaming over network to devices
CN105763909B (en) Method, equipment and the medium that adaptive media content is cleared up on remote equipment
CN102893299B (en) Editable bookmarks shared via social networks
CN103155521B (en) For changing the method and system of media output between two or more equipment
JP7635393B2 (en) Mirroring method, device, electronic device and storage medium
CN113992934B (en) Multimedia information processing method, device, electronic equipment and storage medium
TWI630487B (en) Cooperative provision of personalized user functions using shared and personal devices
JP2016533075A (en) Information acquisition method, apparatus, program, and recording medium
KR20120126803A (en) Apparatus and method for storing data of peripheral device in portable terminal
US20100169514A1 (en) Picture push
WO2017121303A1 (en) Method and apparatus for playing push information during video live broadcast
CN107408262A (en) Method, system and medium for presenting media content advertised on a second screen device using a primary device
CN104035953B (en) Method and system for the seamless delivery of content navigation across different device
WO2011102508A1 (en) Content playback device
CN105812957A (en) Continuous playing method and device for multimedia file
WO2022127523A1 (en) Video playback method and apparatus, device, and medium
WO2018205833A1 (en) Method and apparatus for transmitting music file information, storage medium, and electronic apparatus
WO2015180688A1 (en) Media processing method and device
JP2019503091A (en) Multimedia information reproducing method and system, standardized server and live streaming terminal
US9445142B2 (en) Information processing apparatus and control method thereof
US20100169505A1 (en) Render hopping
CN112055252A (en) Multi-screen interaction method and device, computer readable medium and electronic equipment
WO2022161329A1 (en) Work display method and apparatus, and electronic device and storage medium
CN120316289A (en) Search result display method and device
JP5420863B2 (en) Thin client system, application server, terminal control server, communication method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination