CN118802869A - Desktop sharing method, desktop sharing device, electronic device and readable storage medium - Google Patents

Abstract

The application discloses a desktop sharing method, a desktop sharing device, electronic equipment and a readable storage medium, belonging to the technical field of computers, wherein the method comprises the following steps: displaying a desktop sharing operation button under the condition that the first client side and the second client side of at least one second cloud terminal are detected to establish video call connection; and responding to the triggering operation of the desktop sharing operation button, sharing desktop video stream data to the second client of at least one second cloud terminal, wherein the desktop video stream data comprises screen display content of a first terminal, the first terminal is an operation terminal of the first cloud terminal, and the first cloud terminal is different from the operation terminal of the second cloud terminal.

Description

Desktop sharing method, desktop sharing device, electronic device and readable storage medium

Technical Field

The present invention belongs to the field of computer technology, and in particular relates to a desktop sharing method, a desktop sharing device, an electronic device and a readable storage medium.

Background Art

Currently, when sharing the desktop, both the sharing end and the receiving end need to install the same desktop sharing software, and the desktop sharing function is usually completed within the software, and system-level desktop sharing cannot be achieved.

Summary of the invention

The embodiments of the present application provide a desktop sharing method, a desktop sharing device, an electronic device and a readable storage medium, which can realize system-level desktop sharing.

In a first aspect, an embodiment of the present application provides a desktop sharing method, which is applied to a first cloud terminal, and the method includes: when it is detected that a first client establishes a video call connection with a second client of at least one second cloud terminal, displaying a desktop sharing operation button; in response to a triggering operation of the desktop sharing operation button, sharing desktop video stream data to the second client of at least one second cloud terminal, wherein the desktop video stream data includes the screen display content of the first terminal, the first terminal is an operating terminal of the first cloud terminal, and the operating terminals of the first cloud terminal and the second cloud terminal are different.

In a second aspect, an embodiment of the present application provides a desktop sharing device, which includes: a display module, used to display a desktop sharing operation button when it is detected that a first client establishes a video call connection with a second client of at least one second cloud terminal; a sharing module, used to share desktop video stream data to the second client of at least one second cloud terminal in response to a triggering operation of the desktop sharing operation button, wherein the desktop video stream data includes the screen display content of the first terminal, the first terminal is the operating terminal of the first cloud terminal, and the operating terminals of the first cloud terminal and the second cloud terminal are different.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect.

In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

In an embodiment of the present application, when it is detected that a first client has established a video call connection with a second client of at least one second cloud terminal, a desktop sharing operation button is displayed. When the desktop sharing operation button is triggered, the desktop video stream data is shared to the second client of at least one second cloud terminal, wherein the desktop video stream data includes the screen display content of the first terminal, the first terminal is the operating terminal of the first cloud terminal, and the operating terminals of the first cloud terminal and the second cloud terminal are different, thereby realizing the system capability of internalizing the shared desktop into the cloud terminal, and the sharing parties do not need to install the same application software, and desktop sharing can be achieved through commonly used IM tools.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of the architecture of a cloud server in the related art;

FIG2 is a schematic diagram of a process flow of a desktop sharing method provided in an embodiment of the present application;

FIG3 is a schematic diagram of a first cloud terminal provided in an embodiment of the present application;

FIG4 is a schematic diagram of establishing a communication connection in the related art;

FIG5 is a schematic diagram of an architecture of a cloud phone shared desktop provided in an embodiment of the present application;

FIG6 is another schematic diagram of a process flow of a desktop sharing method provided in an embodiment of the present application;

FIG7 is a schematic diagram of the structure of a desktop sharing device provided in an embodiment of the present application;

FIG8 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

DETAILED DESCRIPTION

The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

In order to better understand the present application, the technologies involved in the present application are described below.

Cloud Phone is a cloud server with native Android operating system and virtual phone functions virtualized from cloud server. Cloud Phone provides interactive control to various users in the form of audio and video streams, allowing users to operate from various clients such as Android, IOS, browser programs, etc. As shown in Figure 1, it is a schematic diagram of the architecture of Cloud Phone. The hardware server can be an ARM server. The hardware server is used to provide hardware resources used by Cloud Phone, including CPU, GPU, memory, storage, etc. The host operating system (such as Linux operating system) runs on the server. On the host operating system, according to the specification design, the hardware resources of the server are allocated to multiple Android operating systems virtualized at the upper layer. Each Android operating system can have an independently allocated storage partition, which can store user data, including user-installed applications and application data. Each Android operating system instance is a remotely controlled cloud phone, which transmits screen, sound and control instructions through the cloud-side SDK on the left and the terminal-side SDK on the right to achieve the use effect of Cloud Phone.

In conjunction with the accompanying drawings, a desktop sharing method, a desktop sharing device, an electronic device and a readable storage medium provided by the embodiments of the present application are described in detail below through specific embodiments and their application scenarios.

FIG2 shows a desktop sharing method provided by an embodiment of the present application, which is applied to a first cloud terminal. The method can be executed by an electronic device, and the electronic device can include: a terminal device. In other words, the method can be executed by software or hardware installed in the electronic device, and the method includes the following steps:

S210: When it is detected that the first client has established a video call connection with a second client of at least one second cloud terminal, a desktop sharing operation button is displayed.

Among them, the first client is the client of the first cloud terminal, and the first client establishes a video call connection with the second client of at least one second cloud terminal, which means that the sharing user conducts a video call with at least one receiving user through the first client, and the first cloud terminal and the second cloud terminal can belong to the same cloud server or different cloud servers. As shown in Figure 3, it is a schematic diagram of a first cloud terminal provided in an embodiment of the present application, wherein a video window 301 can be suspended above the cloud desktop 300 of the first cloud terminal, and the suspension mode can include small window suspension and full screen suspension, and the desktop sharing operation button 302 can also be suspended on the cloud desktop 300. In the present application, the desktop sharing function can be turned on and off through the desktop sharing operation button. Before the sharing operation button is triggered, the video in the video window 301 can be a video captured by the camera of the terminal displaying the first cloud terminal, or a video captured by the camera of the terminal displaying the second cloud terminal, or a combination of the above two.

The first client can be any instant messaging (IM) tool with a video call function, and the second client is a client of the same type as the first client. For example, it is assumed that the IM tools with a video call function installed on the first cloud terminal include client 1, client 2, and client 3, and the IM tools installed on the second cloud terminal include client 1, client 2, client 3, client 4, and client 5. If the first client is client 2, the second client is also client 2. It should be noted that the types of IM tools on the first cloud terminal and at least one second cloud terminal include system built-in and user-defined installations. Therefore, after logging into the cloud desktop, the sender and receiver of desktop sharing can make a video call through the system built-in IM tool.

In S210, no matter which first client the user uses to make a video call with the other party, the desktop sharing operation button is displayed on the cloud desktops of both parties, that is, the display of the desktop sharing operation button is not limited to a specific IM tool.

In addition, the login forms of the first cloud terminal and the second cloud terminal may include client software, applets, and web pages, etc. The user may choose to log in directly through a web page without installing client software.

S220: In response to the triggering operation of the desktop sharing operation button, the desktop video stream data is shared to the second client of at least one of the second cloud terminals through the server.

The desktop video stream data includes screen display content of a first terminal, the first terminal is an operating terminal of the first cloud terminal, and the operating terminals of the first cloud terminal and the second cloud terminal are different.

It is understandable that, when it is detected that the desktop sharing operation button is triggered, the first cloud terminal can share the desktop video stream data to at least one second client through the server. That is to say, when desktop sharing is turned on, the display content of the terminal where the first cloud terminal is located can be synchronized to the second client in real time. It should be noted that the screen display content of the first terminal included in the desktop video stream data can also be the display content selected by the operating user of the first cloud terminal, that is, the operating user selects which content to share, for example, only the display interface of the first cloud terminal is shared.

In an embodiment of the present application, when it is detected that a first client has established a video call connection with a second client of at least one second cloud terminal, a desktop sharing operation button is displayed. When the desktop sharing operation button is triggered, the desktop video stream data is shared to the second client of at least one second cloud terminal, wherein the desktop video stream data includes the screen display content of the first terminal, the first terminal is the operating terminal of the first cloud terminal, and the operating terminals of the first cloud terminal and the second cloud terminal are different, thereby realizing the system capability of internalizing the shared desktop into the cloud terminal, and the sharing parties do not need to install the same application software, and desktop sharing can be achieved through commonly used IM tools.

In one implementation, the first cloud terminal includes a screen recording service, a transfer service, and a video processing service. It should be noted that each cloud terminal includes a screen recording service, a transfer service, and a video processing service. Among them, the screen recording service is used to obtain the desktop video stream data, the transfer service is used to receive the desktop video stream data sent by the screen recording service, and the video processing service is used to share the desktop video stream data to the second client of at least one of the second cloud terminals. Optionally, the screen recording service can be a CameraServer.

Furthermore, in another implementation, before sharing the desktop video stream data to the second client of at least one second cloud terminal, the method includes: recording the screen display content of the first terminal by calling the screen recording service to obtain the desktop video stream data. It is understandable that the screen recording service can be used to record the screen display content of the first cloud terminal, and can also record the screen display content of the first terminal.

Furthermore, in another implementation, the sharing of the desktop video stream data to the second client of at least one of the second cloud terminals includes: obtaining the desktop video stream data sent by the screen recording service by calling the transfer service, and forwarding the desktop video stream data to the video processing service; obtaining the desktop video stream data sent by the transfer service by calling the video processing service, and sending the desktop video stream data to the first client; and sharing the desktop video stream data to the second client of at least one of the second cloud terminals through the first client. That is, the recorded desktop video stream data is first sent by the screen recording service to the transfer service, and then forwarded by the transfer service to the video processing service. The video processing service can discard the video data collected by the camera of the first terminal, and send the desktop video stream data as the target data to the first client, and finally share the desktop video stream data to the second client of at least one of the second cloud terminals through the first client.

Regarding the above-mentioned various implementation methods, it can be understood that in the relevant desktop sharing technology, in order to prevent the network from being blocked, it is necessary to realize the connection between the sharing end and the receiving end through a hole-punching server, that is, as shown in Figure 4, ① the sharing end registers the device with the server, ② the receiving end queries the device from the server, ③ the receiving end initiates a sharing request to the sharing end, and ④ the sharing end sends the screen data to the receiving end. Since the use of a hole-punching server means that it is necessary to rely on a third-party server, if the third-party server fails or restricts access, it will cause sharing failure, and may also increase delay and packet loss rate. Therefore, in the embodiment of the present application, end-to-end connection can be achieved without the use of a network hole-punching server, which can reduce delay and packet loss rate, and through the screen recording service, transit service and video processing service in the cloud terminal, the desktop sharing function with other smart terminals such as Linux, IOS, Windows, etc. is realized.

In one implementation, before the video processing service is called to obtain the desktop video stream data sent by the transit service, the method further includes: discarding the video stream data collected in real time by the camera of the first terminal. It is understandable that before the user triggers the desktop sharing operation button, the video stream data between the first client and the second client is collected by the camera of the first terminal, that is, the data sent to the second client is the video data collected by the camera of the first terminal; after the user triggers the desktop sharing operation button, the video data collected by the camera of the first terminal can be discarded, so that the desktop video stream data is sent to the second terminal, thereby realizing desktop sharing. In another implementation, the video stream data collected in real time by the camera of the first terminal is not discarded, and the video stream data collected in real time by the camera of the first terminal and the desktop video stream data can be sent to the second client at the same time.

In one implementation, after obtaining the desktop video stream data, the method further includes: adjusting the original resolution of the video picture corresponding to the desktop video stream data according to the target resolution of the video picture preset by the first client. Wherein, in another implementation, adjusting the original resolution of the video picture corresponding to the desktop video stream data according to the target resolution of the video picture preset by the first client includes: when the original resolution and the target resolution do not satisfy an equal proportion relationship, preprocessing the video picture corresponding to the desktop video stream data, wherein the resolution of the video picture corresponding to the preprocessed desktop video stream data satisfies an equal proportion relationship with the target resolution. It can be understood that by adjusting the original resolution to a resolution that is equal to the target resolution of the video picture preset by the first client, it can be ensured that the desktop video stream data meets the requirements of the first client or the first cloud terminal during the sharing process, and the compatibility of the video picture can be improved to provide a better user experience.

In order to better illustrate the above embodiments, illustratively, the present application proposes an architectural schematic diagram of a cloud phone sharing desktop. As shown in Figure 5, the first cloud phone includes a desktop, an IM tool, a switch floating button, a screen recording service, a transfer service and a CameraServer, wherein the switch floating button is a system-level floating button provided by the cloud OS layer of the first cloud phone, which can be displayed when making a video call through the IM tool. Clicking the button can turn the shared desktop function on and off. The screen recording service is a service running in the background provided by the cloud OS layer of the first cloud phone. It will start when the sharing function is turned on, record the screen image, and convert it into the size required by IM, and send it to the transfer service. The transfer service is a system resident service provided by the cloud OS layer of the first cloud phone, which is responsible for receiving image data from the screen recording service and forwarding it to the system CameraServer. When the shared desktop function is turned on, the CameraServer will discard the data obtained from the camera and send the video data obtained by the transfer service to the IM tool of the first cloud phone. Figure 6 is another flow diagram of the sharing method proposed by the present application embodiment based on the architectural schematic desktop shown in Figure 5. As shown in Figure 6, the method may include the following steps:

S610: The sharing end and the receiving end establish an IM video call connection.

S620: Automatically display the floating button.

S630: Click the floating button to open the sharing function.

S640: Start the screen recording service to start screen recording, and convert the screen size of the video data into the size set by the IM.

S650: The screen recording service sends the video data to the transfer service.

S660: The transit service sends the video data to CameraServer.

S670: When the CameraServer detects that the sharing function is enabled, it discards the camera data and sends the screen recording data to the IM.

S680: The IM sends the screen recording data to the receiving end.

In the above embodiment, each process in the embodiment shown in Figures 1 to 5 can be implemented. By utilizing the system-level desktop sharing method, the desktop sharing function between the cloud phone and other operating system smart terminals can be realized. The sharing parties do not need to install the same App with specific functions, and there is no need to punch a server through the network. Desktop sharing can be achieved through commonly used IM tools.

FIG. 7 shows a schematic diagram of the structure of a desktop sharing device provided by an embodiment of the present application. As shown in FIG. 7 , the desktop sharing device 700 may include: a display module 710 and a sharing module 720 .

In this embodiment, the display module 710 is used to display a desktop sharing operation button when it is detected that the first client has established a video call connection with the second client of at least one second cloud terminal;

The sharing module 720 is used to share the desktop video stream data to the second client of at least one of the second cloud terminals in response to the triggering operation of the desktop sharing operation button, wherein the desktop video stream data includes the screen display content of the first terminal, the first terminal is the operating terminal of the first cloud terminal, and the operating terminals of the first cloud terminal and the second cloud terminal are different.

In one implementation, the desktop sharing device 700 includes a screen recording service, a transfer service, and a video processing service.

In one implementation, before sharing the desktop video stream data to the second client of at least one of the second cloud terminals, the desktop sharing device 700 is further used to: obtain the desktop video stream data by recording the screen display content of the first terminal by calling the screen recording service.

In one implementation, after obtaining the desktop video stream data, the desktop sharing device 700 is further used to adjust the original resolution of the video picture corresponding to the desktop video stream data according to the target resolution of the video picture preset by the first client.

In one implementation, the original resolution of the video picture corresponding to the desktop video stream data is adjusted according to the target resolution of the video picture preset by the first client, including: when the original resolution and the target resolution do not satisfy a proportional relationship, preprocessing the video picture corresponding to the desktop video stream data, wherein the resolution of the video picture corresponding to the desktop video stream data after the preprocessing satisfies a proportional relationship with the target resolution.

In one implementation, sharing the desktop video stream data to the second client of at least one of the second cloud terminals includes: obtaining the desktop video stream data sent by the screen recording service by calling the transit service, and forwarding the desktop video stream data to the video processing service; obtaining the desktop video stream data forwarded by the transit service by calling the video processing service, and sending the desktop video stream data to the first client; and sharing the desktop video stream data to the second client of at least one of the second cloud terminals through the first client.

In one implementation, before acquiring the desktop video stream data sent by the transfer service by calling the video processing service, the desktop sharing device 700 is further used to discard the video stream data collected in real time by the camera of the first terminal.

A desktop sharing device provided in an embodiment of the present application can implement each process implemented in the embodiments shown in Figures 1 to 6. To avoid repetition, they will not be described here.

The desktop sharing device in the embodiment of the present application may be a device, or a component, an integrated circuit, or a chip in an electronic device. The embodiment of the present application does not specifically limit this.

The desktop sharing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

Optionally, as shown in Figure 8, an embodiment of the present application also provides an electronic device 800, including a processor 801, a memory 802, and a program or instruction stored in the memory 802 and executable on the processor 801. When the program or instruction is executed by the processor 801, each process of the method embodiment shown in Figures 1 to 6 above is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the method embodiments shown in Figures 1 to 6 above are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the method embodiments shown in Figures 1 to 6 above. To avoid repetition, they are not described here.

It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims (10)

1. A desktop sharing method, characterized in that it is applied to a first cloud terminal, and the method comprises: In the case of detecting that the first client has established a video call connection with a second client of at least one second cloud terminal, displaying a desktop sharing operation button; In response to the triggering operation of the desktop sharing operation button, the desktop video stream data is shared to the second client of at least one of the second cloud terminals, wherein the desktop video stream data includes the screen display content of the first terminal, the first terminal is the operating terminal of the first cloud terminal, and the operating terminals of the first cloud terminal and the second cloud terminal are different. 2. The method according to claim 1 is characterized in that the first cloud terminal includes a screen recording service, a transfer service and a video processing service. 3. The method according to claim 2, characterized in that before sharing the desktop video stream data to the second client of at least one second cloud terminal, the method comprises: The desktop video stream data is obtained by calling the screen recording service to record the screen display content of the first terminal. 4. The method according to claim 3, characterized in that after obtaining the desktop video stream data, the method further comprises: According to the target resolution of the video picture preset by the first client, the original resolution of the video picture corresponding to the desktop video stream data is adjusted. 5. The method according to claim 4, characterized in that the step of adjusting the original resolution of the video picture corresponding to the desktop video stream data according to the target resolution of the video picture preset by the first client comprises: When the original resolution and the target resolution do not satisfy a proportional relationship, the video picture corresponding to the desktop video stream data is preprocessed, wherein the resolution of the video picture corresponding to the desktop video stream data after the preprocessing satisfies a proportional relationship with the target resolution. 6. The method according to claim 3, wherein the step of sharing the desktop video stream data to the second client of at least one second cloud terminal comprises: By calling the transfer service, the desktop video stream data sent by the screen recording service is obtained, and the desktop video stream data is forwarded to the video processing service; Acquire the desktop video stream data sent by the transfer service by calling the video processing service, and send the desktop video stream data to the first client; The desktop video stream data is shared to at least one second client of the second cloud terminal through the first client. 7. The method according to any one of claims 3 to 6, characterized in that before acquiring the desktop video stream data sent by the transfer service by calling the video processing service, the method further comprises: The video stream data collected in real time by the camera of the first terminal is discarded. 8. A desktop sharing device, characterized in that it is applied to a first cloud terminal, and the device comprises: A display module, configured to display a desktop sharing operation button when it is detected that the first client has established a video call connection with a second client of at least one second cloud terminal; A sharing module is used to share desktop video stream data to the second client of at least one of the second cloud terminals in response to a triggering operation of the desktop sharing operation button, wherein the desktop video stream data includes the screen display content of the first terminal, the first terminal is the operating terminal of the first cloud terminal, and the operating terminals of the first cloud terminal and the second cloud terminal are different. 9. An electronic device, characterized in that it comprises a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the desktop sharing method according to any one of claims 1 to 7 are implemented. 10. A readable storage medium, characterized in that the readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the desktop sharing method according to any one of claims 1 to 7 are implemented.