CN113961289A - Data processing method, device, equipment and storage medium - Google Patents

Abstract

The present disclosure provides a data processing method, apparatus, device and storage medium, and relates to the technical field of computers, in particular to the technical field of cloud computing, and specifically to a cloud desktop scene. The specific implementation scheme is as follows: acquiring a control event sent by an external terminal; converting the control event according to the event identifier of the control event to obtain a target event; and transmitting the target event to a desktop system in the cloud desktop container so that the desktop system responds to the target event. The present disclosure provides a new solution for implementing cloud desktop technologies based on containers.

Description

A data processing method, apparatus, device and storage medium

technical field

The present disclosure relates to the field of computer technologies, in particular to the field of cloud computing technologies, and in particular to a data processing method, apparatus, device, and storage medium in a cloud desktop scenario.

Background technique

With the development of computer technology, cloud desktop technology has gradually emerged. Cloud desktop, also known as desktop virtualization or cloud computer, is a new model to replace traditional computers. Cloud desktop uses virtualization technology to virtualize various physical devices (such as computer hosts), thereby effectively improving the utilization of resources.

SUMMARY OF THE INVENTION

The present disclosure provides a data processing method, apparatus, device, and storage medium.

According to an aspect of the present disclosure, a data processing method is provided, comprising:

Get control events sent by external terminals;

According to the event identifier of the control event, convert the control event to obtain the target event;

Transmit the target event to the desktop system in the cloud desktop container so that the desktop system responds to the target event.

According to another aspect of the present disclosure, there is provided an electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute any data processing method provided by the embodiments of the present disclosure.

According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is also provided, wherein the computer instructions are used to cause a computer to execute any data processing method provided by the embodiments of the present disclosure.

According to the technology of the present disclosure, the problem that the desktop system in the cloud desktop container cannot directly process the control events sent by the external terminal when the cloud desktop technology is implemented based on the container is solved, and a new solution is provided for implementing the cloud desktop technology based on the container.

It should be understood that what is described in this section is not intended to identify key or critical features of embodiments of the disclosure, nor is it intended to limit the scope of the disclosure. Other features of the present disclosure will become readily understood from the following description.

Description of drawings

The accompanying drawings are used for better understanding of the present solution, and do not constitute a limitation to the present disclosure. in:

1A is a flowchart of a data processing method provided according to an embodiment of the present disclosure;

FIG. 1B is a schematic structural diagram of a cloud desktop container provided according to an embodiment of the present disclosure;

2 is a flowchart of a data processing method provided according to an embodiment of the present disclosure;

3 is a flowchart of a data processing method provided according to an embodiment of the present disclosure;

4 is a schematic diagram of a construction method of a cloud desktop system provided according to an embodiment of the present disclosure;

5 is a flowchart of a data processing method provided according to an embodiment of the present disclosure;

6 is a schematic structural diagram of a data processing apparatus provided according to an embodiment of the present disclosure;

FIG. 7 is a block diagram of an electronic device used to implement the data processing method of an embodiment of the present disclosure.

Detailed ways

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding and should be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted from the following description for clarity and conciseness.

In order to clearly introduce the embodiments of the present disclosure, it should be noted that the cloud desktop technology in the embodiments of the present disclosure is implemented based on containers. Specifically, the electronic devices that provide the cloud desktop services in the embodiments of the present disclosure have low power consumption and high density The design principle is to integrate multiple SoCs (System on Chip, SOC) in a rack server chassis with a set thickness. Each SOC has an independent processor, memory, and storage. At least one available container is deployed on the cloud desktop, and a cloud desktop instance is virtualized in the available container to provide cloud desktop resources. The cloud desktop container involved in this embodiment is the available container of the virtualized cloud desktop instance.

FIG. 1A is a flowchart of a data processing method provided according to an embodiment of the present disclosure, and FIG. 1B is a schematic structural diagram of a cloud desktop container provided according to an embodiment of the present disclosure. The embodiments of the present disclosure are applicable to the situation of how to process data when the cloud desktop technology is implemented based on the container, and especially to the situation of how to process the control event sent by the external terminal. The method can be performed by a data processing device, which can be implemented in software and/or hardware, and can be integrated into an electronic device that provides cloud desktop services, specifically, can be integrated into the information of the cloud desktop container deployed in the electronic device streaming service.

The information flow service may be an intermediate service deployed in the cloud desktop container and established to realize the interaction between the external terminal and the desktop system. For example, it may include, but is not limited to, real-time control streaming services for processing control streaming data, and video streaming services for processing audio and video data. Referring to the cloud desktop container shown in FIG. 1B , the deployed information flow service is a real-time control flow service. Optionally, in the cloud desktop container, a cloud desktop operating system, that is, a desktop system, is also deployed. The desktop system is configured with at least one virtual module that can respond to target events sent by the real-time control flow service, such as a virtual mouse, keyboard, and system settings module, etc.

This embodiment may be specifically executed by the real-time control flow service in the cloud desktop container shown in FIG. 1B . As shown in FIGS. 1A-1B , the data processing method provided in this embodiment may include:

S101: Acquire a control event sent by an external terminal.

The external terminal is an electronic device with the function of forwarding control events or generating control events. Specifically, it may be any device other than the electronic device that provides the cloud desktop service, such as a thin client.

The control event is generated by the external terminal according to the user's operation on the external control device (such as a mouse, a keyboard, a display screen or a cloud desktop client, etc.). For example, the external terminal may determine the event identifier, control operation and event parameters corresponding to the operation according to the user's operation on the external control device, and generate a control event according to the event identifier, control operation and event parameters. Further, the control events may include but are not limited to: mouse control events, keyboard control events, display screen control events, setting events, and the like.

Optionally, in this embodiment, after the external terminal generates the control event, it needs to send the control event to the electronic device of the cloud desktop server. At this time, the electronic device is specifically the real-time control in the cloud desktop container deployed in the electronic device. The streaming service gets the control event.

S102, convert the control event according to the event identifier of the control event to obtain the target event.

The event identifier of the control event may be an identifier representing the type of the control event. Specifically, the same event identifier may be set for the control event triggered by the same external control device. For example, all control events generated by the user operating the mouse have the same event ID. The event identifier may be the identifier of the external control device operated by the user, such as the name or number of the external device. It may also be a unique identifier that is sequentially generated for various types of control events according to preset rules.

Optionally, since the control event is generated by the external terminal according to its custom format, the versatility is poor, and the desktop system in the cloud desktop container cannot directly respond to the control event, so this embodiment requires the information flow service in the cloud desktop container. , that is, the real-time control flow service converts the control events sent by the external terminal into the events in the format supported by the desktop system, that is, the target events. Optionally, when the target events in this embodiment are classified according to types of external control devices, they may include mouse events, keyboard events, display events, and setting events.

Specifically, in this embodiment, when converting the control event according to the event identifier of the control event, the event identifier corresponding to the acquired control event may be determined first, for example, the acquired control event is parsed, and the control event is directly acquired from the parsing result. The event identifier corresponding to the event; the event identifier corresponding to the acquired control event can also be determined according to the analysis result and the association relationship between the locally recorded control event and the event identifier. After the event identifier is determined, then according to the preset association relationship between the event identifier and the conversion logic, determine the conversion logic corresponding to the control event, that is, the conversion logic between the format of the control event generated by the external terminal and the event format supported by the desktop system . And call the conversion logic to convert the control event to get the target event.

Exemplarily, as shown in FIG. 1B , the real-time flow control service of this embodiment includes a custom device adaptation layer, and the custom device adaptation layer is used to perform the operation of converting the control event in this step to obtain the target event, Such as mouse events, keyboard events or set events.

S103, the target event is transmitted to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.

Optionally, the information flow service in the cloud desktop container, that is, the real-time control flow service converts the control event to obtain the target event, and then transmits the target event to the desktop system of the cloud desktop container. It is up to the desktop system to respond to the target event.

Exemplarily, after the real-time flow control service transmits the target event to the desktop system, the desktop system will first determine the virtual module that responds to the event according to the received target event, and transmit the target event to its corresponding virtual module, so that the virtual modules to respond to target events. For example, as shown in FIG. 1B , if the target event is a mouse event, the desktop system will transmit the mouse event to the virtual mouse, so that the virtual mouse responds to the mouse event. If the target event is a keyboard event, the desktop system will transmit the keyboard event to the virtual keyboard so that the virtual keyboard responds to the keyboard event; if the target event is a setting event, the desktop system will transmit the setting event to the system setting module , to make the system setup module respond to the setup event.

In the solution of the embodiment of the present disclosure, after the external terminal sends a control event to the cloud desktop container, the information flow service in the cloud desktop container obtains the control event, converts it into a target event according to the event identifier of the control event, and transmits it to the cloud desktop The desktop system of the container, which responds to the target event. This solution solves the problem that when implementing cloud desktop technology based on containers, the desktop system in the cloud desktop container cannot directly process control events sent by external terminals, and provides a new solution for implementing cloud desktop technology based on containers.

Optionally, in this embodiment, when the cloud desktop container acquires many control events, when performing the operation of transmitting the target event to the desktop system in the cloud desktop container, the operation may further include: adding the target event to the corresponding event identifier. In the event queue of the cloud desktop, the target event in the event queue is transmitted to the desktop system in the cloud desktop container, so that the desktop system can respond to the target event.

Specifically, in this embodiment, a dedicated event queue may be set for the target event corresponding to at least one event identifier. For example, each event identifier may correspond to an event queue. After the control event is converted to obtain the target event, the target event is first added to the event queue corresponding to the event identifier of the target event. When transmitting the target event to the desktop system of the cloud desktop container, multiple event queues can be used to transfer the target event in parallel. The target events contained in each queue are transmitted to the desktop system of the cloud desktop container. Specifically, each target event may be transmitted in parallel to a virtual module in the desktop system that responds to the target event. For example, as shown in FIG. 1B , the mouse event is added to the mouse event queue, and then the mouse event in the mouse event queue is transmitted to the virtual mouse in the desktop system, and the virtual mouse responds to the mouse event. The advantage of this setting in this embodiment is that when the cloud desktop container acquires many control events, the efficiency and accuracy of the cloud desktop container in responding to the control events are improved.

FIG. 2 is a flowchart of another data processing method provided according to an embodiment of the present disclosure. On the basis of the above-mentioned embodiment, this embodiment further describes how to “convert the control event according to the event identifier of the control event to obtain the target event" for a detailed explanation. As shown in FIG. 2, the data processing method provided by this embodiment may include:

S201, acquiring a control event sent by an external terminal.

S202: Decode the control event, and obtain the event identifier of the control event from the decoding result.

Optionally, in order to ensure the security of the control event, when the external terminal generates the control event, it can first obtain the event attribute information required to generate the control event, such as the event identifier, control operation and event parameters, and then use the attribute information according to the automatic After the defined format (such as event identifier-control operation-event parameter) is combined and encoded (such as binary encoding), a control event is obtained, and the generated control event is then sent to the cloud desktop container. At this time, the control event sent by the external terminal acquired in this embodiment is the encoded result, not the original text of the required data. Therefore, in this step, it is necessary to decode the received control event according to the decoding rule corresponding to the external terminal coding control event to obtain the decoding result, that is, the attribute information of the control event combined according to the self-defined format, and then parse the decoding result. , from which the event identifier corresponding to the control event is extracted.

S203, according to the event identifier, determine the conversion logic of the control event.

The conversion logic of the control event may be the processing logic of converting the control event of the custom format generated by the external terminal into the event format supported by the desktop system.

Optionally, in this embodiment, the electronic device that provides the cloud desktop service may pre-store the association relationship between the event identifiers of different external terminals and the conversion logic. In this case, the conversion logic associated with the event identifier determined in S202 may be searched from the association relationship between the locally stored event identifier of the external terminal and the conversion logic, as the conversion logic of the received control event.

Optionally, if the electronic device does not store the association between the event identifier and the conversion logic locally, the electronic device can also communicate with other external devices (the external device may be an external terminal that sends a control event, or it may not be, This is not limited) and interact to obtain the conversion logic associated with the event identifier determined in S202 as the conversion logic of the received control event.

S204, generate a target event according to the decoding result and the conversion logic.

Specifically, in this embodiment, based on the decoding result obtained by decoding the control event in S202, the conversion logic determined in S203 may be invoked to generate the target event.

S205, the target event is transmitted to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.

In the solution of the embodiment of the present disclosure, after the external terminal sends a control event to the cloud desktop container, the information flow service in the cloud desktop container obtains the control event, decodes the control event, and determines the conversion corresponding to the control event according to the decoding result. logic, and based on the conversion logic and decoding results, a target event is generated and transmitted to the desktop system of the cloud desktop container, and the desktop system responds to the target event. The events that the cloud desktop container interacts with the external terminal in this solution are encoded data, not the original data, and are not easy to be cracked, which improves the security of control events. In addition, the encoded events can also minimize the amount of data transmission and avoid waste of resources.

FIG. 3 is a flowchart of another data processing method provided according to an embodiment of the present disclosure. On the basis of the above-mentioned embodiment, this embodiment further describes how to “convert the control event according to the event identifier of the control event to obtain the target event" for a detailed explanation. As shown in FIG. 3 , the data processing method provided in this embodiment may include:

S301: Acquire a control event sent by an external terminal.

S302 , in the case of identifying that the attribute information of the control event is valid, convert the control event according to the event identifier of the control event to obtain the target event.

Wherein, the attribute information of the control event may be related information representing the attribute of the control event, for example, may include but not limited to: an event identifier, a control operation, and an event parameter. Wherein, the control operation is the user's operation on the external control device. For example, when the external control device is a mouse, the control operation can be a left-click, right-click, pulley, etc.; when the external control device is a keyboard, the control operation can be The action of hitting different keys on the keyboard. The event parameters may include parameter values, parameter lengths, and event generation times corresponding to different events.

Optionally, in order to ensure the security and accuracy of the control events processed by the cloud desktop container, the information flow service in this embodiment needs to identify whether the attribute information of the received control events is first before processing the received control events. Valid, for the control event with valid attribute information, the subsequent event conversion and other operations are performed; for the control event with invalid attribute information, the subsequent event conversion and other operations are no longer performed.

Optionally, this embodiment identifies that the attribute information of the control event is valid may include at least one of the following: the event identifier of the identified control event is a valid identifier. The control operations identified with the control event are valid operations supported by the event identifier. The event parameter of the identified control event matches the valid parameter range. Specifically, in this embodiment, a preset valid event identifier, valid operations supported by various types of event identifiers, and valid parameter ranges (such as valid parameter value ranges, valid At least one of the parameter length range and the valid event period), correspondingly, the information flow service in the cloud desktop container, that is, the real-time flow control service attribute information to identify the validity of the acquired control event. In this embodiment, the validity of the control event is verified through various types of attribute information, which further improves the security and flexibility of the validity verification process.

S303, the target event is transmitted to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.

In the solution of the embodiment of the present disclosure, after the external terminal sends the control event to the cloud desktop container, the information flow service in the cloud desktop container obtains the control event. The event identifier is converted into a target event and transmitted to the desktop system of the cloud desktop container, and the desktop system responds to the target event. After receiving the control event, the cloud desktop container of this solution does not respond directly, but first recognizes its validity and then responds, which improves the security and accuracy of event response.

FIG. 4 is a schematic diagram of a construction method of a cloud desktop system provided according to an embodiment of the present disclosure. As shown in FIG. 4 , the cloud desktop system of the embodiment of the present disclosure is built in an advanced reduced instruction set processor ARM chip server, and the server includes: a CPU (central processing unit, central processing unit), a Mali GPU (Graphics Processing Unit, graphics processor) and NIC (network interface controller). The operating system of the server is the Linux operating system, specifically the ubuntu operating system. Before using this operating system, you need to set Linux system parameters, such as namespace parameters (namespace), container parameters (cgroup), file system service parameters (overlayfs), mount file parameters (autofs), and bridge parameters (bridge). In this embodiment, a container manager can be deployed in the ARM chip of the server, and the container manager is used to dynamically manage the deployment situation of the cloud desktop container in the ARM chip. For example, the number of containers deployed in the ARM chip server can be increased or decreased according to the cloud desktop instances running on demand and the available resources of the current ARM chip server. In a cloud desktop container in this embodiment, the cloud desktop container runtime (ie, the running environment of the cloud desktop), the information flow service (ie, the video streaming service and the real-time control streaming service), and the desktop system are deployed. Third-party applications can be installed and run on the desktop system. The embodiments of the present disclosure can dynamically deploy cloud desktop containers in an ARM chip server through a container manager, and can adjust the number of cloud desktop containers according to actual usage requirements. The way the computer runs the cloud desktop system improves the resource utilization of the server.

FIG. 5 is a flowchart of a data processing method provided according to an embodiment of the present disclosure. Based on the cloud desktop system shown in FIG. 4 , this embodiment provides a preferred example of a container-based data processing method for implementing cloud desktop technology. As shown in FIG. 5 , the data processing method provided by this embodiment may include:

S501, the real-time control flow service acquires a control event sent by an external terminal.

S502, the real-time control flow service converts the control event according to the event identifier of the control event to obtain the target event.

S503, the real-time control flow service transmits the target event to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.

S504, the video stream push service processes the collected audio and video data through the advanced reduced instruction set processor RAM configured on the local device.

The video streaming service is a service for pushing audio and video data (ie, audio data and/or video data) to an external device. In this embodiment, processing the collected audio and video data may include, but is not limited to, transcoding processing and encoding processing. In addition, the video stream push service in this embodiment is based on the MaliGPU (Graphics Processing Unit, graphics processor) provided by the advanced reduced instruction set processor ARM to process the collected audio and video data.

Specifically, the video streaming service will collect the audio data and/or video data currently to be displayed on the cloud desktop from the resource storage area of the cloud desktop service in real time during the running process of the cloud desktop. Affected by factors such as data compression, transmission bandwidth, and playback format, it is usually necessary to transcode and encode video data (such as H264 video stream encoding) by the video streaming service in the target container using the Mali GPU that comes with ARM. operate to obtain a video stream; perform operations such as encoding audio data to obtain an audio stream, and then transmit the encoded video stream and/or audio stream to an external terminal, such as a thin client. After receiving the video data, the external terminal decodes and transcodes the video stream to obtain video data, which is displayed on the display device; decodes the audio stream to obtain audio data, which is output through the sound output device.

Because the way of relying on CPU for soft decoding consumes too much hardware resources, for cloud desktop application scenarios where computing resources are extremely precious, it is likely to cause the desktop transmission image to freeze, which directly affects the user experience of the operator. The embodiment of the present disclosure can perform hardware encoding and decoding based on the Mali GPU (Graphics Processing Unit, graphics processor) that comes with the advanced reduced instruction set processor ARM, and perform the rendering and output of audio and video data, which greatly exerts the hardware characteristics of the GPU, and further Reduced desktop response latency and CPU resource consumption. The utilization rate of resources is improved, and the resource overhead of implementing cloud desktops is reduced.

On the basis of the foregoing technical solutions, the present disclosure also provides an optional embodiment of an execution apparatus for implementing the foregoing data processing methods. Further referring to a data processing apparatus 600 shown in FIG. 6 , it is configured in an electronic device that provides a cloud desktop service, and may be configured in an information flow service in a cloud desktop container deployed in the electronic device. The apparatus 600 includes: an event acquisition module 601 , an event conversion module 602 and an event transmission module 603 . in,

an event acquisition module 601, configured to acquire a control event sent by an external terminal;

The event conversion module 602 is used to convert the control event according to the event identifier of the control event to obtain the target event;

The event transmission module 603 is configured to transmit the target event to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.

In the solution of the embodiment of the present disclosure, after the external terminal sends a control event to the cloud desktop container, the information flow service in the cloud desktop container acquires the control event, converts it into a target event according to the event identifier of the control event, and transmits it to the cloud desktop The container's desktop system, which responds to the target event. This solution solves the problem that the desktop system in the cloud desktop container cannot directly process the control events sent by the external terminal when the cloud desktop technology is implemented based on the container, and provides a new solution for implementing the cloud desktop technology based on the container.

Further, the event conversion module 602 is specifically used for:

Decode the control event, and obtain the event identifier of the control event from the decoding result;

Determine the conversion logic of the control event according to the event identifier;

Based on the decoding result and transformation logic, the target event is generated.

Further, the event conversion module 602 includes:

A validity identification unit, used to identify whether the attribute information of the control event is valid;

The event conversion unit is configured to convert the control event according to the event identifier of the control event when it is recognized that the attribute information of the control event is valid.

Further, the validity identification unit is specifically configured to perform at least one of the following:

The event ID of the identified control event is a valid ID;

The control operation that identifies the control event is a valid operation supported by the event identifier;

The event parameter of the identified control event matches the valid parameter range.

Further, the event transmission module 603 is specifically used for:

Add the target event to the event queue corresponding to the event ID;

Transfer the target event in the event queue to the desktop system in the cloud desktop container.

Further, the above-mentioned data processing apparatus 600 also includes:

The video stream processing module is used to process the collected audio and video data through the advanced reduced instruction set processor configured on the local device.

The above product can execute the method provided by any embodiment of the present disclosure, and has corresponding functional modules and beneficial effects for executing the method.

In the technical solutions of the present disclosure, the acquisition, storage, and application of the control events and audio and video data involved comply with the provisions of relevant laws and regulations, and do not violate public order and good customs.

According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

FIG. 7 shows a schematic block diagram of an example electronic device 700 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.

As shown in FIG. 7 , the device 700 includes a computing unit 701 that can be executed according to a computer program stored in a read only memory (ROM) 702 or loaded into a random access memory (RAM) 703 from a storage unit 708 Various appropriate actions and handling. In the RAM 703, various programs and data necessary for the operation of the device 700 can also be stored. The computing unit 701 , the ROM 702 , and the RAM 703 are connected to each other through a bus 704 . An input/output (I/O) interface 705 is also connected to bus 704 .

Various components in the device 700 are connected to the I/O interface 705, including: an input unit 706, such as a keyboard, mouse, etc.; an output unit 707, such as various types of displays, speakers, etc.; a storage unit 708, such as a magnetic disk, an optical disk, etc. ; and a communication unit 709, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 709 allows the device 700 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.

Computing unit 701 may be various general-purpose and/or special-purpose processing components with processing and computing capabilities. Some examples of computing units 701 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various specialized artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc. Preferably, the GPU in this embodiment is the MaliGPU that comes with the ARM chip. The computing unit 701 executes the various methods and processes described above, such as data processing methods. For example, in some embodiments, a data processing method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 708 . In some embodiments, part or all of the computer program may be loaded and/or installed on device 700 via ROM 702 and/or communication unit 709 . When a computer program is loaded into RAM 703 and executed by computing unit 701, one or more steps of the data processing method described above may be performed. Alternatively, in other embodiments, the computing unit 701 may be configured to perform the data processing method by any other suitable means (eg, by means of firmware).

Various implementations of the systems and techniques described herein above may be implemented in digital electronic circuitry, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips system (SOC), load programmable logic device (CPLD), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpretable on a programmable system including at least one programmable processor that The processor, which may be a special purpose or general-purpose programmable processor, may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device an output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer or other programmable data processing apparatus, such that the program code, when executed by the processor or controller, performs the functions/functions specified in the flowcharts and/or block diagrams. Action is implemented. The program code may execute entirely on the machine, partly on the machine, partly on the machine and partly on a remote machine as a stand-alone software package or entirely on the remote machine or server.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with the instruction execution system, apparatus or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.

To provide interaction with a user, the systems and techniques described herein may be implemented on a computer having a display device (eg, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user ); and a keyboard and pointing device (eg, a mouse or trackball) through which a user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (eg, visual feedback, auditory feedback, or tactile feedback); and can be in any form (including acoustic input, voice input, or tactile input) to receive input from the user.

The systems and techniques described herein may be implemented on a computing system that includes back-end components (eg, as a data server), or a computing system that includes middleware components (eg, an application server), or a computing system that includes front-end components (eg, a user computer having a graphical user interface or web browser through which a user may interact with implementations of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system may be interconnected by any form or medium of digital data communication (eg, a communication network). Examples of communication networks include: Local Area Networks (LANs), Wide Area Networks (WANs), blockchain networks, and the Internet.

A computer system can include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also known as a cloud computing server or a cloud host. It is a host product in the cloud computing service system to solve the traditional physical host and VPS services, which are difficult to manage and weak in business scalability. defect. The server can also be a server of a distributed system, or a server combined with a blockchain.

Artificial intelligence is the study of making computers to simulate certain thinking processes and intelligent behaviors of people (such as learning, reasoning, thinking, planning, etc.), both hardware-level technology and software-level technology. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, and big data processing; artificial intelligence software technologies mainly include computer vision technology, speech recognition technology, natural language processing technology, and machine learning/depth Learning technology, big data processing technology, knowledge graph technology and other major directions.

Cloud computing refers to accessing elastically scalable shared physical or virtual resource pools through the network. Resources can include servers, operating systems, networks, software, applications and storage devices, etc., and can be self-service on demand and on demand. A technical system for deploying and managing resources in a way. Through cloud computing technology, it can provide efficient and powerful data processing capabilities for artificial intelligence, blockchain and other technical applications and model training.

It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, the steps described in the present disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, no limitation is imposed herein.

The above-mentioned specific embodiments do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent replacements, and improvements made within the spirit and principles of the present disclosure should be included within the protection scope of the present disclosure.

Claims (16)

1. A data processing method, comprising: Get control events sent by external terminals; According to the event identifier of the control event, the control event is converted to obtain the target event; The target event is transmitted to the desktop system in the cloud desktop container, so that the desktop system responds to the target event. 2. The method according to claim 1, wherein, converting the control event according to the event identifier of the control event to obtain a target event, comprising: Decoding the control event, and obtaining the event identifier of the control event from the decoding result; Determine the conversion logic of the control event according to the event identifier; A target event is generated according to the decoding result and the conversion logic. 3. The method according to claim 1, wherein the converting the control event according to the event identifier of the control event comprises: When it is recognized that the attribute information of the control event is valid, the control event is converted according to the event identifier of the control event. 4. The method according to claim 3, wherein the attribute information of the identified control event is valid, comprising at least one of the following: Identifying the event identifier of the control event as a valid identifier; Identifying the control operation of the control event as a valid operation supported by the event identifier; The event parameter of the control event is identified as being within the valid parameter range. 5. The method according to claim 1, wherein transmitting the target event to the desktop system in the cloud desktop container comprises: adding the target event to the event queue corresponding to the event identifier; The target event in the event queue is transmitted to the desktop system in the cloud desktop container. 6. The method of claim 1, further comprising: The collected audio and video data are processed through the advanced reduced instruction set processor configured on the local device. 7. A data processing device, comprising: The event acquisition module is used to acquire the control events sent by the external terminal; an event conversion module, configured to convert the control event according to the event identifier of the control event to obtain a target event; An event transmission module, configured to transmit the target event to the desktop system in the cloud desktop container, so that the desktop system responds to the target event. 8. The apparatus according to claim 7, wherein the event conversion module is specifically used for: Decoding the control event, and obtaining the event identifier of the control event from the decoding result; Determine the conversion logic of the control event according to the event identifier; A target event is generated according to the decoding result and the conversion logic. 9. The apparatus of claim 7, wherein the event conversion module comprises: a validity identification unit, used to identify whether the attribute information of the control event is valid; An event conversion unit, configured to convert the control event according to the event identifier of the control event when the attribute information of the control event is identified as valid. 10. The apparatus according to claim 9, wherein the validity identification unit is specifically configured to perform at least one of the following: Identifying the event identifier of the control event as a valid identifier; Identifying the control operation of the control event as a valid operation supported by the event identifier; The event parameters identified for the control event conform to valid parameter ranges. 11. The apparatus according to claim 7, wherein the event transmission module is specifically configured to: adding the target event to the event queue corresponding to the event identifier; The target event in the event queue is transmitted to the desktop system in the cloud desktop container. 12. The apparatus of claim 7, further comprising: The video stream processing module is used to process the collected audio and video data through the advanced reduced instruction set processor configured on the local device. 13. An electronic device comprising: at least one processor; and a memory communicatively coupled to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the execution of any of claims 1-6 data processing method. 14. The electronic device of claim 13, wherein, The at least one processor is an advanced reduced instruction set processor. 15. A non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the data processing method of any one of claims 1-6. 16. A computer program product comprising a computer program which, when executed by a processor, implements the data processing method according to any of claims 1-6.

Images