CN114079809A - Terminal and input method and device thereof - Google Patents

Terminal and input method and device thereof Download PDF

Info

Publication number
CN114079809A
CN114079809A CN202010845515.7A CN202010845515A CN114079809A CN 114079809 A CN114079809 A CN 114079809A CN 202010845515 A CN202010845515 A CN 202010845515A CN 114079809 A CN114079809 A CN 114079809A
Authority
CN
China
Prior art keywords
information
terminal
interface
input
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010845515.7A
Other languages
Chinese (zh)
Inventor
杨婉艺
丁宁
范振华
吴谢私月
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202010845515.7A priority Critical patent/CN114079809A/en
Publication of CN114079809A publication Critical patent/CN114079809A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440236Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/221Announcement of recognition results

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供了一种终端及其输入方法与装置,包括:接收第二终端发送的第一消息,显示第一界面,第一消息包括用于指示将第二终端上第二界面中视图信息投屏至第一终端的投屏指令;接收第二终端发送的第二消息,第二消息包括第二界面或第二界面中第二输入控件的身份标识;基于身份标识配置第一输入控件;响应用户在第一输入控件上的第一操作,生成用于提示用户输入信息第一事件;响应用户的输入操作显示用户输入的第一信息;响应用户下发的信息发送指令,向第二终端发送第三消息,第三消息包括第一信息和第一指令,第一指令用于指示第二终端发送第一信息并在第二界面显示第一信息。该方法利用第一输入控件进行输入操作,实现了跨设备的输入操作。

Figure 202010845515

The present application provides a terminal and an input method and device thereof, including: receiving a first message sent by a second terminal, and displaying a first interface, where the first message includes instructions for displaying view information in the second interface on the second terminal. screen-casting instruction to the first terminal; receiving a second message sent by the second terminal, where the second message includes the identity of the second interface or the second input control in the second interface; configuring the first input control based on the identity; responding The user's first operation on the first input control generates a first event for prompting the user to input information; the first information input by the user is displayed in response to the user's input operation; the information sending instruction sent by the user is sent to the second terminal. The third message, where the third message includes first information and a first instruction, where the first instruction is used to instruct the second terminal to send the first information and display the first information on the second interface. The method utilizes the first input control to perform the input operation, and realizes the cross-device input operation.

Figure 202010845515

Description

Terminal and input method and device thereof
Technical Field
The present application relates to the field of terminal technologies, and in particular, to a terminal and an input method and apparatus thereof.
Background
With the development of smart home technology, a user or a home often has a plurality of electronic devices capable of communicating with each other. The electronic device can display the multimedia data among a plurality of devices in a screen projection mode and the like. For example, when a user watches a video by using an ipad, the user can screen a chat interface in a mobile phone onto the ipad, so that the content of the chat interface on the mobile phone can be viewed on the ipad, wherein the mobile phone can be set as a source device, and the ipad can be set as a different device. However, at present, although a user can view content in a display interface projected by a source device at a different-end device, the user is difficult to perform related control on the display interface at the different-end device, and user experience is poor.
Disclosure of Invention
The embodiment of the application provides electronic equipment and an input method and device thereof, and can configure a first input control on a first terminal when a second terminal maps a second interface of the second terminal to the first terminal, and perform input operation by using the first input control, so that cross-equipment input operation is realized.
In a first aspect, an embodiment of the present application provides an input method, applied to a first terminal, including:
receiving a first message sent by a second terminal, and displaying a first interface, wherein the first message comprises a screen projection instruction, the screen projection instruction is used for indicating that view information in a second interface on the second terminal is projected to the first terminal, and the first interface is used for displaying the view information;
receiving a second message sent by a second terminal, wherein the second message comprises a first identity identifier, and the first identity identifier comprises a second interface or an identity identifier of a second input control in the second interface;
configuring a first input control based on the first identity;
responding to a first operation of a user on a first input control, and generating a first event, wherein the first event is used for prompting the user to input information;
responding to the input operation of a user, and displaying first information input by the user on a first input control;
and responding to an information sending instruction sent by the user, sending a third message to the second terminal, wherein the third message comprises first information and a first instruction, and the first instruction is used for indicating the second terminal to send the first information and displaying the first information on a second interface.
In one possible implementation manner, the first operation includes a touch duration, and the generating of the first event in response to the first operation of the user on the first input control includes:
determining that the touch duration is greater than a first preset duration, and prompting a user to input voice information;
and determining that the touch duration is less than or equal to a first preset duration, and displaying the text input assembly in the first input control.
In one possible implementation, the method further includes:
determining the first event as prompting the user to input voice information, and generating a second event, wherein the second event comprises displaying the remaining time for voice input on the first input control and/or continuing to play the information displayed in a third interface on the first terminal, or
And determining the first event as displaying a text input component in the first input control, and generating a third event, wherein the third event comprises pausing information which is displayed in a third interface on the first terminal.
In one possible implementation, the method further includes:
and presenting a time shifting progress bar on the first input control, wherein the time shifting progress bar is used for indicating a second remaining time length which can be input.
In one possible implementation, in response to an input operation by a user, displaying first information input by the user on a first input control, the method includes:
determining that the input operation is a voice input operation, converting the received voice information into text information, and displaying the text information, wherein the text information is first information.
In one possible implementation, the method further includes:
and generating a fourth event in response to a second operation of the user on the input control, wherein the second operation comprises sliding on the first input control, and the fourth event comprises clearing all or part of the first information, prolonging the residual time for which voice input can be carried out or canceling the sending of the first information.
In one possible implementation, the generating of the fourth event in response to the second operation of the user on the input control includes:
determining that the second operation is left sliding, the speed of the left sliding is greater than the first speed, and clearing all information in the first information;
determining that the second operation is left sliding, the speed of the left sliding is less than or equal to the first speed, determining the initial position and the stop position of the left sliding of the user, and clearing the information between the initial position and the stop position in the first information;
determining that the second operation is right sliding, and prolonging the residual time length for voice input;
and determining that the second operation is an upward slide, and canceling the sending of the first information.
In one possible implementation, the method further includes:
and generating a fifth event in response to a third operation of the user on the first interface, wherein the third operation comprises dragging the first interface, and the fifth event comprises moving the first interface to a position where the user stops dragging on the first terminal.
In a possible implementation manner, after the generating the fifth event, the method further includes:
and determining that the interface edges of the first interface are far away from the display edges of the display components on the first terminal, and generating a sixth event, wherein the sixth event comprises the step of moving any interface edge of the first interface to any display edge of the display components.
In one possible implementation, the area of the first interface is smaller than the display area of the display component on the first terminal.
In one possible implementation, the transparency of the first interface is greater than a preset transparency threshold.
In a second aspect, an embodiment of the present application provides an input method, applied to a second terminal, including:
responding to a fourth operation of the user, sending a first message to the first terminal so as to enable the first terminal to display a first interface, wherein the first message comprises a screen projection instruction, the screen projection instruction is used for instructing screen projection of view information in a second interface on the second terminal to the first terminal, and the first interface is used for displaying the view information;
sending a second message to the first terminal, wherein the second message comprises a first identity identifier, and the first identity identifier comprises an identity identifier of a second input control in the second interface or the second interface, so that the first terminal configures the first input control based on the first identity identifier;
receiving a third message sent by the first terminal, wherein the third message comprises first information and a first instruction, the first information is information input by a user on the first input control, and the first instruction is used for indicating the second terminal to send the first information and displaying the first information on a second interface;
the first information is sent, and the first information is displayed on the second interface.
In a third aspect, an embodiment of the present application provides an input apparatus, including:
a memory for storing a program;
a processor for executing the memory-stored program, the processor being adapted to perform the method of the first or second aspect when the memory-stored program is executed.
In a fourth aspect, an embodiment of the present application provides a terminal, including the input device in the third aspect.
In a fifth aspect, embodiments of the present application provide a computer storage medium having instructions stored therein, which when executed on a computer, cause the computer to perform the method of the first aspect or the second aspect.
In a sixth aspect, embodiments of the present application provide a computer program product comprising instructions which, when executed on a computer, cause the computer to perform the method of the first or second aspect.
In a seventh aspect, an embodiment of the present application provides a chip, which includes at least one processor and an interface;
an interface for providing program instructions or data to at least one processor;
the at least one processor is configured to execute the program line instructions to implement the method of the first aspect or the second aspect.
According to the electronic equipment and the input method and device thereof, when the second terminal maps the second interface of the second terminal to the first terminal, the first input control is configured on the first terminal, and the first input control is used for input operation, so that cross-equipment input operation is realized.
Drawings
Fig. 1 is a schematic system architecture diagram of an input method according to an embodiment of the present application;
fig. 2 is a schematic hardware structure diagram of a terminal according to an embodiment of the present disclosure;
FIG. 3 is a communication diagram of an input method provided by an embodiment of the present application;
FIG. 4 is a schematic diagram illustrating an application of an input method provided in an embodiment of the present application;
fig. 5a is a schematic view of a display interface of a terminal according to an embodiment of the present application;
fig. 5b is a schematic view of a display interface of a terminal according to an embodiment of the present application;
fig. 5c is a schematic view of a display interface of a terminal according to an embodiment of the present application;
fig. 6a is a schematic view of a display interface of a terminal according to an embodiment of the present application;
fig. 6b is a schematic view of a display interface of a terminal according to an embodiment of the present application;
fig. 6c is a schematic view of a display interface of a terminal according to an embodiment of the present application;
FIG. 7 is a flowchart illustrating an operation of an input method according to an embodiment of the present application;
FIG. 8 is a schematic structural diagram of an input device according to an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of a chip according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions of the embodiments of the present application will be described below with reference to the accompanying drawings.
In the description of the embodiments of the present application, the words "exemplary," "for example," or "for instance" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary," "e.g.," or "e.g.," is not to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the words "exemplary," "e.g.," or "exemplary" is intended to present relevant concepts in a concrete fashion.
In the description of the embodiments of the present application, the term "and/or" is only one kind of association relationship describing an associated object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, B exists alone, and A and B exist at the same time. In addition, the term "plurality" means two or more unless otherwise specified. For example, the plurality of systems refers to two or more systems, and the plurality of terminals refers to two or more terminals.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicit indication of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.
Referring to fig. 1, fig. 1 is a schematic diagram of a system architecture of an input method according to an embodiment of the present application. As shown in fig. 1, the system includes a first terminal 11 and a second terminal 12, wherein the first terminal 11 and the second terminal 12 are connected through a network 13. The second interface on the second terminal 12 may be mapped onto the first terminal 11, for example, by means of a screen shot. When the second interface is mapped to the first terminal 11, the first terminal 11 may draw and display the first interface, where view information in the first interface is consistent with view information in the second interface; in other words, the first interface is a mapping interface of the second terminal on the first terminal. Meanwhile, the first terminal 11 may be configured with a first input control through which a user may perform an input operation on the first terminal 11, where the first input control has a mapping relationship with a second interface in the second terminal 12 or a second input control in the second interface. When the user performs an input operation through the first input control, first information input by the user can be displayed on the first input control. After determining that the user finishes the input operation, the first terminal 11 may send a third message to the second terminal 11 through the network 13, where the third message includes the first information and a first instruction, and the first instruction may instruct the second terminal 12 to send the first information in the second interface. The second terminal 12 may send the first information in the second interface and display the first information on the second interface after receiving the second message. Thus, when the second terminal 12 maps the second interface thereof to the first terminal 11, the first input control is configured on the first terminal 11, and the first input control is used for performing input operation, thereby realizing cross-device input operation.
In some embodiments, the first terminal 11 and/or the second terminal 12 may be a mobile phone, a tablet computer, a digital camera, a Personal Digital Assistant (PDA), a wearable device, a smart television, a smart screen, or other electronic devices. Exemplary embodiments of the electronic device include, but are not limited to, an electronic device that hosts an iOS, android, Windows, dammon system (Harmony OS), or other operating system. The electronic device may also be other electronic devices such as a laptop computer (laptop) with a touch sensitive surface (e.g., a touch panel), etc. The embodiment of the present application does not specifically limit the type of the electronic device.
In some embodiments, the network 13 may be a Wired network (Wired network) or a wireless network (wireless network), etc. For example, the network 13 may be a Local Area Network (LAN) or a Wide Area Network (WAN) (e.g., the internet). The network 13 may be implemented using any known network communication protocol, which may be any of various wired or wireless communication protocols, such as ethernet, Universal Serial Bus (USB), firewire (firewire), global system for mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), time division code division multiple access (TD-SCDMA), long term evolution (long term evolution, LTE), new air interface (new, NR), bluetooth (bluetooth), wireless fidelity (Wi-Fi), and so on.
A schematic diagram of a hardware structure of a terminal in the embodiment of the present application is described below. Wherein the terminal is the first terminal 11 and/or the second terminal 12.
Fig. 2 shows a hardware configuration diagram of the terminal. As shown in fig. 2, the terminal 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identification Module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.
It is to be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation to the terminal 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
The processor 110 may include one or more processing units, for example, the processor 110 may include one or more of an Application Processor (AP), a modem (modem), a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural Network Processor (NPU), among others. The different processing units may be separate devices or may be integrated into one or more processors.
A memory may also be provided in processor 110 for storing instructions and data. In some examples, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory to avoid repeated accesses, reduce the waiting time of the processor 110, and improve the efficiency of the system. In some examples, the processor 110 may be used to draw a first interface, configure a first input control, generate a first event, a second event, a third event, and so on.
In some examples, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a Universal input/output (GPIO), a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, and the like.
The charging management module 140 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging examples, the charging management module 140 may receive charging input of a wired charger through the USB interface 130. In some examples of wireless charging, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the terminal 100. The charging management module 140 may also supply power to other terminals through the power management module 141 while charging the battery 142.
The power management module 141 is used for connecting the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In other examples, the power management module 141 may also be disposed in the processor 110. In other examples, the power management module 141 and the charging management module 140 may be disposed in the same device.
The wireless communication function of the terminal 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem, a baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in terminal 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other examples, the antenna may be used in conjunction with a tuning switch.
The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication and the like applied to the terminal 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive electromagnetic waves from at least two antennas including the antenna 1, filter, amplify, and transmit the received electromagnetic waves to a modem for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some examples, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some examples, at least some of the functional modules of the mobile communication module 150 may be disposed in the same device as at least some of the modules of the processor 110.
The modem may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some examples, the modem may be a stand-alone device. In other examples, the modem may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110. In other examples, mobile communication module 150 may be a module in a modem.
The wireless communication module 160 may provide solutions for wireless communication applied to the terminal 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.
In some examples, antenna 1 of terminal 100 is coupled to mobile communication module 150 and antenna 2 is coupled to wireless communication module 160 so that terminal 100 can communicate with networks and other devices via wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), Wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), Long Term Evolution (LTE), fifth generation, new air interface (new radio, NR), BT, GNSS, WLAN, NFC, FM, and/or I R technologies, and the like. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).
The terminal 100 implements a display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-o led, a quantum dot light-emitting diode (QLED), and the like. In some examples, terminal 100 may include one or more display screens 194.
The terminal 100 may implement a photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.
The ISP is used to process the data fed back by the camera 193. For example, when shooting, a shutter is opened, light is transmitted to a camera photosensitive element through a lens, an optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to an ISP (internet service provider) for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some examples, the ISP may be provided in camera 193.
The camera 193 is used to capture still images or video, for example, capturing facial feature information, pose feature information, and the like of a person. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some examples, terminal 100 may include one or more cameras 193.
The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the terminal 100 selects a frequency bin, the digital signal processor is configured to perform fourier transform or the like on the frequency bin energy.
Video codecs are used to compress or decompress digital video. The terminal 100 may support one or more video codecs. In this way, the terminal 100 can play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.
The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the terminal 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.
The internal memory 121 may be used to store computer-executable program code, which includes instructions. The processor 110 executes various functional applications of the terminal 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (e.g., audio data, a phonebook, etc.) created during use of the terminal 100, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.
The terminal 100 can implement an audio function through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playing, recording, etc.
The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some examples, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.
The speaker 170A, also called a "horn", is used to convert the audio electrical signal into an acoustic signal. The terminal 100 can listen to music through the speaker 170A or listen to a handsfree call.
The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the terminal 100 receives a call or voice information, it can receive voice by bringing the receiver 170B close to the human ear.
The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal to the microphone 170C by speaking the user's mouth near the microphone 170C. The terminal 100 may be provided with at least one microphone 170C. In other examples, the terminal 100 may be provided with two microphones 170C to implement a noise reduction function in addition to collecting sound signals. In other embodiments, the terminal 100 may further include three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, implement directional recording functions, and so on.
The headphone interface 170D is used to connect a wired headphone. The headset interface 170D may be the USB interface 130, or may be a 3.5mm open mobile platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.
The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.
The pressure sensor 180A is used for sensing a pressure signal, and converting the pressure signal into an electrical signal. In some examples, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A can be of a wide variety, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The terminal 100 determines the intensity of the pressure according to the change in the capacitance. When a touch operation is applied to the display screen 194, the terminal 100 detects the intensity of the touch operation according to the pressure sensor 180A. The terminal 100 may also calculate the touched position based on the detection signal of the pressure sensor 180A. In some examples, touch operations that act on the same touch location but at different touch operation intensities may correspond to different operation instructions. For example: and when the touch operation with the touch operation intensity smaller than the first pressure threshold value acts on the short message application icon, executing an instruction for viewing the short message. And when the touch operation with the touch operation intensity larger than or equal to the first pressure threshold value acts on the short message application icon, executing an instruction of newly building the short message.
The gyro sensor 180B may be used to determine a motion attitude of the terminal 100. In some examples, the angular velocity of terminal 100 about three axes (i.e., x, y, and z axes) may be determined by gyroscope sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. Illustratively, when the terminal 100 is used to collect user characteristic information in an environment, the gyroscope sensor 180B detects a shaking angle of the terminal 100, calculates a distance that the lens module needs to compensate according to the shaking angle, and allows the lens to counteract shaking of the terminal 100 through a reverse movement, thereby achieving anti-shaking.
The air pressure sensor 180C is used to measure air pressure. In some examples, terminal 100 calculates altitude, aiding in positioning and navigation, from barometric pressure values measured by barometric pressure sensor 180C.
The acceleration sensor 180E may detect the magnitude of acceleration of the terminal 100 in various directions (generally, three axes). The magnitude and direction of gravity can be detected when the terminal 100 is stationary. The method can also be used for recognizing the gesture of the terminal, and is applied to horizontal and vertical screen switching, pedometers and other applications.
A distance sensor 180F for measuring a distance. The terminal 100 may measure the distance by infrared or laser. In some examples, when the user characteristic information of the user in the environment is collected with the terminal, the terminal 100 may range using the distance sensor 180F to achieve fast focusing.
The ambient light sensor 180L is used to sense the ambient light level. The terminal 100 may adaptively adjust the brightness of the display 194 according to the perceived ambient light level.
The fingerprint sensor 180H is used to collect a fingerprint. The terminal 100 can utilize the collected fingerprint characteristics to realize fingerprint unlocking, access to an application lock, fingerprint photographing, fingerprint incoming call answering, and the like.
The temperature sensor 180J is used to detect temperature. In some examples, the terminal 100 executes a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the terminal 100 performs a reduction in the performance of the processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, terminal 100 heats battery 142 when the temperature is below another threshold to avoid a low temperature causing abnormal shutdown of terminal 100. In other embodiments, when the temperature is lower than a further threshold, the terminal 100 performs boosting on the output voltage of the battery 142 to avoid abnormal shutdown due to low temperature.
The touch sensor 180K is also called a "touch device". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation applied thereto or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided through the display screen 194. In other embodiments, the touch sensor 180K may be disposed on the surface of the terminal 100 at a different position than the display screen 194.
The keys 190 include a power-on key, a volume key, an input keypad, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The terminal 100 may receive a key input, and generate a key signal input related to user setting and function control of the terminal 100.
The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration cues, as well as for touch vibration feedback. For example, touch operations applied to different applications (e.g., video playback, audio playback, etc.) may correspond to different vibration feedback effects. The motor 191 may also respond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.
Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc.
The following describes in detail a technical solution provided by an embodiment of the present application based on a system architecture shown in fig. 1 and a hardware structure of an electronic device shown in fig. 2 with reference to the accompanying drawings.
Fig. 3 is a schematic flowchart of an input method provided in the present application. As shown in fig. 3, the input method provided by the present application includes the following steps:
and step S101, the second terminal responds to the fourth operation of the user and sends a first message to the first terminal.
Specifically, after a user issues an instruction for interface screen projection and the like to a first terminal, a second terminal sends a first message including a screen projection instruction to the first terminal, wherein the screen projection instruction is used for instructing screen projection of view information in a second interface on the second terminal to the first terminal, so that the first terminal displays the first interface. The first interface is used for displaying the view information in the second interface.
It can be understood that the fourth operation may be an operation in which the user issues an instruction to the first terminal to perform interface screen projection or the like on the second terminal.
And S102, the first terminal receives the first message of the second terminal and displays a first interface.
Specifically, after the second terminal sends the first message including the screen projection instruction to the first terminal, the first terminal may receive the first message. The first terminal may then display the first interface in response to the first message, thereby enabling mapping of view information in a second interface in the second terminal onto the first interface in the first terminal. For example, as shown in fig. 4, the electronic device a1 projects its display interface D1 onto the electronic device B1, and at this time, there is a display interface D2 on the electronic device a2, and the view information displayed in the display interface D2 is the same as the view information in the display interface D1.
In one embodiment, the area of the first interface is smaller than the display area of the display component on the first terminal, so that when the user views the information in the first interface, the user can also view other information displayed on the display component, such as part of video content and the like; wherein, the display component can be understood as a display screen on the first terminal. For example, with continued reference to FIG. 4, at this time, the display area of the first interface D2 is smaller than the area of the display device D3, and the user can view the video displayed on the display device D3.
In one embodiment, the transparency of the first interface is greater than a preset transparency threshold, so as to prevent the first interface from blocking other contents, such as video contents and the like, being displayed on the first terminal.
The first terminal step S103, the second terminal sends a second message to the first terminal.
Specifically, the second message includes a first identity identifier, where the first identity identifier includes an identity identifier of the second interface or a second input control in the second interface. Through the first identity, the first terminal may configure the first input control to establish a mapping relationship between the first input control and the second input control.
It is understood that the second message may be sent together with the first message or separately from the first message, which may be determined according to the actual situation and is not limited herein. When the second message is sent together with the first message, the second message and the first message can form a message, and the message can comprise a screen projection instruction and a first identity identification.
And step S104, the first terminal configures a first input control based on the first identity identifier.
In particular, the first terminal may configure a first input control on its display interface or on the first interface. The first input control may be configured based on the first identity, so that a mapping relationship is established between the first input control and the second interface or the second input control of the second terminal in the second interface, for example, the identities of the first input control and the second input control are in one-to-one correspondence, so as to accurately transmit information input in the first input control to the corresponding second interface.
Alternatively, the first input control may be located in an information input area in the first interface and the second input control may be located in an information input area in the second interface. For example, with continued reference to fig. 4, the input control configured for display interface D2 is input control C2, and the input control on display interface D1 is input control C1.
In one embodiment, the first input control may include an input unit and a display unit. The input unit may provide input services for the user, for example, provide voice input services, text input services, and the like; the display unit may display information input by the user, may also display a remaining period of time that may be input, and the like.
Step S105, the first terminal responds to a first operation of the user on the first input control, and generates a first event, wherein the first event is used for prompting the user to input information.
Specifically, when a user performs a first operation on a first input control, the first terminal may generate a first event corresponding to the first operation based on the first operation performed by the user, where the first event may prompt the user to input information.
In an embodiment, the first operation may include a touch duration, and if the first terminal determines that the touch duration is greater than a first preset duration, which indicates that the user has a long-time pressing operation, the first terminal may prompt the user to input voice information, such as a text prompt, a voice prompt, and the like, to prompt the user to perform voice input. If the first terminal determines that the touch duration is less than or equal to a first preset duration, which indicates that the user has a short-time pressing operation, a text input assembly in the first input control can be displayed to remind the user of performing text input, wherein the text input assembly can be understood as a virtual keyboard. It should be understood that, in the embodiment of the present application, the touch duration refers to a duration from when the user starts touching the first input control to when the user finishes touching the first input control.
For example, as shown in fig. 5a, if the user's finger presses the first input control C2 for a period of time longer than 3s, the interface shown in fig. 5b may be displayed, that is, the voice input prompt message of "please speak, i.e., i'm hear" is displayed; if the user's finger presses the first input control C2 for a period of time less than or equal to 1s, an interface such as that shown in FIG. 5C may be displayed, i.e., text input element E2 is displayed.
Further, if it is determined that the first event is prompting the user to input voice information, the first terminal may generate a second event, where the second event includes displaying a first remaining duration for which voice input is possible on the first input control and/or continuing to play information being displayed in a third interface on the first terminal. For example, when the user is prompted to input voice information, the timer can be directly counted down to remind the user of the time length for voice input; in addition, when the user watches the video, the video can be continuously played without pausing the video, so that the user can watch the video while performing voice input, and the user experience is improved.
Alternatively, the generated second event may be the presentation of a time-shifted progress bar on the first input control, which may indicate a remaining time period for which voice input is available. Wherein, the shape of the time shifting progress bar can be a long strip, a circle, etc. It will be appreciated that the time-shift progress bar may be a bar indicating a second remaining time period for which input is currently available, which may occur at other time periods, for example, when a first event for prompting the user to input information is generated, or when the user ends a first operation, etc.
If the first event is determined to be the display of the text input component in the first input control, the first terminal can generate a third event, and the third event can comprise the suspension of the information being displayed in a third interface on the first terminal, so that a user can concentrate on inputting the text and avoid missing wonderful moments in the information being displayed in the third interface; wherein the third interface is a different display interface than the first interface. For example, with continued reference to FIG. 5C, while a video is being played in the third interface C3, if the text input element E2 in the first input control C2 is displayed, the video being played in the third interface C3 is paused. In addition, when the user operates the character input component to hide, the information displayed in the third interface is recovered.
And S106, the first terminal responds to the input operation of the user and displays the first information input by the user on the first input control.
Specifically, after the user performs an input operation on a first input control on the first terminal, the first terminal may display first information input by the user on the first input control. If the user uses the character input component to input, the character information input by the user can be directly displayed. If the input operation used by the user is a voice input operation, after the user uses the voice input operation, the voice information sent by the user can be identified in real time or at intervals of preset duration and converted into text information, and the text information is displayed, so that the user can visually see whether the input content is correct, and the user experience is improved.
And S107, the first terminal responds to the information sending instruction sent by the user and sends a third message to the second terminal, wherein the third message comprises the first information and the first instruction, and the first instruction is used for indicating the second terminal to send the first information in the second interface.
Specifically, after the user issues the information sending instruction, the first terminal sends a third message to the second terminal, where the third message includes the first information and the first instruction, and the first instruction may instruct the second terminal to send the first information in the second interface, thereby implementing the cross-device input operation.
Optionally, the issuing of the information sending instruction by the user may include that the user clicks a sending button on the first input control, or the duration of the input operation of the user is greater than a second preset duration, and so on. For example, when a user clicks a sending button on the first input control, it is determined that an information sending instruction issued by the user is received; or, when the time length for which the input operation can be performed is 0, it may also be determined that an information sending instruction issued by the user is received.
And S108, the second terminal sends the first information and displays the first information on the second interface.
Specifically, after receiving the third message sent by the first terminal, the second terminal sends the first message and displays the first message on the second interface.
It can be appreciated that, because the mapping relationship between the first input control and the second interface or the second input control in the second interface has been established, the first terminal can display the first information on the second interface corresponding to the first input control based on an accurate indication of the mapping relationship.
It can be understood that, in the embodiment of the present application, if there are a plurality of second interfaces, one first input control may be configured for each second interface.
In summary, according to the input method provided by the embodiment of the present application, when the second terminal maps the second interface of the second terminal to the first terminal, the first input control is configured on the first terminal, and the first input control is used for performing an input operation, so that a cross-device input operation is implemented.
In some embodiments, the first terminal may generate a fourth event in response to a second operation by the user on the first input control, the second operation including sliding on the first input control, the fourth event including clearing all or part of the first information, extending a remaining period of time for which voice input is available, or canceling transmission of the first information. That is, the user may perform a second operation on the first input control, such as sliding, and then may generate a fourth event corresponding to the second operation.
Alternatively, if it is determined that the second operation is a left slip, and the speed of the left slip is greater than the first speed, all of the first information is cleared. And if the second operation is determined to be left sliding, the speed of the left sliding is less than or equal to the first speed, the initial position and the stop position of the left sliding of the user are determined, and the information between the initial position and the stop position in the first information is cleared. And if the second operation is determined to be right sliding, prolonging the remaining time for inputting the voice. And if the second operation is determined to be the upward sliding, canceling the sending of the first information.
In some embodiments, the user may also drag the first interface on the first terminal, and when the user drags the first interface, the first terminal may move the first interface to a position where the user stops dragging on the first terminal. In other words, the first terminal may generate a fifth event in response to a third operation of the user on the first interface, wherein the third operation includes dragging the first interface, and the fifth event includes moving the first interface to a position where the user stops dragging on the first terminal.
Further, in order to avoid the moved first interface from blocking other display information on the first terminal, after the fifth event is generated, a sixth event may be generated after it is determined that the interface edges of the first interface are both far away from the display edge of the display component on the first terminal, where the sixth event includes moving any interface edge of the first interface to any display edge of the display component. That is to say, after the user stops dragging the first interface and the finger of the user is far away from the display component of the first terminal, if the first terminal determines that any interface edge of the first interface is not in contact with the display edge of the display component, the first terminal moves one interface edge of the first interface to any display edge of the display component.
For example, as shown in fig. 6a and 6b, the operation issued by the user using the finger is: the first interface D3 is dragged from the position M1 to the position M2, and at this time, the first terminal may drag the first interface D3 from the position M1 to the position M2 in response to the user's operation. Further, as shown in fig. 6b and 6c, after the user's finger is away from the display component of the first terminal, the first terminal may move the first interface D3 from the position M2 to the position M3 even though the lower edge of the first interface D3 is in contact with the lower edge of the display component.
In some embodiments, a third input control is further configured in the electronic device, such as the first terminal and/or the second terminal, and the user can perform operations, such as voice input, text input, and input information modification, through the third input control.
When the third input control is touched, an event which can be generated by the electronic device can be predefined in the electronic device. For example, when the touch duration is greater than the preset touch duration, for example, 3s, the voice input mode is started; starting a character input mode when the touch duration is less than or equal to the preset touch duration; when the left sliding speed of the third input control is higher than the preset sliding speed, emptying the information in the third input control; when the left sliding speed on the third input control is less than or equal to the preset sliding speed, removing the information between the initial position and the stop position of the left sliding; when the third input control slides upwards, the information in the third input control is cancelled; when sliding to the right on the third input control, the remaining time period for which voice input is possible is extended, and so on.
In an example, after the time length that the user touches the third input control exceeds the preset time length, the input interface of the third input control may be controlled to be presented above other interfaces, and the transparency of the input interface may be greater than a preset transparency threshold, so that the user can perform an input operation, and information on other interfaces can be viewed during the input operation.
In one example, when the electronic device activates the voice input mode, the user may be prompted with text information or voice information for a voice input operation. Optionally, when the user stops touching the third input control, the voice information sent by the user is received and recognized, the voice information is converted into text information, and the text information is displayed on the third input control.
In addition, after the voice input mode is started, the remaining time period for which the voice input is available to the user can be displayed on the electronic device, for example, on a third input control. The display manner includes, but is not limited to, displaying in a time-shifting progress bar manner, displaying in a countdown manner, and the like.
In one example, when the user completes an input operation, such as a voice input operation, the information input by the user or the information input by the search user may be transmitted, or the like. The user may finish the input operation by understanding that the user issues a certain instruction, such as an information sending instruction, an information searching instruction, and the like, or when the remaining duration for which voice or text input is possible is 0, and the like.
In order to facilitate understanding of the situation where the third input control is configured in the electronic device, the following description will take the example of sending information. As shown in fig. 6, when the user needs to send information, the user may touch the third input control, and when the touch duration is less than or equal to the preset duration, the user may prompt text input, for example, display a text input method, and then the user may input text. When the touch duration is longer than the preset duration, prompting to perform voice input, and then starting voice input countdown when the user stops touching the third input control; and then, receiving voice information sent by the user, converting the voice information into text information, and displaying the text information on the third input control. Then, when the voice input countdown is finished, information that the user has input is transmitted. If the voice input countdown is not finished and the user clicks the finish key, the user is sent that the voice input countdown is not finished and the user touches the third input control, and the user can cancel sending the information when sliding down on the third input control. The length of time that can be entered can be extended when the user slides right on the third input control, after which the user can continue to enter. When the user clicks the third input control, the input may be suspended, and then, if the user clicks the third input control again, the user may continue the input. When the user slides to the left on the third input control, if the sliding speed is greater than the preset speed, all input information can be emptied and input is continued; if the sliding speed is less than or equal to the preset speed, part of the input information, for example, information between the sliding start position and the sliding end position, may be cleared, and the input may be continued.
An input device provided in an embodiment of the present application is described below.
Fig. 8 is a schematic structural diagram of an input device according to an embodiment of the present application. As shown in fig. 7, the input device provided in the embodiment of the present application may be used to implement the input method performed by the first terminal or the input method performed by the second terminal described in the above method embodiments.
The input device includes at least one processor 21, and the at least one processor 21 may support the input device to implement the input method executed by the first terminal or the input method executed by the second terminal in the embodiment of the present application.
The processor 21 may be a general purpose processor or a special purpose processor. For example, the processor 21 may include a Central Processing Unit (CPU) and/or a baseband processor. The baseband processor may be configured to process communication data, and the CPU may be configured to implement corresponding control and processing functions, execute a software program, and process data of the software program.
Further, the input device may further include a transceiving unit 25 for implementing input (reception) and output (transmission) of signals. For example, the transceiving unit 25 may include a transceiver or a radio frequency chip. The transceiving unit 25 may also comprise a communication interface.
Optionally, the input device may further include an antenna 26, which may be used to support the transceiving unit 25 to implement the transceiving function of the input device.
Optionally, the input device may include one or more memories 22, on which programs (also instructions or codes) 24 are stored, and the programs 24 may be executed by the processor 21, so that the processor 21 executes the method described in the above method embodiments. Optionally, data may also be stored in the memory 22. Alternatively, the processor 21 may also read data (e.g., pre-stored first characteristic information) stored in the memory 22, the data may be stored at the same memory address as the program 24, and the data may be stored at a different memory address from the program 24.
The processor 21 and the memory 22 may be provided separately or integrated together, for example, on a single board or a System On Chip (SOC).
For detailed description of operations performed by the input device in the above various possible designs, reference may be made to the description of the embodiment of the control method of the smart home system provided in the present application, and details are not repeated here.
It will be appreciated that the steps of the above-described method embodiments may be performed by logic circuits in the form of hardware or instructions in the form of software in the processor 21. The processor 21 may be a CPU, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or other programmable logic device, such as a discrete gate, a transistor logic device, or a discrete hardware component.
The embodiment of the application also provides electronic equipment, and the electronic equipment comprises the input device in the embodiment.
Fig. 9 is a schematic structural diagram of a chip according to an embodiment of the present application. Chip 900 includes one or more processors 901 and interface circuits 902. Optionally, the chip 900 may further include a bus 903. Wherein:
the processor 901 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be implemented by integrated logic circuits of hardware or instructions in the form of software in the processor 901. The processor 901 may be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The methods, steps disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The interface circuit 902 may be used for sending or receiving data, instructions or information, and the processor 901 may perform processing by using the data, instructions or other information received by the interface circuit 902, and may send out processing completion information through the interface circuit 902.
Optionally, the chip further comprises a memory, which may include read only memory and random access memory, and provides operating instructions and data to the processor. The portion of memory may also include non-volatile random access memory (NVRAM).
Optionally, the memory stores executable software modules or data structures, and the processor may perform corresponding operations by calling the operation instructions stored in the memory (the operation instructions may be stored in an operating system).
Alternatively, the chip may be used in a communication apparatus (including a master node and a slave node) according to an embodiment of the present application. Optionally, the interface circuit 902 may be used to output the execution result of the processor 901. For the data transmission method provided in one or more embodiments of the present application, reference may be made to the foregoing embodiments, and details are not repeated here.
It should be noted that the respective functions of the processor 901 and the interface circuit 902 may be implemented by hardware design, software design, or a combination of hardware and software, which is not limited herein.
It will be appreciated that the steps of the above-described method embodiments may be performed by logic circuits in the form of hardware or instructions in the form of software in a processor. The processor may be a CPU, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or other programmable logic device, such as a discrete gate, a transistor logic device, or a discrete hardware component.
It is understood that the processor in the embodiments of the present application may be a Central Processing Unit (CPU), other general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. The general purpose processor may be a microprocessor, but may be any conventional processor.
The method steps in the embodiments of the present application may be implemented by hardware, or may be implemented by software instructions executed by a processor. The software instructions may consist of corresponding software modules that may be stored in Random Access Memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), Erasable Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), registers, a hard disk, a removable hard disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. Of course, the storage medium may also be integral to the processor. The processor and the storage medium may reside in an ASIC.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in or transmitted over a computer-readable storage medium. The computer instructions may be transmitted from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is to be understood that the various numerical references referred to in the embodiments of the present application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of the present application.

Claims (17)

1.一种输入方法,其特征在于,应用于第一终端,包括:1. an input method is characterized in that, being applied to the first terminal, comprising: 接收第二终端发送的第一消息,显示第一界面,所述第一消息包括投屏指令,所述投屏指令用于指示将所述第二终端上第二界面中的视图信息投屏至所述第一终端,所述第一界面用于显示所述视图信息;Receive a first message sent by the second terminal, and display a first interface, where the first message includes a screen-casting instruction, and the screen-casting instruction is used to instruct to screen the view information in the second interface on the second terminal to the screen. the first terminal, where the first interface is used to display the view information; 接收所述第二终端发送的第二消息,所述第二消息包括第一身份标识,所述第一身份标识包括所述第二界面或所述第二界面中第二输入控件的身份标识;receiving a second message sent by the second terminal, where the second message includes a first identity, and the first identity includes the identity of the second interface or the second input control in the second interface; 基于所述第一身份标识,配置第一输入控件;Based on the first identity identifier, configure a first input control; 响应于用户在所述第一输入控件上的第一操作,生成第一事件,所述第一事件用于提示用户输入信息;In response to the user's first operation on the first input control, a first event is generated, and the first event is used to prompt the user to input information; 响应于用户的输入操作,在所述第一输入控件上显示用户输入的第一信息;In response to the user's input operation, displaying the first information input by the user on the first input control; 响应于用户下发的信息发送指令,向所述第二终端发送第三消息,所述第三消息包括所述第一信息和第一指令,所述第一指令用于指示所述第二终端发送所述第一信息,以及在所述第二界面显示所述第一信息。In response to the information sending instruction issued by the user, send a third message to the second terminal, where the third message includes the first information and a first instruction, and the first instruction is used to instruct the second terminal The first information is sent, and the first information is displayed on the second interface. 2.根据权利要求1所述的方法,其特征在于,所述第一操作包括触碰时长,所述响应于用户在所述第一输入控件上的第一操作,生成第一事件,包括:2 . The method according to claim 1 , wherein the first operation comprises a touch duration, and the generating a first event in response to a user's first operation on the first input control, comprising: 2 . 确定所述触碰时长大于第一预设时长,提示用户输入语音信息;determining that the touch duration is greater than the first preset duration, and prompting the user to input voice information; 确定所述触碰时长小于或等于所述第一预设时长,显示所述第一输入控件中的文字输入组件。It is determined that the touch duration is less than or equal to the first preset duration, and the text input component in the first input control is displayed. 3.根据权利要求2所述的方法,其特征在于,所述方法还包括:3. The method according to claim 2, wherein the method further comprises: 确定所述第一事件为提示用户输入语音信息,生成第二事件,所述第二事件包括在所述第一输入控件上显示可进行语音输入的第一剩余时长和/或继续播放所述第一终端上第三界面中正在显示的信息,或者It is determined that the first event is to prompt the user to input voice information, and a second event is generated, and the second event includes displaying on the first input control the first remaining duration for voice input and/or continuing to play the first Information being displayed in a third interface on a terminal, or 确定所述第一事件为显示所述第一输入控件中的文字输入组件,生成第三事件,所述第三事件包括暂停所述第一终端上第三界面中正在显示的信息。It is determined that the first event is displaying the text input component in the first input control, and a third event is generated, where the third event includes pausing the information being displayed in the third interface on the first terminal. 4.根据权利要求1-3任一项所述的方法,其特征在于,所述方法还包括:4. The method according to any one of claims 1-3, wherein the method further comprises: 在所述第一输入控件上呈现时移进度条,所述时移进度条用于指示可进行输入的第二剩余时长。A time-shifting progress bar is presented on the first input control, and the time-shifting progress bar is used to indicate a second remaining time period for which input can be performed. 5.根据权利要求1-3任一项所述的方法,其特征在于,所述响应于用户的输入操作,在所述第一输入控件上显示用户输入的第一信息,包括:5. The method according to any one of claims 1-3, wherein, in response to a user's input operation, displaying the first information input by the user on the first input control comprises: 确定所述输入操作为语音输入操作,将接收的语音信息转换为文字信息,以及显示所述文字信息,其中,所述文字信息为所述第一信息。It is determined that the input operation is a voice input operation, the received voice information is converted into text information, and the text information is displayed, wherein the text information is the first information. 6.根据权利要求1-3任一项所述的方法,其特征在于,所述方法还包括:6. The method according to any one of claims 1-3, wherein the method further comprises: 响应于用户在所述第一输入控件上的第二操作,生成第四事件,所述第二操作包括在所述第一输入控件上滑动,所述第四事件包括清除所述第一信息中的全部信息或部分信息、延长可进行语音输入的剩余时长或者取消发送所述第一信息。In response to the user's second operation on the first input control, a fourth event is generated, the second operation includes sliding on the first input control, and the fourth event includes clearing the first information all or part of the information, extend the remaining time for voice input, or cancel the sending of the first information. 7.根据权利要求6所述的方法,其特征在于,所述响应于用户在所述第一输入控件上的第二操作,生成第四事件,包括:7. The method according to claim 6, wherein the generating a fourth event in response to a second operation of the user on the first input control comprises: 确定所述第二操作为左滑,且所述左滑的速度大于第一速度,清除所述第一信息中的全部信息;Determine that the second operation is left-swiping, and the speed of the left-swiping is greater than the first speed, and clear all the information in the first information; 确定所述第二操作为左滑,且所述左滑的速度小于或等于所述第一速度,确定用户左滑的初始位置和停止位置,清除所述第一信息中位于所述初始位置和所述停止位置之间的信息;Determine that the second operation is left swipe, and the speed of the left swipe is less than or equal to the first speed, determine the initial position and stop position of the user's left swipe, and clear the initial position and the stop position in the first information. information between said stop positions; 确定所述第二操作为右滑,延长可进行语音输入的剩余时长;It is determined that the second operation is a right swipe, and the remaining duration of voice input is extended; 确定所述第二操作为上滑,取消发送所述第一信息。It is determined that the second operation is sliding up, and the sending of the first information is canceled. 8.根据权利要求1-3任一项所述的方法,其特征在于,所述方法还包括:8. The method according to any one of claims 1-3, wherein the method further comprises: 响应于用户在所述第一界面上的第三操作,生成第五事件,所述第三操作包括拖动所述第一界面,所述第五事件包括将所述第一界面移动至用户在所述第一终端上停止拖动的位置。In response to a user's third operation on the first interface, a fifth event is generated, the third operation includes dragging the first interface, and the fifth event includes moving the first interface to the user's The position on the first terminal where dragging is stopped. 9.根据权利要求8所述的方法,其特征在于,所述生成第五事件之后,还包括:9. The method according to claim 8, wherein after the generating the fifth event, the method further comprises: 确定所述第一界面的界面边缘均远离所述第一终端上显示组件的显示边缘,生成第六事件,所述第六事件包括将所述第一界面的任一界面边缘移动至所述显示组件的任一显示边缘处。It is determined that the interface edges of the first interface are all far away from the display edge of the display component on the first terminal, and a sixth event is generated, and the sixth event includes moving any interface edge of the first interface to the display at either display edge of the component. 10.根据权利要求1-3任一项所述的方法,其特征在于,所述第一界面的面积小于所述第一终端上显示组件的显示面积。10 . The method according to claim 1 , wherein an area of the first interface is smaller than a display area of a display component on the first terminal. 11 . 11.根据权利要求1-3任一项所述的方法,其特征在于,所述第一界面的透明度大于预设透明度阈值。11. The method according to any one of claims 1-3, wherein the transparency of the first interface is greater than a preset transparency threshold. 12.一种输入方法,其特征在于,应用于第二终端,包括:12. An input method, characterized in that, applied to a second terminal, comprising: 响应于用户的第四操作,向第一终端发送第一消息,以使所述第一终端显示第一界面,,所述第一消息包括投屏指令,所述投屏指令用于指示将所述第二终端上第二界面中的视图信息投屏至所述第一终端,所述第一界面用于显示所述视图信息;In response to the fourth operation of the user, a first message is sent to the first terminal to cause the first terminal to display the first interface, where the first message includes a screen-casting instruction, and the screen-casting instruction is used to instruct projecting the view information in the second interface on the second terminal to the first terminal, and the first interface is used to display the view information; 向所述第一终端发送第二消息,所述第二消息包括第一身份标识,所述第一身份标识包括所述第二界面或所述第二界面中第二输入控件的身份标识,以使所述第一终端基于所述第一身份标识,配置第一输入控件;Send a second message to the first terminal, the second message includes a first identity, and the first identity includes the second interface or the identity of the second input control in the second interface, to enabling the first terminal to configure a first input control based on the first identity; 接收所述第一终端发送的第三消息,所述第三消息包括第一信息和第一指令,所述第一信息为用户在所述第一输入控件上输入的信息,所述第一指令用于指示所述第二终端发送所述第一信息,以及在所述第二界面显示所述第一信息;Receive a third message sent by the first terminal, where the third message includes first information and a first instruction, the first information is information input by the user on the first input control, and the first instruction is used to instruct the second terminal to send the first information, and display the first information on the second interface; 发送所述第一信息,以及在所述第二界面显示所述第一信息。The first information is sent, and the first information is displayed on the second interface. 13.一种输入装置,其特征在于,包括:13. An input device, comprising: 存储器,用于存储程序;memory for storing programs; 处理器,用于执行所述存储器存储的程序,当所述存储器存储的程序被执行时,所述处理器用于执行如权利要求1-11任一所述的方法,或者执行如权利要求12所述的方法。a processor, configured to execute the program stored in the memory, when the program stored in the memory is executed, the processor is configured to execute the method according to any one of claims 1-11, or execute the method according to claim 12 method described. 14.一种终端,其特征在于,包含权利要求13所述的输入装置。14. A terminal, comprising the input device of claim 13. 15.一种计算机存储介质,所述计算机存储介质中存储有指令,当所述指令在计算机上运行时,使得计算机执行如权利要求1-12任一所述的方法。15. A computer storage medium in which instructions are stored which, when executed on a computer, cause the computer to perform the method of any one of claims 1-12. 16.一种包含指令的计算机程序产品,当所述指令在计算机上运行时,使得所述计算机执行如权利要求1-12任一所述的方法。16. A computer program product comprising instructions which, when executed on a computer, cause the computer to perform the method of any of claims 1-12. 17.一种芯片,其特征在于,包括至少一个处理器和接口;17. A chip, comprising at least one processor and an interface; 所述接口,用于为所述至少一个处理器提供程序指令或者数据;the interface for providing program instructions or data for the at least one processor; 所述至少一个处理器用于执行所述程序行指令,以实现如权利要求1-12任一项所述的方法。The at least one processor is configured to execute the program line instructions to implement the method of any of claims 1-12.
CN202010845515.7A 2020-08-20 2020-08-20 Terminal and input method and device thereof Pending CN114079809A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010845515.7A CN114079809A (en) 2020-08-20 2020-08-20 Terminal and input method and device thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010845515.7A CN114079809A (en) 2020-08-20 2020-08-20 Terminal and input method and device thereof

Publications (1)

Publication Number Publication Date
CN114079809A true CN114079809A (en) 2022-02-22

Family

ID=80282208

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010845515.7A Pending CN114079809A (en) 2020-08-20 2020-08-20 Terminal and input method and device thereof

Country Status (1)

Country Link
CN (1) CN114079809A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117692483A (en) * 2023-08-18 2024-03-12 荣耀终端有限公司 An input event transmission method, electronic device and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1937733A (en) * 2005-09-19 2007-03-28 海信集团有限公司 Method for regulating picture-in-puture display transmitance
CN104090652A (en) * 2014-06-13 2014-10-08 北京搜狗科技发展有限公司 Voice input method and device
CN106814879A (en) * 2017-01-03 2017-06-09 北京百度网讯科技有限公司 A kind of input method and device
CN107493484A (en) * 2017-08-18 2017-12-19 三星电子(中国)研发中心 System, method and apparatus for projection screen
CN109426424A (en) * 2017-08-31 2019-03-05 阿里巴巴集团控股有限公司 A kind of operating method of terminal device, device and electronic equipment
CN110147199A (en) * 2019-05-23 2019-08-20 北京硬壳科技有限公司 Display on the same screen method, apparatus and touch control display
CN110381195A (en) * 2019-06-05 2019-10-25 华为技术有限公司 A kind of throwing screen display methods and electronic equipment
CN110377250A (en) * 2019-06-05 2019-10-25 华为技术有限公司 A kind of touch control method and electronic equipment thrown under screen scene
WO2020051852A1 (en) * 2018-09-13 2020-03-19 华为技术有限公司 Method for recording and displaying information in communication process, and terminals

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1937733A (en) * 2005-09-19 2007-03-28 海信集团有限公司 Method for regulating picture-in-puture display transmitance
CN104090652A (en) * 2014-06-13 2014-10-08 北京搜狗科技发展有限公司 Voice input method and device
CN106814879A (en) * 2017-01-03 2017-06-09 北京百度网讯科技有限公司 A kind of input method and device
CN107493484A (en) * 2017-08-18 2017-12-19 三星电子(中国)研发中心 System, method and apparatus for projection screen
CN109426424A (en) * 2017-08-31 2019-03-05 阿里巴巴集团控股有限公司 A kind of operating method of terminal device, device and electronic equipment
WO2020051852A1 (en) * 2018-09-13 2020-03-19 华为技术有限公司 Method for recording and displaying information in communication process, and terminals
CN110147199A (en) * 2019-05-23 2019-08-20 北京硬壳科技有限公司 Display on the same screen method, apparatus and touch control display
CN110381195A (en) * 2019-06-05 2019-10-25 华为技术有限公司 A kind of throwing screen display methods and electronic equipment
CN110377250A (en) * 2019-06-05 2019-10-25 华为技术有限公司 A kind of touch control method and electronic equipment thrown under screen scene

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117692483A (en) * 2023-08-18 2024-03-12 荣耀终端有限公司 An input event transmission method, electronic device and storage medium

Similar Documents

Publication Publication Date Title
CN110244893B (en) Operating method and electronic device for split-screen display
CN110347269B (en) Empty mouse mode realization method and related equipment
CN110531864B (en) A gesture interaction method, device and terminal equipment
CN112312366B (en) Method, electronic equipment and system for realizing functions through NFC (near field communication) tag
WO2021213120A1 (en) Screen projection method and apparatus, and electronic device
CN113535284B (en) Full-screen display methods, devices and electronic devices
CN110012154A (en) A kind of control method and electronic equipment of the electronic equipment with Folding screen
CN114514498A (en) Electronic equipment and operation method thereof
JP7173670B2 (en) VOICE CONTROL COMMAND GENERATION METHOD AND TERMINAL
WO2022028537A1 (en) Device recognition method and related apparatus
CN114489533A (en) Screen projection method and device, electronic equipment and computer readable storage medium
CN110012130A (en) A kind of control method and electronic equipment of the electronic equipment with Folding screen
WO2021052015A1 (en) Touch screen control method and electronic device
WO2020221062A1 (en) Navigation operation method and electronic device
CN112272191B (en) Data transfer method and related device
CN111142767B (en) A custom button method, device and storage medium for a folding device
CN112532508B (en) Video communication method and video communication device
CN109285563B (en) Voice data processing method and device in online translation process
CN114079809A (en) Terminal and input method and device thereof
CN113867520A (en) Device control method, electronic device, and computer-readable storage medium
CN114077519A (en) System service recovery method and device and electronic equipment
CN117319369A (en) Document delivery methods, electronic equipment and storage media
CN116069156A (en) Shooting parameter adjustment method, electronic equipment and storage medium
CN112463086A (en) Display control method and electronic equipment
CN114691066B (en) Application display method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20220222

RJ01 Rejection of invention patent application after publication