CN110602675A

CN110602675A - Earphone pair translation method and device, earphone pair and translation system

Info

Publication number: CN110602675A
Application number: CN201910780680.6A
Authority: CN
Inventors: 张海宏
Original assignee: Goertek Inc
Current assignee: Goertek Inc
Priority date: 2019-08-22
Filing date: 2019-08-22
Publication date: 2019-12-20
Also published as: WO2021031290A1

Abstract

The invention discloses a translation method and device for an earphone pair, the earphone pair and a translation system, wherein the earphone pair comprises a first earphone and a second earphone which correspond to each other and is used for establishing a Bluetooth link with electronic equipment; the translation method comprises the following steps: controlling a first earphone to establish a Bluetooth link with an electronic device; the method comprises the steps that a first earphone is controlled to obtain a first voice signal input by a user, and the first voice signal is uploaded to electronic equipment through a Bluetooth link so that the electronic equipment can translate the first voice signal to obtain a first translation signal; controlling a first earphone and a second earphone to acquire a first translation signal sent by the electronic equipment through a Bluetooth link; and controlling the first earphone and the second earphone to play the first translation signal.

Description

Earphone pair translation method and device, earphone pair and translation system

Technical Field

The invention relates to the technical field of earphone translation, in particular to a translation method and device for an earphone pair, the earphone pair and a translation system.

Background

With the development and progress of society, the global internationalization of all walks of life is faster and faster, and the probability of communicating with foreigners in work or life is higher and higher. Although the mobile phone application and the desktop application both open the voice online translation service and set up a communication bridge for two people speaking different languages, the two modes are really not convenient enough and have low practicability. And can only finish the one-way simultaneous translation from the first language to the second language, and can not realize the effect that different users respectively use the first language to the second language to carry out barrier-free conversation.

If the mobile phone is used alone for communication and translation service, the user needs to manually switch from the first language to the second language, which is very inconvenient when different users talk from the first language to the second language respectively.

Therefore, a speech translation method is provided to enable a user to obtain a better use experience scheme.

Disclosure of Invention

It is an object of the present invention to provide a new solution that solves one of the above mentioned problems.

According to a first aspect of the present invention, there is provided a translation method for a pair of headsets, the pair of headsets comprising corresponding first and second headsets, the pair of headsets being for establishing a bluetooth link with an electronic device; the translation method comprises the following steps:

controlling the first earphone to establish a Bluetooth link with the electronic equipment;

the first earphone is controlled to obtain a first voice signal input by a first user, and the first voice signal is uploaded to the electronic equipment through the Bluetooth link, so that the electronic equipment can translate the first voice signal to obtain a first translation signal;

controlling the first earphone and the second earphone to acquire the first translation signal sent by the electronic equipment through the Bluetooth link;

and controlling the first earphone and the second earphone to play the first translation signal.

Optionally, the translation method further includes:

controlling the second earphone to acquire the channel parameters of the Bluetooth link;

controlling the second earphone to acquire a second voice signal input by a second user, and uploading the second voice signal to the electronic equipment according to the channel parameter so that the electronic equipment can translate the second voice signal to obtain a second translation signal;

controlling the first earphone and the second earphone to acquire the second translation signal sent by the electronic equipment through the Bluetooth link;

and controlling the first earphone and the second earphone to play the second translation signal.

Optionally, the controlling the first headset and the second headset to acquire the translation signal sent by the electronic device through the bluetooth link includes:

controlling the first headset to receive the translated signal over the Bluetooth link; wherein the translation signal is the first translation signal or the second translation signal;

and controlling the second earphone to monitor the Bluetooth link according to the channel parameters to acquire the translation signal.

Optionally, the translation method further includes:

after controlling the first earphone to play the first translation signal, controlling the first earphone to detect a first continuous time length during which the first voice signal is not input by the first user;

and when the first duration exceeds a preset first duration threshold, controlling the first earphone to send a first end notification of the end of the self translation process to the second earphone, so that the second earphone can acquire the second voice signal input by the second user under the condition that the second earphone receives the first end notification.

Optionally, the translation method further includes:

and under the condition that the first earphone sends the first end notice to the second earphone, controlling a first microphone and a first radio frequency sending unit of the first earphone to stop working.

Optionally, the translation method further includes:

controlling the first earphone to detect whether a first event that a first voice signal is input by a user occurs;

and under the condition that the first event occurs, controlling a first microphone and a first radio frequency transmission unit of the first earphone to start working so as to acquire the first voice signal input by the first user.

Optionally, the translation method further includes:

and under the condition of controlling the first microphone and the first radio frequency transmitting unit of the first earphone to start working, controlling the first earphone to send out a reminding alarm.

Optionally, the translation method further includes:

under the condition that the first earphone is controlled to acquire a first voice signal input by a first user, the first earphone is controlled to send a first starting notice of self translation process starting to the second earphone, and under the condition that the second earphone receives the first starting notice and does not receive the first ending notice, the second earphone is controlled to stop acquiring a second voice signal input by a second user.

Optionally, the translation method further includes:

detecting, by the first headset, a continuous duration in which the first voice signal is not input by a user;

and when the continuous time length exceeds a preset third time length threshold value, disconnecting the Bluetooth link between the first earphone and the electronic equipment.

Optionally, the bluetooth link is an SCO synchronous link, an ACL asynchronous link, or a BLE link.

According to a second aspect of the present invention, there is provided a translation apparatus for a pair of headsets, the pair of headsets comprising corresponding first and second headsets, the pair of headsets being for establishing a bluetooth link with an electronic device; the translation device comprises:

the first link establishing module is used for controlling the first earphone and the electronic equipment to establish a Bluetooth link;

the first voice uploading module is used for controlling the first earphone to acquire a first voice signal input by a user and uploading the first voice signal to the electronic equipment through the Bluetooth link so that the electronic equipment can translate the first voice signal to obtain a first translation signal;

the first translation acquisition module is used for controlling the first earphone and the second earphone to acquire the first translation signal sent by the electronic equipment through the Bluetooth link;

and the first signal playing module is used for controlling the first earphone and the second earphone to play the first translation signal.

According to a third aspect of the present invention, there is provided a pair of headphones comprising:

the translation apparatus according to the second aspect of the present invention; or,

a processor and a memory for storing instructions for controlling the processor to perform a translation method according to the first aspect of the invention.

According to a fourth aspect of the present invention, there is provided a translation system comprising an electronic device, and a pair of earphones according to the third aspect of the present invention; the electronic equipment is used for establishing a Bluetooth link with a first earphone of the earphone pair, receiving a first voice signal uploaded by the first earphone through the Bluetooth link, translating the first voice signal to obtain a first translation signal, and sending the first translation signal to the first earphone through the Bluetooth link.

The invention has the advantages that through the translation method of the embodiment, users with two different languages wear the first earphone and the second earphone respectively, and can hear the voice translated into the native language from the voice of the other party when talking in different languages, so as to communicate without language barrier. The first earphone and the second earphone can both acquire the first translation signal sent by the electronic device, and the first earphone does not need to forward the acquired first translation signal to the second earphone, so that the delay of the first earphone and the second earphone for acquiring the first translation signal is small; the first user and the second user can talk without waiting for the process time of establishing the Bluetooth link.

Other features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention.

Fig. 1 is a flow chart of a translation method for a headset pair according to an embodiment of the present invention;

FIG. 2 is a flow diagram of one example of a translation method for a headset pair, according to an embodiment of the invention;

FIG. 3 is a flow chart of another example of a translation method for a headset pair according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a translation system according to an embodiment of the present invention;

FIG. 5 is a functional block diagram of one example of a translator for a pair of headphones, according to an embodiment of the invention;

FIG. 6 is a functional block diagram of one example of a translator for a pair of headphones, according to an embodiment of the invention;

fig. 7 is a schematic block diagram of an example of a pair of earphones according to an embodiment of the invention.

Detailed Description

Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.

The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.

Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.

In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.

< method examples >

In order to solve the problem that the method for realizing communication between users with different languages through translation application on electronic equipment in the prior art is poor in practicability, a translation method for an earphone pair is provided. The translation method may be implemented by a pair of headsets, which may include corresponding first and second headsets, for establishing a bluetooth link with the electronic device.

The corresponding first and second headsets are a set of real wireless headsets (TWS headsets) between which data may be transmitted via the TWS protocol. In an embodiment of the invention, the channel parameters and notifications may be transmitted between the first earpiece and the second earpiece via a TWS protocol without the need to transmit voice signals or translate signals between the first earpiece and the second earpiece.

Fig. 1 is a flowchart of a translation method for a headset pair according to an embodiment of the present invention.

As shown in fig. 1, the translation method may include steps S1100 to S1400 as follows:

step S1100, controlling the first earphone and the electronic device to establish a Bluetooth link.

In one embodiment of the present invention, the first headset and the electronic device may establish a bluetooth link through a bluetooth connection.

The bluetooth link may be an SCO synchronous link or an ACL asynchronous link or a BLE link.

Under the condition that the bluetooth link is the SCO synchronous link, HFP connection can be established between the first earphone and the electronic device, and uplink and downlink synchronous transmission (such as making a call) of voice signals can be directly performed between the first earphone and the electronic device on the SCO synchronous link through an HFP protocol.

Under the condition that the Bluetooth link is an ACL asynchronous link, A2DP connection and SPP connection can be established between the first earphone and the electronic equipment, downlink asynchronous transmission (such as listening to music) of voice signals can be carried out between the first earphone and the electronic equipment through an A2DP protocol in the ACL asynchronous link, and uplink and downlink asynchronous transmission of the voice signals can be carried out through the SPP protocol.

Under the condition of a BLE link in a Bluetooth link, a BLE link is established between the first earphone and the electronic equipment, and the first earphone and the electronic equipment perform uplink and downlink transmission through a data protocol or a voice protocol. Optionally, the BLE link may also be established between the second headset and the electronic device, and uplink and downlink transmission may be performed through a data protocol or a voice protocol. Step S1200, controlling the first earphone to obtain a first voice signal input by the first user, and uploading the first voice signal to the electronic device through the bluetooth link, so that the electronic device translates the first voice signal to obtain a first translation signal.

In this embodiment, the first earphone may be provided with a first microphone and a first radio frequency transmitting unit, the first microphone is configured to collect a first voice signal input by a first user, and the first radio frequency transmitting unit may be configured to upload the first voice signal to the electronic device. The first radio frequency transmitting unit may be provided by a bluetooth chip in the first headset.

The electronic device in this embodiment may be an electronic product capable of implementing a voice translation function, such as a mobile phone, a smart watch, a tablet computer, and the like.

After the electronic equipment receives the first voice signal, the first voice signal can be converted into characters for translation, and then the translated characters are converted into voice signals to obtain a first translation signal.

Further, the electronic device needs to set a translated source language type as a first language used by a first user in advance, the target language type as a second language understood by a second user using a second headset, and when the detected speech of the first speech signal is the source language type, the electronic device can translate the first speech signal of the first language into a first translation signal of the second language.

The above text translation process may be implemented by a translation engine, and the conversion between text and speech may be implemented by a speech recognition engine, for example.

In this embodiment, after obtaining the first translation signal, the electronic device may send the first translation signal through the bluetooth link.

Step 1300, controlling the first earphone and the second earphone to acquire a first translation signal sent by the electronic device through the bluetooth link.

In one embodiment, when the first headset establishes a bluetooth link with the electronic device, the first headset sends channel parameters of the bluetooth link to the second headset for the second headset to acquire.

On the basis, the step of controlling the first earphone and the second earphone to acquire the first translation signal sent by the electronic device through the bluetooth link comprises the following steps:

controlling the first earphone to receive the first translation signal through the Bluetooth link; and controlling the second earphone to monitor the Bluetooth link according to the channel parameters to acquire a first translation signal.

Specifically, the electronic device may send the first translation signal through a bluetooth link, and since the first headset is connected to the electronic device through the bluetooth link, the first headset may directly receive the first translation signal sent by the electronic device through the bluetooth link.

In addition, the second earphone can adopt a monitoring mode, and channel parameters such as a receiving frequency hopping point and a frequency band are completely the same as those of the first earphone. Therefore, the second earphone can acquire the first translation signal sent by the electronic device through the bluetooth link in a monitoring mode without being forwarded by the first earphone.

This process is as if there were a virtual bluetooth link from the electronic device to the second headset to simultaneously transmit the first translated signal.

In this embodiment, the TWS connection may be established between the first headset and the second headset, and the channel parameters may be transmitted through a TWS protocol.

Specifically, the first earphone transmits channel parameters such as a bluetooth address, a sending frequency point, a receiving frequency hopping point, a frequency band and the like of the first earphone to the second earphone through a TWS protocol, so that the second earphone simulates the receiving frequency hopping point and the frequency band of the first earphone, monitoring of a bluetooth link is realized, and a first translation signal sent to the first earphone by the electronic device through the bluetooth link is acquired.

In the case that the bluetooth link is an SCO link, the electronic device may encode the first translation signal into a bluetooth packet through a baseband and transmit the bluetooth packet through a radio frequency. The second earphone adopts a monitoring mode, and the information of receiving frequency hopping points, frequency bands and the like is completely the same as that of the first earphone. The first earphone and the second earphone both receive the same Bluetooth baseband data packet and analyze the same to obtain a first translation signal. This process amounts to having a virtual SCO link from the electronic device to the second headset to simultaneously transmit the first translation signal.

In the case that the bluetooth link is an ACL link, the electronic device may encode and encapsulate the first translation signal into a data packet of an A2DP protocol, and then encapsulate the data packet into a bluetooth baseband protocol packet, and transmit the bluetooth baseband protocol packet to the bluetooth address of the first headset through the ACL link. The first earphone directly receives and analyzes the Bluetooth baseband protocol packet to obtain a first translation signal. The second earphone adopts a monitoring mode, receives the Bluetooth baseband protocol packet by adopting the same frequency point strategy as the first earphone, and analyzes the information such as the Bluetooth address of the earphone which is the same as the first earphone to obtain a first translation signal. The first and second headsets thus receive the downstream protocol packets simultaneously and decode them into the first translated signal. This process appears to be equivalent to establishing a virtual A2DP asynchronous link between the second headset and the electronic device.

In the case where the bluetooth link is a BLE link, the electronic device may send the first translated signal directly to the first headset and the second headset by following an associated data protocol or a voice protocol.

Step S1400, controlling the first earphone and the second earphone to play the first translation signal.

In this embodiment, both the first earphone and the second earphone may acquire the first translation signal sent by the electronic device, and the first earphone does not need to forward the acquired first translation signal to the second earphone, so that the delay for the first earphone and the second earphone to acquire the first translation signal is small.

In an embodiment of the present invention, the translation method may further include steps S2100 to S2400 as follows:

step S2100, controlling the second headset to acquire a channel parameter of the bluetooth link.

Step S2200 is to control the second earphone to obtain a second voice signal input by the second user, and upload the second voice signal to the electronic device according to the channel parameter, so that the electronic device performs a translation process on the second voice signal to obtain a second translation signal.

In one or more embodiments of the invention, the second speech signal is a speech signal picked up by the second headset. Correspondingly, a second microphone may be disposed on the second earphone, and may be configured to collect two voice signals input by a second user.

In this embodiment, the second headset may simulate the first headset to upload the second voice signal to the electronic device according to the channel parameter of the bluetooth link, and a process of disconnecting the bluetooth link from the first headset and reconnecting the bluetooth link with the second headset is not required, so that the first user and the second user do not need to wait for a process time of establishing the bluetooth link during a conversation.

In one embodiment, a second microphone and a second radio frequency transmission unit may be disposed on the second earphone. The second microphone is used for collecting a second voice signal, and the second radio frequency sending unit is used for uploading the second voice signal to the electronic equipment. The second radio frequency transmitting unit may be provided by a bluetooth chip in the second headset.

In this embodiment, after the electronic device receives the second voice signal, the electronic device may convert the second voice signal into a text for translation, and then convert the translated text into a voice signal to obtain a second translation signal.

Further, the electronic device needs to set a translated source language type as a second language used by a second user in advance, the target language type is a first language which can be understood by a first user using the first headset, and when the detected speech of the second speech signal is the source language type, the electronic device can translate the second speech signal of the second language into a second translation signal of the first language.

Step S2300, controlling the first earphone and the second earphone to obtain a second translation signal sent by the electronic device through the bluetooth link.

In one example, controlling the first headset and the second headset to acquire the second translation signal transmitted by the electronic device through the second translation link may include:

controlling the first earphone to receive the second translation signal through the Bluetooth link; and controlling the first earphone to monitor the Bluetooth link according to the channel parameters to acquire a second translation signal. Specifically, reference may be made to the foregoing description for controlling the first headset and the second headset to acquire the first translation signal sent by the electronic device through the bluetooth link, which is not described herein again.

And step S2400, controlling the first earphone and the second earphone to play the second translation signal.

In one or more embodiments of the invention, the translation method may further include:

after controlling the first earphone to play the first translation signal, controlling the first earphone to detect a first continuous time length during which the first voice signal is not input by the first user; and under the condition that the first continuous time exceeds a preset first time threshold, controlling the first earphone to send a first end notification of the end of the self translation process to the second earphone, so that the second earphone can acquire a second voice signal input by a second user under the condition that the second earphone receives the first end notification.

Specifically, the first duration may be a duration detected by the first earphone after the first translation signal is played, where the first user does not input the first voice signal.

In this embodiment, the first headset and the second headset are connected via bluetooth, and the first end notification may be transmitted via a TWS protocol.

The first time threshold may be preset in advance according to an application scenario or specific requirements, and may also be changed according to actual requirements of a user.

Correspondingly, the translation method can further comprise the following steps:

after controlling the second earphone to play the second translation signal, controlling the second earphone to detect a second continuous time length for which the second user does not input the second voice signal; and when the second continuous time length exceeds a preset second time length threshold value, controlling the second earphone to send a second ending notice of the end of the self translation process to the first earphone, so that the first earphone can acquire the first voice signal input by the first user under the condition that the first earphone receives the second ending notice.

Specifically, the second continuous duration may be a continuous duration detected by the second earphone after the second translation signal is played, where the second user does not input the second voice signal.

In this embodiment, the second end notification may be transmitted between the first headset and the second headset via a TWS protocol.

The second duration threshold may be preset in advance according to an application scenario or a specific requirement, and may also be changed according to an actual requirement of a user.

Further, the first duration threshold and the second duration threshold may be equal or unequal.

and under the condition that the first earphone sends the first end notice to the second earphone, controlling the first microphone and the first radio frequency sending unit of the first earphone to stop working.

Therefore, the power consumption of the first earphone in the process of not translating can be reduced, and the service life of the first earphone is prolonged.

and under the condition that the second earphone sends a second end notice to the first earphone, controlling a second microphone and a second radio frequency sending unit of the second earphone to stop working.

Therefore, the power consumption of the second earphone in the process of not translating can be reduced, and the service life of the second earphone is prolonged.

controlling a first earphone to detect whether a first event that a user inputs a first voice signal occurs;

and in the case of a first event, controlling a first microphone of the first earphone and a first radio frequency transmission unit to start working so as to acquire a first voice signal input by a first user.

The first event may include:

receiving a first voice signal input by a first user; and/or the presence of a gas in the gas,

a specified operation performed by the first user for the first headset.

In the case that the first event is the reception of a first voice signal input by a user, the first headset may detect whether the first event of the first voice signal input by the first user occurs through a voice activity detection algorithm. Voice Activity Detection (VAD), also known as speech activity detection, is a technique used for speech processing to detect the presence of a speech signal. Correspondingly, a first voice activity detection unit may be disposed in the first earphone, and configured to detect whether a first event that a first user inputs a first voice signal occurs.

In the case that the first event is a designated operation performed by the first user with respect to the first headset, the designated operation may be that the first user controls the first headset to perform a designated action, or that the first user clicks a designated key on the first headset.

When the first event is detected, it indicates that the first user wants to talk, and therefore, the first microphone and the first rf transmitting unit of the first earphone need to be controlled to start working, so as to ensure that the first earphone works normally.

controlling the second earphone to detect whether a second event that the user inputs a second voice signal occurs;

and under the condition that a second event occurs, controlling a second microphone of the second earphone and a second radio frequency transmission unit to start working so as to acquire a second voice signal input by a second user.

Wherein the second event may include:

receiving a second voice signal input by a second user; and/or the presence of a gas in the gas,

a specified operation performed by the second user with respect to the second headset.

In the case that the second event is the reception of a second voice signal input by the user, the second headset may detect whether the second event of the second voice signal input by the second user occurs through a voice activity detection algorithm. Correspondingly, a second voice activity detection unit may be disposed in the second earphone, and configured to detect whether a second event of a second user inputting a second voice signal occurs.

In the case that the second event is a designated operation performed by the second user for the second headset, the designated operation may be that the second user controls the second headset to perform a designated action, or that the second user clicks a designated key on the second headset.

When the second event is detected, it indicates that the second user wants to talk, and therefore, the second microphone and the second rf transmitting unit of the second headset need to be controlled to start working, so as to ensure that the second headset works normally.

In this embodiment, when the first microphone and the first radio frequency transmitting unit of the first earphone start to operate, the first earphone is controlled to send out a warning alarm, so that the first user can be reminded to start speaking, and the first user can be translated to the second user through the earphone pair and the electronic device.

under the condition that the second microphone of the second earphone and the first radio frequency transmitting unit are controlled to start working, the second earphone is controlled to send out a reminding alarm, so that the second user can be reminded to start speaking, and the reminding alarm can be translated to the first user through the earphone pair and the electronic equipment.

In one example, the manner of reminding the alarm may be, for example, playing a designated warning tone, emitting light, vibrating, or the like.

Taking an SCO link adopted by a Bluetooth link as an uplink as an example, when a first earphone is required to send a first voice signal to the electronic equipment through the SCO Bluetooth link, a first microphone of the first earphone is started, and a first radio frequency sending unit starts a radio frequency sending function; the second microphone of the second earphone is closed, and the second radio frequency transmitting unit closes the radio frequency transmitting function. The first earphone packages and packages a baseband packet of a first voice signal collected by the first microphone according to an HFP protocol, and sends the first voice signal to a Bluetooth address of the electronic device.

When the second earphone is required to send a second voice signal to the electronic equipment through the SCO Bluetooth link, a second microphone of the second earphone is started, and a second radio frequency sending unit starts a radio frequency sending function; the first microphone of the first earphone is closed, and the first radio frequency transmitting unit closes the radio frequency transmitting function. And the second earphone packages and packages the second voice signal acquired by the second microphone according to the same HFP protocol, and sends the second voice signal to the Bluetooth address of the electronic equipment.

The sending of the uplink voice signal may be performed by the first headset or the second headset, in which the HFP of the electronic device is always connected to the bluetooth address of the first headset (specifically, the first headset and the second headset are connected to the electronic device using the same bluetooth address).

Thus, during the translation process, the bluetooth link between the first earpiece and the electronic device need not be disconnected and reconnected, but rather the transmission of the voice signals both downstream and upstream is performed in a manner similar to the way a virtual connection is established between the second earpiece and the electronic device. The link delay in the whole process is thus very small, thus making possible the application of a true simultaneous interpretation in a pair of headphones.

By the translation method, users with two different languages wear the first earphone and the second earphone respectively, and can hear the voice translated from the voice of the other party to the voice of the native language respectively when talking in different languages, so that communication and conversation can be carried out without language barrier.

In one or more embodiments of the present invention, in order to ensure that the first user speaking interferes with the translation process during the second user speaking, the translation method may further include:

and under the condition that the first earphone is controlled to acquire a first voice signal input by a first user, the first earphone is controlled to send a first starting notice for starting the self translation process to the second earphone, so that under the condition that the second earphone receives the first starting notice and does not receive the first ending notice, the second earphone is controlled to stop acquiring a second voice signal input by a second user.

In the case that the second earphone receives the first start notification and does not receive the first end notification, it indicates that the earphone pair and the electronic device are performing a translation process on the first voice signal, and thus, interference between the voice signals is prevented by controlling the second earphone to stop acquiring the second voice signal input by the second user.

Under the condition that the second earphone receives the first starting notice and does not receive the first ending notice, if the second earphone detects that the second event occurs, the second earphone can remind the second user to wait by sending out a designated prompt tone, emitting light or vibrating.

Correspondingly, in order to ensure that the second user speaking interferes with the translation process during the first user speaking, the translation method may further include:

and under the condition that the second earphone is controlled to acquire the first voice signal input by the second user, the second earphone is controlled to send a second starting notice for starting the self translation process to the first earphone, so that the first earphone is controlled to stop acquiring the first voice signal input by the first user under the condition that the first earphone receives the second starting notice and does not receive the second ending notice.

And in the case that the first earphone receives the second starting notice and does not receive the second ending notice, the earphone pair and the electronic equipment are indicated to execute the translation process of the second voice signal, so that the interference among the voice signals is prevented by controlling the first earphone to stop acquiring the first voice signal input by the first user.

Under the condition that the first earphone receives the second starting notice and does not receive the second ending notice, if the first earphone detects that the first event occurs, the first earphone can remind the first user to wait by sending out a specified prompt tone, emitting light or vibrating.

In an embodiment of the present invention, the translation method may further include:

and under the condition that the first continuous time length detected by the first earphone and used for the first user not inputting the first voice signal exceeds a preset third time length threshold value, disconnecting the Bluetooth link between the first earphone and the electronic equipment.

In case the first duration of time, detected by the first headset, during which the first user does not input the first speech signal exceeds the preset third duration threshold, the translation process may be indicated to be finished, and thus, the bluetooth link between the first headset and the electronic device may be disconnected.

< translation System >

FIG. 4 is a schematic diagram of a translation system for implementing the translation method of the present invention.

In the translation system shown in fig. 4, a first user a uses a first headset M and a second user B uses a second headset S, which may be used to establish a bluetooth link with an electronic device P.

Referring to fig. 4, the first headset M may include a first voice activity detection unit M1, a first microphone M2, a first speaker M3, a first radio frequency transmission unit M4, a first radio frequency reception module M5, and a first processing unit M6.

The first speech model detecting unit M1 may be configured to detect whether a first event of the first user a inputting the first speech signal occurs. The first microphone M2 is used to acquire a first voice signal input by the first user a. The first processing unit M6 is configured to encapsulate the first voice signal according to the corresponding protocol, and obtain a corresponding data packet. The first rf transmitting unit M4 is configured to transmit the data packet obtained by the first processing unit M6 to the electronic device P. The first rf receiving unit M5 is configured to receive a data packet sent by the electronic device P. The first processing unit M6 is further configured to parse the received data packet to obtain a first translation signal. The first speaker M3 is used to play the first translation signal. The first processing unit M6 is further configured to control the first microphone M2 and the first rf transmitting unit M4 to start operation when the first speech model detecting unit M1 detects the occurrence of the first event; in the case of detecting that the continuous time period in which the first user a does not input the first voice signal exceeds the preset time period threshold, the first microphone M2 and the first radio frequency transmission unit M4 are controlled to stop working.

The second speech model detecting unit S1 may be used to detect whether a second event of the second user B inputting the second speech signal occurs. The second microphone S2 is used to acquire a second voice signal input by the second user B. The second processing unit S6 is configured to encapsulate the second voice signal according to the corresponding protocol, so as to obtain a corresponding data packet. The second rf transmitting unit S4 is configured to transmit the data packet obtained by the second processing unit S6 to the electronic device P. The second rf receiving unit S5 is configured to receive a data packet sent by the electronic device P. The second processing unit S6 is further configured to parse the received data packet to obtain a second translation signal. The second speaker S3 is used to play the second translation signal. The second processing unit S6 may be further configured to control the second microphone S2 and the second rf transmitting unit S4 to start operating when the second voice model detecting unit S1 detects that the second event occurs; and controlling the second microphone S2 and the second radio frequency transmission unit S4 to stop working under the condition that the continuous time length that the second user B does not input the second voice signal is detected to exceed the preset time length threshold.

In this embodiment, referring to fig. 4, the electronic device P may include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a speaker 1700, a microphone 1800, and the like.

Processor 1100 can be a mobile version processor. The memory 1200 includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like. The interface device 1300 includes, for example, a USB interface, a headphone interface, and the like. The communication device 1400 is, for example, capable of wired or wireless communication, and the communication device 1400 may include a bluetooth device for bluetooth communication with the first headset M or the second headset S through a bluetooth protocol. The display device 1500 is, for example, a liquid crystal display panel, a touch panel, or the like. The input device 1600 may include, for example, a touch screen, a keyboard, and the like. A user can input/output voice information through the speaker 1700 and the microphone 1800.

Although a plurality of apparatuses of the electronic device P are shown in fig. 4, the present invention may only relate to some of the apparatuses, for example, the electronic device P only relates to the memory 1200 and the processor 1100 and the communication apparatus 1400.

< example 1>

The following describes a process implemented by the translation method according to an embodiment of the present invention with a specific example. Example 1 describes a translation method according to the present embodiment, taking the translation system shown in fig. 4 as an example.

The translation method may include steps S2001 to S2015 as shown in fig. 2:

in step S2001, the first headset M establishes a bluetooth link with the electronic device P.

In step S2002, the first headset M detects whether a first event occurs in which the first user a inputs the first voice signal.

In step S2003, the first user a inputs a first voice signal using the first headset M.

In step S2004, the first headset M detects whether the translation process of the second headset S is finished, in case of detecting that the first event of the first user a inputting the first voice signal occurs.

In case the first headset M receives the second end notification sent by the second headset S, it is determined that the translation process of the second headset S is ended.

In step S2005, the first headphone M controls the first microphone and the first rf transmitting unit to start and send a warning alarm to remind the first user a to input the first voice signal and talk with the second user B using the second headphone S when detecting that the translation process of the second headphone S is finished.

In step S2006, the first headset M sends a first start notification and channel parameters of the bluetooth link to the second headset S.

In step S2007, the first headset M obtains the first voice signal input by the first user a, and uploads the first voice signal to the electronic device P through the bluetooth link.

In step S2008, the electronic device P translates the first voice signal to obtain a first translation signal.

In step S2009, the electronic device P sends the first translation signal through the bluetooth link.

In step S2010, the first headset M receives the first translation signal through the bluetooth link.

In step S2011, the second headset S monitors the bluetooth link according to the channel parameter to obtain the first translation signal.

In step S2012, the first headphone M plays the first translation signal.

Step S2013, the second headphone S plays the first translation signal.

In step S2014, the first headphone M detects a first duration during which the first user a does not input the first voice signal.

In step S2015, the first headphone M sends a first end notification to the second headphone when the first duration exceeds the preset first duration threshold, so as to notify that the translation process of the second headphone is finished.

In step S2016, the first headset M disconnects the bluetooth link with the electronic device P when the first duration exceeds the preset third duration threshold.

< example 2>

On the basis of the above example 1, the translation method may further include steps S3001 to S3015 as shown in fig. 3:

in step S3001, the second headset S detects whether a second event occurs when the second user B inputs the second voice signal.

In step S3002, the second user B inputs a second voice signal using the second headset S.

In step S3003, the second headset S detects whether the translation process of the first headset M is finished or not when detecting that the second event that the second user B inputs the second voice signal occurs.

In case the second headset S receives the first end notification sent by the first headset M, it is determined that the translation process of the first headset M is ended.

Step S3004, the second earphone S controls the second microphone and the second rf transmitting unit to start up and send out a warning alarm to remind the second user B that the second voice signal can be input to talk with the first user a using the first earphone M when detecting that the translation process of the first earphone M is finished.

In step S3005, the second headset S sends a second start notification to the first headset M.

Step S3006, the second earphone S obtains a second voice signal input by the second user B, and uploads the second voice signal to the electronic device P according to the channel parameter.

In step S3007, the electronic device P performs a translation process on the second speech signal to obtain a second translation signal.

In step S3008, the electronic device P transmits the second translation signal through the bluetooth link.

In step S3009, the first headset M receives the second translation signal through the bluetooth link.

Step S3010, the second headset S monitors the bluetooth link according to the channel parameter, and acquires the second translation signal.

In step S3011, the second headphone S plays the second translation signal.

In step S3012, the first headphone M plays the second translation signal.

In step S3013, the second headset S detects a second continuous duration for which the second user B does not input the second voice signal.

Step S3014, the second earphone S sends a first end notification to the first earphone when the second continuous duration exceeds a preset second duration threshold, so as to notify that the translation process of the first earphone is finished.

< apparatus embodiment >

In this embodiment, a translation apparatus 5000 for a headset pair is provided, wherein the headset pair comprises a corresponding first headset and a second headset, and the headset pair is used for establishing a bluetooth link with an electronic device.

As shown in fig. 5, the translating apparatus 5000 includes a first link establishing module 5100, a first voice uploading module 5200, a first translation obtaining module 5300, and a first signal playing module 5400, where the first link establishing module 5100 is configured to control the first earphone and the electronic device to establish a bluetooth link; the first voice uploading module 5200 is configured to control the first earphone to obtain a first voice signal input by a user, and upload the first voice signal to the electronic device through the bluetooth link, so that the electronic device translates the first voice signal to obtain a first translation signal; the first translation obtaining module 5300 is configured to control the first earphone and the second earphone to obtain a first translation signal sent by the electronic device through a bluetooth link; the first signal playing module 5400 is configured to control the first earphone and the second earphone to play the first translation signal.

In one or more embodiments of the present invention, as shown in fig. 6, the translation apparatus 5000 may further include: a channel parameter obtaining module 6100, a second voice uploading module 6200, a second translation obtaining module 6300, and a second signal playing module 6400. The channel parameter acquiring module 6100 is configured to control the second earphone to acquire the channel parameter of the bluetooth link; the second voice uploading module 6200 is configured to control the second headset to obtain a second voice signal input by a second user, and upload the second voice signal to the electronic device according to the channel parameter, so that the electronic device translates the second voice signal to obtain a second translation signal; the second translation acquiring module 6300 is configured to control the first headset and the second headset to acquire a second translation signal sent by the electronic device through the bluetooth link; the second signal playing module 6400 is configured to control the first earphone and the second earphone to play the second translation signal.

In one or more embodiments of the invention, the first translation obtaining module 5300 is further configured to: controlling the first earphone to receive the first translation signal through the Bluetooth link; and controlling the second earphone to monitor the Bluetooth link according to the channel parameters to acquire a first translation signal. The second translation obtaining module 6300 may also be configured to: controlling the first earphone to receive the second translation signal through the Bluetooth link; and controlling the second earphone to monitor the Bluetooth link according to the channel parameters to acquire a second translation signal.

In one or more embodiments of the present invention, the translation apparatus 5000 may further include:

and the module is used for controlling the first earphone to send a first end notification of the end of the self translation process to the second earphone when the first continuous time exceeds a preset first time threshold so that the second earphone can acquire a second voice signal input by a second user under the condition that the second earphone receives the first end notification.

a module for controlling the second earphone to detect a second continuous duration for which the second user does not input the second voice signal after controlling the second earphone to play the second translation signal;

and the module is used for controlling the second earphone to send a second ending notice of the end of the self translation process to the first earphone when the second continuous time length exceeds a preset second time length threshold value, so that the first earphone can acquire the first voice signal input by the first user under the condition that the first earphone receives the second ending notice.

and the module is used for controlling the first microphone and the first radio frequency transmitting unit of the first earphone to stop working under the condition that the first earphone transmits the first end notice to the second earphone.

and the module is used for controlling the second microphone of the second earphone and the second radio frequency transmitting unit to stop working under the condition that the second earphone transmits the second ending notice to the first earphone.

means for controlling a first earphone to detect whether a first event of a user inputting a first voice signal occurs;

and the module is used for controlling a first microphone of the first earphone and the first radio frequency transmission unit to start working under the condition that a first event occurs so as to acquire a first voice signal input by a first user.

means for controlling a second headset to detect whether a second event occurs in which a user inputs a second voice signal;

and the module is used for controlling a second microphone of the second earphone and the second radio frequency transmission unit to start working under the condition that a second event occurs so as to acquire a second voice signal input by a second user.

and the module is used for controlling the first earphone to send out a reminding alarm under the condition of controlling the first microphone and the first radio frequency transmitting unit of the first earphone to start working.

and the module is used for controlling the second earphone to send out a reminding alarm under the condition of controlling the second microphone and the second radio frequency sending unit of the second earphone to start working.

and the module is used for controlling the first earphone to send a first starting notice for starting the self translation process to the second earphone under the condition of controlling the first earphone to obtain the first voice signal input by the first user, and controlling the second earphone to stop obtaining the second voice signal input by the second user under the condition that the second earphone receives the first starting notice and does not receive the first ending notice.

and the module is used for controlling the second earphone to send a second starting notice for starting the self translation process to the first earphone under the condition of controlling the second earphone to obtain a second voice signal input by a second user, so as to control the first earphone to stop obtaining the first voice signal input by the first user under the condition that the first earphone receives the second starting notice and does not receive the second ending notice.

and the module is used for disconnecting the Bluetooth link between the first earphone and the electronic equipment when the first continuous time length of the first user for inputting no first voice signal exceeds a preset third time length threshold value.

In one or more embodiments of the invention, the bluetooth link is an SCO synchronous link or an ACL asynchronous link or a BLE link.

It will be appreciated by those skilled in the art that the translation means 5000 for a pair of headphones may be implemented in various ways. The translation means 5000 for the headset pair may be implemented, for example, by instructing a configuration processor. For example, the translation means 5000 for a headset pair may be implemented by storing instructions in ROM and reading the instructions from ROM into a programmable device when the device is started. For example, the translator 5000 for the headset pair may be solidified into a dedicated device (e.g., ASIC). The interpreting means 5000 for the pair of earphones may be divided into units independent of each other or may be implemented by combining them together. The translation means 5000 for the pair of headphones may be implemented by one of the various implementations described above, or may be implemented by a combination of two or more of the various implementations described above.

In this embodiment, the translating means 5000 for the earphone pair may have various implementation forms, for example, the translating means 5000 for the earphone pair may be any functional module running in a software product or an application providing a network access service, or a peripheral insert, a plug-in, a patch, etc. of the software product or the application, and may also be the software product or the application itself.

< earphone pair >

In this embodiment, a headset pair 7000 is further provided, where the headset pair 7000 includes a corresponding first headset and a corresponding second headset, and the first headset and/or the second headset may establish a corresponding bluetooth link with the electronic device through bluetooth.

In one embodiment, the headset pair 7000 may comprise the translation apparatus 5000 for a headset pair according to any embodiment of the present invention, for implementing the translation method for a headset pair according to any embodiment of the present invention.

In another embodiment, as shown in fig. 7, the headset pair 7000 may further comprise a processor 7100 and a memory 7200, the memory 7200 for storing executable instructions; the processor 7100 is configured to execute the headset pair 7000 according to the control of the instructions to perform the translation method for the headset pair according to any embodiment of the present invention.

< translation System >

In this embodiment, there is also provided a translation system comprising an electronic device and the headset pair of any of the preceding embodiments. The headset pair is used to perform the translation method for the headset pair of any embodiment of the present invention.

The electronic device is configured to: the method comprises the steps of establishing a Bluetooth link with a first earphone of an earphone pair, receiving a first voice signal uploaded by the first earphone through the Bluetooth link, translating the first voice signal to obtain a first translation signal, and sending the first translation signal to the first earphone through the Bluetooth link.

The above embodiments mainly focus on differences from other embodiments, but it should be clear to those skilled in the art that the above embodiments can be used alone or in combination with each other as needed.

The embodiments in the present disclosure are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments, but it should be clear to those skilled in the art that the embodiments described above can be used alone or in combination with each other as needed. In addition, for the device embodiment, since it corresponds to the method embodiment, the description is relatively simple, and for relevant points, refer to the description of the corresponding parts of the method embodiment. The system embodiments described above are merely illustrative, in that modules illustrated as separate components may or may not be physically separate.

The present invention may be an apparatus, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied therewith for causing a processor to implement various aspects of the present invention.

The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.

The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.

The computer program instructions for carrying out operations of the present invention may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present invention are implemented by personalizing an electronic circuit, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA), with state information of computer-readable program instructions, which can execute the computer-readable program instructions.

Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, by software, and by a combination of software and hardware are equivalent.

Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein were chosen in order to best explain the principles of the embodiments, the practical application, or technical improvements to the techniques in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.

Claims

1. A translation method for a headset pair, wherein the headset pair comprises a corresponding first headset and a second headset, the headset pair being configured to establish a bluetooth link with an electronic device; the translation method comprises the following steps:

2. The translation method according to claim 1, further comprising:

3. The translation method according to claim 2, wherein said controlling the first headset and the second headset to acquire the translation signal transmitted by the electronic device via the bluetooth link comprises:

4. The translation method according to claim 2, further comprising:

5. The translation method according to claim 4, further comprising:

6. The translation method according to claim 5, further comprising:

7. The translation method according to claim 6, further comprising:

8. The translation method according to claim 4, further comprising:

9. The translation method according to claim 1, further comprising:

10. The translation method according to claim 1, wherein said bluetooth link is an SCO synchronous link or an ACL asynchronous link or a BLE link.

11. A translation apparatus for a pair of headsets, the pair of headsets comprising corresponding first and second headsets, the pair of headsets being for establishing a bluetooth link with an electronic device; the translation device comprises:

12. A headset pair, characterized in that the headset pair comprises:

the translation device of claim 11; or,

a processor and a memory for storing instructions for controlling the processor to perform a translation method according to any of claims 1 to 10.

13. A translation system comprising an electronic device and a pair of headphones according to claim 12; the electronic equipment is used for establishing a Bluetooth link with a first earphone of the earphone pair, receiving a first voice signal uploaded by the first earphone through the Bluetooth link, translating the first voice signal to obtain a first translation signal, and sending the first translation signal to the first earphone through the Bluetooth link.