CN108710486A - Audio playing method and device, earphone and computer readable storage medium - Google Patents

Abstract

The application relates to an audio playing method, an audio playing device, an earphone and a computer readable storage medium. The method comprises the following steps: establishing a communication connection with a server based on the identification of the headset when the headset is connected to a wireless network; when detecting that the earphone is inserted into the ear of a user, acquiring identity information related to the user wearing the earphone at present; sending an audio acquisition request carrying the identity information to a server, wherein the audio acquisition request is used for indicating the server to send audio information to the earphone according to the identity information; and receiving the audio information fed back by the server, and playing audio according to the audio information. By the method, the audio playing can be realized by acquiring the audio information returned by the server after the server is connected with the server, no additional audio electronic equipment is needed, the convenience of receiving the audio information by the user through the earphone is improved, and the user experience is improved.

Description

Audio playback method, device, earphone and computer-readable storage medium

technical field

The present application relates to the technical field of communication, and in particular to an audio playback method, device, earphone and computer-readable storage medium.

Background technique

With the intelligent development of communication equipment, earphones are used more and more frequently in people's daily life, and various activities such as listening to music, talking, and listening to video and voice are performed through earphones. Traditional earphones need to cooperate with additional audio electronic devices (such as mobile phones, computers, MP3, etc.) Music brings many limitations to the use of users, and the operation of listening to audio through earphones also requires cumbersome operations, which brings inconvenience to users.

Contents of the invention

Embodiments of the present application provide an audio playback method, device, earphone, and computer-readable storage medium, which can implement audio playback by acquiring audio information on a server, making the user's use process more convenient and quick.

An audio playback method applied to an earphone with a wireless connection function, the method comprising:

When the earphone is connected to the wireless network, establish a communication connection with the server based on the identity of the earphone;

When it is detected that the earphone is inserted into the user's ear, the identity information of the user who is currently wearing the earphone is obtained;

sending an audio acquisition request carrying the identity information to the server, where the audio acquisition request is used to instruct the server to send audio information to the earphone according to the identity information;

The audio information fed back by the server is received, and audio playback is performed according to the audio information.

An audio playback method, comprising:

receiving the verification request sent by the earphone, and establishing a communication connection with the earphone after verifying that the identity of the earphone is passed;

receiving an audio acquisition request sent by the earphone;

Sending audio information to the earphone according to the identity information carried in the audio acquisition request.

An audio playback device, said device comprising:

A communication connection module, configured to establish a communication connection with a server based on the identity of the earphone when the earphone is connected to the wireless network;

The identity acquisition module is used to obtain the identity information associated with the user currently wearing the earphone when it is detected that the earphone is inserted into the user's ear;

A request sending module, configured to send an audio acquisition request carrying the identity information to the server, where the audio acquisition request is used to instruct the server to send audio information to the earphone according to the identity information;

An audio playing module, configured to receive the audio information fed back by the server, and perform audio playback according to the audio information.

An audio playback device, said device comprising:

The verification request receiving module is used to receive the verification request sent by the earphone, and establish a communication connection with the earphone after verifying that the identity of the earphone is passed;

an audio request receiving module, configured to receive the audio acquisition request sent by the earphone;

An audio information sending module, configured to send audio information to the earphone according to the identity information carried in the audio acquisition request.

An earphone, comprising an electro-acoustic transducer, a memory, a processor, and a computer program stored in the memory and operable on the processor, the processor is electrically connected to the electro-acoustic transducer and the memory, The steps of the method are implemented when the processor executes the computer program.

A computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method are implemented.

The above-mentioned audio playing method, device, earphone and computer-readable storage medium, when the earphone is connected to the wireless network, establish a communication connection with the server based on the identification of the earphone, and when it is detected that the earphone is inserted into the user's ear, obtain the associated current wearing The identity information of the earphone user, sending an audio acquisition request carrying the identity information to the server, the audio acquisition request is used to instruct the server to send audio information to the earphone according to the identity information, and receive audio information fed back by the server, And perform audio playback according to the audio information, after connecting with the server, obtain the audio information returned by the server to realize audio playback, without the need for additional audio electronic equipment, increasing the convenience for users to receive audio information through earphones, Improve user experience.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

Fig. 1 is a schematic diagram of an application environment of an audio playback method in an embodiment;

Fig. 2 is a schematic diagram of the internal structure of the earphone in one embodiment;

Fig. 3 is a schematic flow chart of an audio playback method in an embodiment;

Fig. 4 is a schematic flow chart of an audio playback method in another embodiment;

Fig. 5 is a schematic flow chart of an audio playback method in another embodiment;

Fig. 6 is a schematic flow chart of an audio playback method in another embodiment;

Fig. 7 is a schematic flow chart of an audio playback method in another embodiment;

FIG. 8 is a schematic flow chart of an audio playback method in another embodiment;

Fig. 9 is a structural block diagram of an audio playback device in an embodiment;

FIG. 10 is a block diagram of a partial structure of an earphone related to a terminal provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field to which this application belongs. The terms used herein in the description of the application are only for the purpose of describing specific embodiments, and are not intended to limit the application. It can be understood that the terms "first", "second" and the like used in this application may be used to describe various elements herein, but these elements are not limited by these terms. These terms are only used to distinguish one element from another element. For example, a first application could be termed a second application, and, similarly, a second application could be termed the first application, without departing from the scope of the present application. Both the first application and the second application are applications, but they are not the same application.

Fig. 1 is a schematic diagram of an application environment of a data processing method in an embodiment. As shown in FIG. 1 , the application environment includes a server 110 and an earphone 120 communicating with the server 110 .

Wherein, the server 110 may be a cloud server, an independent physical server, or a cluster of physical servers. Audio information is stored on the server 110, including but not limited to songs, recordings, broadcasts, and the like. The types of the earphone 120 include but not limited to in-ear type, earphone type, head-mounted type, and ear-hook type. The earphone 120 and the server 110 can communicate wirelessly to realize data transmission.

The earphone 120 includes an acoustic-electric transducer 121, and the acoustic-electric transducer 121 is located at the tip of the earphone. When the tip of the earphone is positioned in the user's ear canal, the acoustic-electric transducer 121 outputs the audio signal acquired by the earphone 120 to in the user's ear canal. The acoustic-electric transducer 121 includes a loudspeaker and a microphone, the loudspeaker is used to play the audio signal, and the microphone is used to record the audio signal around the earphone 120. Optionally, the microphone can also collect the reflection and vibration of the audio signal played by the loudspeaker through the inner structure of the ear The resulting echo signal. In one embodiment, the speaker and the microphone are integrated.

Fig. 2 is a schematic diagram of the internal structure of the earphone in one embodiment. The headset 120 includes a processor, a memory, and a communication interface connected through a system bus. Wherein, the processor is used to provide computing and control capabilities to support the operation of the entire earphone 120 . The memory is used to store data, programs, and/or instruction codes, etc., and at least one computer program is stored on the memory, and the computer program can be executed by the processor to implement the audio playback method suitable for the earphone 120 provided in the embodiment of the present application. The memory may include a non-volatile storage medium such as a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random-access-memory (Random-Access-Memory, RAM). For example, in one embodiment, the memory includes non-volatile storage media and internal memory. Nonvolatile storage media store operating systems, databases, and computer programs. The database stores data related to implementing an audio playing method provided by the above embodiments. The computer program can be executed by a processor, so as to implement an audio playing method provided by various embodiments of the present application. Internal memory provides a cached operating environment for operating systems, databases, and computer programs in non-volatile storage media. The communication interface includes a mobile communication interface, a wifi communication interface, a bluetooth communication interface, etc., and the headset 120 communicates with the server 110 through the communication interface to obtain audio information on the server 110 .

Those skilled in the art can understand that the structure shown in FIG. 2 is only a block diagram of a part of the structure related to the solution of this application, and does not constitute a limitation on the earphone 120 to which the solution of this application is applied. The specific earphone 120 can be More or fewer components than shown in the figures may be included, or some components may be combined, or have a different arrangement of components.

As shown in FIG. 3 , it is a flowchart of an audio playback method in an embodiment. The audio playback method in this embodiment is described by taking the earphone running on the earphone in FIG. 1 as an example. The audio playback method includes the following steps 302 to 308:

Step 302: When the headset is connected to the wireless network, establish a communication connection with a server based on the identifier of the headset.

Among them, the wireless network (wireless network) is a network implemented by wireless communication technology, and the wireless network may include wireless networks (such as GPRS, 4G, 5G, etc.) and wireless local area networks (Wireless Local Area Networks, WLAN) implemented through public mobile communication networks. . The headset includes a wireless communication interface, and can be connected to a wireless network through the wireless communication interface. For example, when the headset is within the coverage of the wireless local area network, it can be connected to the wireless local area network through the built-in wifi communication module of the headset.

When the headset is connected to the wireless network, a communication connection is established with the server based on the identifier of the headset. The logo of the earphone refers to the identity of the earphone. The earphone sends the identity to the server through the wireless network. After the server verifies the identity of the earphone, the earphone establishes a connection with the server. After establishing a communication connection between the headset and the server, data can be transmitted to each other through the wireless network. For example, the headset can send requests or control instructions to the server, and the server can return relevant data according to the request sent by the headset or perform related operations according to the control instructions sent by the headset. .

Step 304: When it is detected that the earphone is inserted into the user's ear, obtain the identity information associated with the user currently wearing the earphone.

When the user needs to use the earphone for functions such as listening to music, watching videos, or answering calls, the user will put the earphone into the ear to receive the sound transmitted on the earphone. Wherein, an audio signal is pre-stored in the headset, and the audio signal can be used to detect user behavior and user information. Specifically, the audio signal can be stored in a memory in the headset, and the audio signal can be an audio signal of a specific frequency, such as an ultrasonic wave. When the earphone is in the user's ear, the audio signal is played, and the user cannot hear it, so that the detection of user behavior and user information can be completed without the user being aware of it.

Furthermore, the earpiece of the earphone will send out audio signals and collect the returned signal, and it can be judged whether the earpiece of the earphone is located in the user's ear canal by analyzing the returned signal. For example, an audio signal of a specific frequency (such as an ultrasonic signal) is sent out through the earpiece of the earphone. The audio signal will have different effects when passing through different obstacles. At this time, the signals around the earpiece are collected, and the collected signals are analyzed and compared. , if it is detected that the returned signal matches the human ear data, it is determined that the earphone has been inserted into the user's ear.

After detecting that the headset is inserted into the user's ear, obtain the identity information associated with the user who is currently wearing the headset. Specifically, the acoustic feature model associated with the internal structure of the current user's ear may be acquired according to the audio signal currently played in the earphone. The acoustic feature model can be understood as the spatial feature of the internal structure of the user's ear where the earphone is currently located, that is, different acoustic feature models can be used to represent different positions of the earphone in the user's ear. Furthermore, according to the acoustic feature model, it can also be used to generate an acoustic signature to verify the user's identity, that is, to generate the user's earprint information, where the earprint is a unique feature of people, just like fingerprints and facial appearance ,unique.

For example, when the user uses the headset for the first time, the user's earprint information needs to be initialized and stored in the earprint database built by the preset system, so as to verify the user's identity. Specifically, the system prompts the user to identify and store the user's earprint information after wearing the headset to a preset standard position, where the preset standard position can be set and adjusted according to the user's wearing habits. When the user wears the earphones, the system obtains the current user's earprint features, and calls the earprint information in the earprint database for data matching; if the current user's earprint features can match the earprint information in the earprint database, the system prompts User "authentication successful". If the earprint feature of the current user does not match the earprint information of the preset user, after storing the earprint information of the current user, the user is prompted "identity registration is successful".

Step 306: Send an audio acquisition request carrying the identity information to the server, where the audio acquisition request is used to instruct the server to send audio information to the earphone according to the identity information.

Specifically, the identity information is used to verify the user account preset on the server, and the user can generate a user account by registering on the server during use, and enter the acoustic feature model associated with the internal structure of the user's ear during registration. The earphone generates a data packet as an audio acquisition request according to the detected identity information of the currently wearing user, and sends the audio acquisition request to the server.

After receiving the audio acquisition request, the server extracts the user's identity information from the audio acquisition request, verifies the identity information, and sends audio information to the earphone when the identity information matches at least one preset identity information. Among them, multiple user identity information can be pre-stored on the server to verify the login operation of the current user. For example, the pre-stored identity information of users with different earphone IDs is stored in the user directory of the server, and one earphone ID can also store multiple The identity information of the user is not limited in this embodiment.

Step 308: Receive the audio information fed back by the server, and perform audio playback according to the audio information.

Wherein, the audio information can be understood as digitized sound data, and the earphone converts the digitized sound data into an analog audio signal output through digital-to-analog conversion (DAC), so as to realize sound playback. The audio information returned by the server can be songs, recordings, broadcasts, radio stations, etc. For example, the audio information can be pre-purchased songs in the user account, or pre-downloaded and favorited songs, etc.; the audio information can also be earphones It should be understood that the present embodiment is not limited to the above examples for the songs shared by the user to the cloud server.

In the above audio playback method, when the earphone is connected to the wireless network, a communication connection is established with the server based on the identification of the earphone; An audio acquisition request for the identity information, the audio acquisition request is used to instruct the server to send audio information to the earphone according to the identity information, receive the audio information fed back by the server, and perform audio playback according to the audio information, After being connected to the server, audio information returned by the server can be acquired to realize audio playback without requiring additional audio electronic equipment, which increases the convenience for users to receive audio information through earphones and improves user experience.

In one embodiment, as shown in FIG. 4, when the earphone is connected to the wireless network, a communication connection is established with the server based on the identity of the earphone, that is, step 302 includes:

Step 402: When the earphone is connected to the wireless network, obtain the earphone ID representing the intrinsic property of the earphone, and send a verification request with the earphone ID to the server.

Each earphone is correspondingly provided with a specific earphone logo, and the earphone logo is an inherent attribute on the earphone, which can be used as an identification mark of the earphone, that is, the identity of the earphone can be authenticated by identifying the earphone logo. The earphone identification may be a digital code, such as 001001, or a two-dimensional code, or a bar code, etc., which is not limited in this embodiment.

After the earphone is connected to the wireless network, a verification request with the earphone ID is sent to the server, so that the server verifies the identity of the earphone. Since the headphone ID that allows connection is stored on the server, the headphone ID can be pre-set on the server, or it can be stored in the connection list of the server after registering on the server during the use of the headset. For example, the earphone ID includes Headphone model, headphone brand, headphone type and other information.

Step 404: When the verification request matches the preset verification information, the headset establishes a communication connection with the server.

When the server recognizes that the earphone identification sent by the earphone is in the connection white list, the earphone and the server are connected in communication and can transmit data to each other through the wireless network. For example, the earphone can send a request or control instruction to the server, and the server can return relevant data according to the request sent by the earphone or perform related operations according to the control instruction sent by the earphone.

In the audio playback method provided in this embodiment, after the earphone is connected to the wireless network, the earphone establishes a communication connection with the server after the server verifies the earphone identity, so that the earphone can obtain audio information without additional audio electronic equipment. It improves the convenience for users to listen to sound through headphones.

In one embodiment, as shown in FIG. 5, when it is detected that the earphone is inserted into the user's ear, the identity information associated with the user currently wearing the earphone is obtained, that is, step 304 includes:

Step 502: Obtain an audio signal pre-stored in the earphone, and play the audio signal.

Wherein, an audio signal is pre-stored in the headset, and the audio signal can be used to detect user behavior and user information. Specifically, the audio signal can be stored in a memory in the headset, and the audio signal can be an audio signal of a specific frequency, such as an ultrasonic wave. When the earphone is in the user's ear, the audio signal is played, and the user cannot hear it, so that the detection of user behavior and user information can be completed without the user being aware of it.

In other embodiments, the audio signal can be music, voice signals from multimedia files played in the preset application, or sound signals beyond the hearing range of the user, etc. Human voice signals, etc.

Step 504: Based on the electro-acoustic transducer playing the audio signal, collect the echo signal formed after the audio signal is reflected and vibrated by the inner structure of the ear.

The earphone includes an electro-acoustic transducer, and the electro-acoustic transducer can be used as a loudspeaker to convert an electrical signal corresponding to an audio signal into a sound wave signal that a user can hear. At the same time, the electroacoustic transducer is very sensitive to the sound waves in the internal structure of the user's ear (ear canal), which can cause the vibration of the speaker paper cone, and drive the coil connected to the paper cone to cut the magnetic force line in the magnetic field of the permanent magnet. Generate a current that changes with the change of the sound wave (the phenomenon of generating current is called electromagnetic induction phenomenon in physics), and at the same time, the electromotive force of the audio frequency will be output at both ends of the coil. Therefore, the electro-acoustic transducer can also collect the acoustic echo signal generated by the reflection and vibration of the internal structure of the ear after the audio signal. That is, the electro-acoustic transducer can also be used as a microphone. Wherein, the principle of the microphone is to convert the acoustic signal into mechanical vibration and then convert it into an electrical signal after the electro-acoustic transducer performs energy reverse conversion, so as to realize the function of collecting the echo signal.

Electro-acoustic transducers, although different in type, function or working state, they all include two basic components, namely, the electrical system and the mechanical vibration system. Inside the electro-acoustic transducer, the electrical system and the mechanical vibration system pass through Certain physical effects are interconnected to complete the energy conversion.

Based on the electroacoustic transducer playing the audio signal, the acoustic echo signal formed by the reflection and vibration of the audio signal through the internal structure of the ear does not need to be additionally provided with a microphone in the earphone to collect the acoustic echo signal, which saves costs , simplifying the internal structure of the earphone.

Optionally, the acoustic echo signal formed by the reflection and vibration of the internal structure of the ear through the audio signal may also be collected through a microphone arranged in the earphone. Wherein, when the earphone is worn in the user's ear, the microphone is arranged on the side where the earphone is in contact with the internal structure of the user's ear, that is, the microphone is arranged on the earphone housing with the speaker through hole.

Step 506: Determine an acoustic feature model associated with the internal structure of the current user's ear according to the audio signal and the echo signal.

Among them, the audio signal played by the earphone speaker is s(t), the acoustic echo signal in the ear canal collected by the microphone is r(t), and the acoustic feature model associated with the internal structure of the current user's ear is represented by w(t). , so the following expression can be obtained:

r(t)=s(t)*w(t) (1)

In the formula, w(t) is a parameter that can reflect the coupling between the earphone and the user's ear, and can be used to characterize the acoustic characteristics of the space where the earphone is placed in the user's ear. In formula (1), the audio signal s(t) and the acoustic echo signal r(t) can be obtained by monitoring the audio circuit set by the earphone or electronic equipment, and then the acoustic features associated with the internal structure of the current user's ear can be obtained Model w(t). The acoustic feature model w(t) can be understood as the spatial feature of the internal structure of the user's ear where the earphone is currently located, that is, different acoustic feature models w(t) can be used to represent different positions of the earphone in the user's ear. Correspondingly, the acoustic feature model w(t) can also be used to characterize the earprint features of each user.

Further, a noise factor e(t) can also be added to the above formula (1), wherein the noise factor e(t) includes environmental noise and circuit noise; the environmental noise is when the audio signal s(t) is not played, the recording The environmental noise generated during the process of the acoustic echo signal can be collected by an additional microphone; the circuit noise is the noise caused by the built-in circuit of the earphone, which is an inherent property of the earphone. Adding the noise factor e(t) as a known parameter, after considering the noise factor e(t), the formula (1) can be revised as:

r(t)=s(t)*w(t)+e(t) (2)

In formula (2), the newly added noise factor e(t), the audio signal s(t) and the acoustic echo signal r(t) are all known parameters, and then the parameters related to the internal structure of the current user's ear can be obtained. The acoustic feature model w(t) of .

The audio playback method provided in this embodiment can represent the user's identity information through the acoustic feature model associated with the internal structure of the user's ear, which improves the security and convenience of user identity authentication. The user identity can be determined when the user identity is obtained, and the process of obtaining the user identity does not need to add an additional device, which saves the cost of the device.

In one embodiment, as shown in FIG. 6, after sending the audio acquisition request carrying the identity information to the server, it further includes:

Step 602: Verify the user account associated with the headset identifier based on the identity information.

After obtaining the user's identity information, the headset sends an audio acquisition request carrying the current user's identity information to the server. The server stores the user account information associated with the headset ID. The user can register on the server during the use of the headset. Generate a user account and enter the acoustic feature model associated with the internal structure of the user's ear during registration. After receiving the audio acquisition request, the server extracts the user's identity information from the audio acquisition request, verifies the identity information, and sends the identity verification result to the headset after the identity verification is completed.

Specifically, when the identity information matches at least one preset identity information stored in the server, the server sends a verification result of successful identity authentication to the headset. When the identity information does not match the preset identity information stored in the server, the server sends a verification result of identity authentication failure to the headset.

Step 604: Receive the verification result based on the identity information returned by the server, and prompt according to the verification result.

Specifically, when receiving the verification result of successful identity authentication returned by the server, the earphone can play a specific voice or vibration prompt to remind the user that the earphone has been connected to the server and log in to the user account, for example, the earphone can play "user verification successful" The voice prompt, or the headset emits a short vibration to prompt the user to log in successfully. When receiving the verification result of identity authentication failure returned by the server, the headset can play a specific voice or vibration prompt to remind the user that the identity authentication fails, that is, the current user's identity information does not match the user identity information bound to the headset. For example, the earphone can play the voice prompt of "the user cannot be identified, please confirm whether the user identity is registered!", or the earphone emits three long vibrations to prompt the user that the login failed and the user information needs to be registered.

In one embodiment, after the user account is successfully logged in, the headset may receive the audio playlist fed back by the server under the directory of the currently logged-in user, and play audio according to the audio playlist. Specifically, users will add their own music playlists during the process of listening to music, such as by purchasing, downloading, and collecting songs, or creating their favorite playlists. After receiving the audio playlist returned by the server, the headset plays the audio in the audio playlist.

In one embodiment, after the user account is successfully logged in, the earphone can also receive the shared audio fed back by the server, and play audio according to the shared audio. Since there are multiple user account information stored on the server, when the user logs in to the account, the audio data can be uploaded to the server, and the audio data uploaded to the server can be provided to other users on the server for acquisition, so as to realize the sharing of audio data . For example, user A uploads music 1 in the playlist of his account to the server, and the server will store music 1 in the database. When user B searches for music 1 through the server, the server will send music 1 already stored in the database to the account of user B, so that data sharing is realized between user A and user B, which saves the resource consumption of the user and makes it more convenient for the user to listen to music.

In one embodiment, as shown in Figure 7, the audio playback method also includes:

Step 702: Obtain health data representing the current user's physical characteristics based on the acoustic feature model.

Based on the acoustic feature model representing the spatial characteristics of the internal structure of the user's ear acquired by the earphone, the acoustic echo signal formed after the audio signal played by the earphone is reflected and vibrated by the internal structure of the ear is collected, and the acoustic echo signal is processed by low-pass filtering , that is, after eliminating the interference of external noise, a signal waveform diagram with a relatively clear period can be obtained. The signal period of the acoustic echo signal can be calculated by detecting the interval between two adjacent peaks. The signal period represents the current user's physical characteristics.

For example, the beating of the heart has a certain periodicity, and the beating of the heart will cause the contraction vibration of the ear canal wall. According to the period of the acquired acoustic echo signal, it can reflect the beating law of the heart to a certain extent, then the acoustic echo signal The inverse of the period is the heart rate. It can be understood that based on the same or similar principle, the period of the acoustic echo signal can also reflect the lateral pressure of the blood on the blood vessel wall, the electric wave changes during brain activity, etc., which will not be repeated here.

Step 704: Send an audio recommendation request with the health data to the server, the music recommendation request is used to instruct the server to match corresponding types of songs according to the health data, and generate a recommended song list.

In this embodiment, an audio recommendation request carrying the current user's health data is sent to the server, and the server can search for songs of a corresponding type according to the health data, and generate a recommended song list. For example, based on the health data, the current state, mood, environment, etc. of the current user can be analyzed, and corresponding recommended playlists can be generated based on song types adapted to different scenarios. For example, when it is detected that the user's heart rate is increasing, it is judged that the user may be in a state of exercise (such as running). At this time, the server generates a music playlist with a brisk rhythm and strong rhythm, and recommends it to the user to improve the user's listening experience. When it is detected that the user's brain wave contains a large amount of noise current, it indicates that the user's brain cannot concentrate at this time, and the user's mood is relatively restless. At this time, the server generates a melodious and slow-paced music playlist (such as light music ) to relax the user's mind. It can be understood that, the present embodiment is not limited to the above illustrations, and will not be listed here.

Step 706: Receive the recommended song list fed back by the server, and perform audio playback according to the recommended song list.

When receiving the recommended song list fed back by the server, perform song recommendation according to the recommended song list.

In the method provided in this embodiment, the health data representing the physical characteristics of the current user is sent to the server, the server searches for songs of the corresponding type according to the health data, and generates a recommended song list, and the earphone recommends songs according to the received recommended song list , according to the user's current state, mood, environment and other scenes, it can recommend songs with adaptive genres, so that the user can hear music that fits the current scene, enhance the user's sense of music substitution, and improve the user's listening experience.

In one embodiment, as shown in Figure 8, the audio playback method also includes:

Step 802: Detect an input operation on the earphone, and generate a corresponding operation instruction according to the input operation.

For example, the shell of the earphone is provided with a leak port for balancing the air pressure, through which the user's ear canal can be exhausted, and the size and shape of the leak port can be calibrated so that when different users wear the earphone and/or the earphone is located at the user's Different locations inside the ear have a substantially consistent frequency response. In the process of using the earphone, the user can perform input operations such as covering, plugging, and pressing the leakage port on the earphone shell. Specifically, the input operations include but are not limited to covering the preset position, covering the preset duration, and covering the preset frequency. Wait.

When the earphone receives the input operation, a frequency response curve associated with the acoustic structure of the earphone may be acquired according to the audio signal currently played in the earphone. Among them, the frequency response refers to the phenomenon that when an audio signal output with a constant voltage is connected to the system, the sound pressure generated by the earphone increases or attenuates with the frequency, and the phase changes with the frequency. The relationship between phase and frequency is called the frequency response. Since the leak on the earphone can exhaust the user's ear canal, when the leak is covered by the user, the acoustic structure of the earphone will change, and the air pressure in the user's ear canal will change, causing the frequency response in the user's ear canal to change. Variety. That is, the frequency response curve can be used to characterize the change of the acoustic structure of the earphone.

Further, the input operation is identified according to the frequency response curve, and an operation instruction corresponding to the input operation is generated.

Step 804: Send the operation instruction to the server, so as to instruct the server to perform an instruction interaction operation corresponding to the operation instruction.

Specifically, the earphone transmits the generated operation instruction to the server with which the earphone communicates, and instructs the server to perform an instruction interaction operation corresponding to the operation instruction. Wherein, the instruction interaction operation includes but is not limited to playing/pausing music, switching music songs, adjusting playback volume, switching channels, etc. Optionally, the instruction interaction operation can also be searching, collecting, downloading or sharing the audio signal being played, It can also be operations such as recording. Certainly, according to the usage habit of the user, the content of instruction interaction operation may also be added or deleted, which is not limited in this embodiment.

The method provided in this embodiment can realize command interaction control with the server according to the user's input operation on the earphone leak port, making the user's operation convenient and fast, improving the use efficiency and improving the user experience.

In one embodiment, an audio playback method is provided. The audio playback method in this embodiment is described by taking the server running on the server in FIG. 1 as an example. The audio playback method includes the following steps: receiving a verification request sent by the earphone, and establishing a communication connection with the earphone after the identification of the earphone is verified; receiving the audio acquisition request sent by the earphone; according to the audio acquisition request carried in the audio acquisition request, The identity information sends audio information to the headset.

The method provided in this embodiment can achieve audio playback by obtaining the audio information returned by the server after connecting to the server, without requiring additional audio electronic equipment, increasing the convenience for users to receive audio information through earphones, and improving user experience .

It should be understood that although the steps in the flow chart corresponding to the above embodiments are displayed sequentially as indicated by the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in Figures 3-8 may include a plurality of sub-steps or stages, these sub-steps or stages are not necessarily performed at the same time, but may be performed at different times, these sub-steps or stages The order of execution is not necessarily performed sequentially, but may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

As shown in FIG. 9 , in one embodiment, an audio playback device is provided, which includes: a communication connection module 910 , an identity acquisition module 920 , a request sending module 930 and an audio playback module 940 .

The communication connection module 910 is configured to establish a communication connection with a server based on the identification of the earphone when the earphone is connected to the wireless network.

The identity acquisition module 920 is configured to acquire the identity information associated with the user currently wearing the earphone when it is detected that the earphone is inserted into the user's ear.

The request sending module 930 is configured to send an audio acquisition request carrying the identity information to the server, and the audio acquisition request is used to instruct the server to send audio information to the earphone according to the identity information.

The audio playing module 940 is configured to receive the audio information fed back by the server, and perform audio playback according to the audio information.

In the above-mentioned audio playback device, when the earphone is connected to the wireless network, the communication connection module 910 establishes a communication connection with the server based on the identification of the earphone, and when it is detected that the earphone is inserted into the user's ear, the identity acquisition module 920 obtains the information associated with the user currently wearing the earphone. identity information, the request sending module 930 sends an audio acquisition request carrying the identity information to the server, and the audio playback module 940 receives the audio information fed back by the server, and performs audio playback according to the audio information. Through the above device, audio playback can be realized by obtaining the audio information returned by the server after being connected to the server, without requiring additional audio electronic equipment, increasing the convenience for users to receive audio information through earphones, and improving user experience.

In one embodiment, the communication connection module 910 is further configured to obtain the earphone ID representing the intrinsic properties of the earphone when the earphone is connected to the wireless network, and send a verification request with the earphone ID to the server; when the verification When the request matches the preset verification information, the headset establishes a communication connection with the server.

In one embodiment, the identity acquisition module 920 is also used to acquire the audio signal pre-stored in the earphone, and play the audio signal; based on the electro-acoustic transducer playing the audio signal, collect the audio signal through the ear The echo signal formed after the reflection and vibration of the internal structure; determine the acoustic feature model associated with the internal structure of the current user's ear according to the audio signal and the echo signal.

In one embodiment, the audio playback device further includes a prompt module, configured to verify the user account associated with the headset identifier based on the identity information; receive the verification result based on the identity information returned by the server, and The verification result will be prompted.

In one embodiment, the audio playback device further includes an audio recommendation module, configured to obtain health data representing the physical characteristics of the current user based on the acoustic feature model; send an audio recommendation request with the health data to the server, The music recommendation request is used to instruct the server to match corresponding types of songs according to the health data, and generate a recommended song list; receive the recommended song list fed back by the server, and perform audio playback according to the recommended song list.

In one embodiment, the audio playback device further includes an instruction operation module, configured to detect an input operation acting on the earphone, generate a corresponding operation instruction according to the input operation; and send the operation instruction to the server , to instruct the server to perform an instruction interaction operation corresponding to the operation instruction.

In one embodiment, there is also provided an audio playback device, the device comprising:

The verification request receiving module is configured to receive the verification request sent by the earphone, and establish a communication connection with the earphone after the identification of the earphone is verified.

The audio request receiving module is configured to receive the audio acquisition request sent by the earphone.

An audio information sending module, configured to send audio information to the earphone according to the identity information carried in the audio acquisition request.

The division of each module in the above audio playback device is only for illustration. In other embodiments, the audio playback device can be divided into different modules according to needs, so as to complete all or part of the functions of the above audio playback device.

For specific limitations on the audio playback device, refer to the above-mentioned limitations on the audio playback method, which will not be repeated here. Each module in the above-mentioned audio playback device can be fully or partially realized by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of the computer device in the form of software, so that the processor can invoke and execute the corresponding operations of the above-mentioned modules.

The implementation of each module in the audio playback device provided in the embodiment of the present application may be in the form of a computer program. The computer program can run on a terminal or a server. The program modules constituted by the computer program can be stored in the memory of the terminal or server. When the computer program is executed by the processor, the steps of the audio playing method described in the embodiments of the present application are implemented.

The embodiment of the present application also provides an earphone, which includes an electro-acoustic transducer, a memory, a processor, and a computer program stored in the memory and operable on the processor, the processor and the electro-acoustic transducer The processor is electrically connected to the memory, and when the processor executes the computer program, the audio playing method as described in the above embodiments is implemented.

The embodiment of the present application also provides a computer-readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the Describes the audio playback method.

The embodiment of the present application also provides a computer program product. A computer program product containing instructions, when running on a computer, causes the computer to execute the audio playing method described in the above embodiments.

The embodiment of the present application also provides a terminal device. As shown in FIG. 10 , for ease of description, only the parts related to the embodiment of the present application are shown. For specific technical details not disclosed, please refer to the method part of the embodiment of the present application. Take the terminal device as a headset as an example:

FIG. 10 is a block diagram of a partial structure of an earphone related to a terminal provided by an embodiment of the present application. Referring to FIG. 10 , the headset includes: a radio frequency (Radio Frequency, RF) circuit 1010, a memory 1020, an input unit 1030, a display unit 1040, a sensor 1050, an audio circuit 1060, a wireless fidelity (wireless fidelity, WiFi) module 1070, and a processor 1080 , and power supply 1090 and other components. Those skilled in the art can understand that the earphone structure shown in FIG. 10 is not limited to the earphone, and may include more or less components than shown in the figure, or combine some components, or arrange different components.

Among them, the RF circuit 1010 can be used for sending and receiving information or receiving and sending signals during a call. After receiving the downlink information from the base station, it can be processed by the processor 1080; it can also send uplink data to the base station. Generally, an RF circuit includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, LNA), a duplexer, and the like. In addition, RF circuitry 1010 may also communicate with networks and other devices via wireless communications. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile Communication (Global System of Mobile communication, GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access, CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), etc.

The memory 1020 can be used to store software programs and modules, and the processor 1080 executes various functional applications and data processing of the earphone by running the software programs and modules stored in the memory 1020 . The memory 1020 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as an application program for a sound playback function, an application program for an image playback function, etc.); The data storage area can store data (such as audio data, address book, etc.) created according to the use of the headset, and the like. In addition, the memory 1020 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The input unit 1030 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the earphone 1000 . Specifically, the input unit 1030 may include a touch panel 1031 and other input devices 1032 . The touch panel 1031, which can also be referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger, a stylus, etc. on the touch panel 1031 or near the touch panel 1031 operation), and drive the corresponding connection device according to the preset program. In one embodiment, the touch panel 1031 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the to the processor 1080, and can receive and execute commands sent by the processor 1080. In addition, the touch panel 1031 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1031 , the input unit 1030 may also include other input devices 1032 . Specifically, other input devices 1032 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control keys, switch keys, etc.), and the like.

The display unit 1040 may be used to display information input by or provided to the user and various menus of the earphone. The display unit 1040 may include a display panel 1041 . In one embodiment, the display panel 1041 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like. In one embodiment, the touch panel 1031 can cover the display panel 1041, and when the touch panel 1031 detects a touch operation on or near it, the touch operation is sent to the processor 1080 to determine the type of the touch event, and then the processor 1080 according to the The type of touch event provides a corresponding visual output on the display panel 1041 . Although in FIG. 10, the touch panel 1031 and the display panel 1041 are used as two independent components to realize the input and input functions of the earphone, in some embodiments, the touch panel 1031 and the display panel 1041 can be integrated and Realize the input and output functions of the earphone.

The headset 1000 may also include at least one sensor 1050, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 1041 and/or when the earphone is moved to the ear. or backlight. The motion sensor can include an acceleration sensor, through which the magnitude of acceleration in various directions can be detected, and the magnitude and direction of gravity can be detected when stationary, and can be used for applications that recognize the posture of the earphone (such as switching between horizontal and vertical screens), vibration recognition related functions (such as pedometer, tap), etc.; in addition, the headset can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors.

Audio circuitry 1060, speaker 1061 and microphone 1062 may provide an audio interface between the user and the headset. The audio circuit 1060 can transmit the electrical signal converted from the received audio data to the speaker 1061, and the speaker 1061 converts it into an audio signal for output; After being received, it is converted into audio data, and after being processed by the output processor 1080, the audio data can be sent to another earphone through the RF circuit 1010, or the audio data can be output to the memory 1020 for subsequent processing.

WiFi is a short-distance wireless transmission technology. The headset can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 1070, which provides users with wireless broadband Internet access. Although FIG. 10 shows the WiFi module 1070, it can be understood that it is not an essential component of the headset 1000 and can be omitted as required.

The processor 1080 is the control center of the earphone. It uses various interfaces and lines to connect various parts of the entire earphone. By running or executing software programs and/or modules stored in the memory 1020, and calling data stored in the memory 1020, execution Various functions and processing data of the headset, so as to monitor the headset as a whole. In one embodiment, processor 1080 may include one or more processing units. In one embodiment, the processor 1080 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, application programs, etc.; the modem processor mainly processes wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 1080 .

The earphone 1000 also includes a power supply 1090 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 1080 through a power management system, so that functions such as charging, discharging, and power consumption management can be implemented through the power management system.

In an embodiment, the headset 1000 may also include a Bluetooth module and the like.

In this embodiment of the present application, when the processor 1080 included in the terminal device executes the computer program stored in the memory, the audio playing method described in the foregoing embodiments is realized.

When the computer program running on the processor is executed, it can realize audio playback by connecting to the server and obtaining the audio information returned by the server, without the need for additional audio electronic equipment, which increases the convenience for users to receive audio information through earphones and improve user experience.

Any reference to memory, storage, database, or other medium as used herein may include non-volatile and/or volatile memory. Suitable nonvolatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in many forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchronous Synchlink DRAM (SLDRAM), Memory Bus (Rambus) Direct RAM (RDRAM), Direct Memory Bus Dynamic RAM (DRDRAM), and Memory Bus Dynamic RAM (RDRAM).

The above-mentioned embodiments only express several implementation modes of the present application, and the description thereof is relatively specific and detailed, but should not be construed as limiting the patent scope of the present application. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the scope of protection of the patent application should be based on the appended claims.

Claims (15)

1. An audio playback method, characterized in that, being applied to earphones with a wireless connection function, the method comprises: When the earphone is connected to the wireless network, establish a communication connection with the server based on the identity of the earphone; When it is detected that the earphone is inserted into the user's ear, the identity information of the user who is currently wearing the earphone is obtained; sending an audio acquisition request carrying the identity information to the server, where the audio acquisition request is used to instruct the server to send audio information to the earphone according to the identity information; The audio information fed back by the server is received, and audio playback is performed according to the audio information. 2. The method according to claim 1, wherein when the earphone is connected to the wireless network, establishing a communication connection with the server based on the identity of the earphone comprises: When the earphone is connected to the wireless network, obtain the earphone ID representing the intrinsic property of the earphone, and send a verification request with the earphone ID to the server; When the verification request matches the preset verification information, the headset establishes a communication connection with the server. 3. The method according to claim 1, wherein when it is detected that the earphone is inserted into the user's ear, acquiring the identity information associated with the user currently wearing the earphone comprises: Obtain the audio signal pre-stored in the earphone, and play the audio signal; Based on the electro-acoustic transducer playing the audio signal, collecting the echo signal formed after the audio signal passes through the reflection and vibration of the internal structure of the ear; An acoustic feature model associated with the internal structure of the current user's ear is determined according to the audio signal and the echo signal. 4. The method according to claim 2, further comprising: after sending the audio acquisition request carrying the identity information to the server: Verifying a user account associated with the headset identifier based on the identity information; receiving the verification result based on the identity information returned by the server, and prompting according to the verification result. 5. The method according to claim 4, wherein the receiving the audio information fed back by the server and performing audio playback according to the audio information comprises: Receive the audio playlist under the currently logged-in user directory fed back by the server, and perform audio playback according to the audio playlist; or receiving the shared audio fed back by the server, and performing audio playback according to the shared audio; wherein the shared audio is the audio uploaded by the user to the server. 6. The method according to claim 2, characterized in that the method further comprises: Acquiring health data representing the physical characteristics of the current user based on the acoustic feature model; Sending an audio recommendation request with the health data to the server, the music recommendation request is used to instruct the server to match corresponding types of songs according to the health data, and generate a recommended song list; receiving the recommended song list fed back by the server, and performing audio playback according to the recommended song list. 7. The method according to any one of claims 1-6, wherein the method further comprises: Detecting an input operation acting on the earphone, and generating a corresponding operation instruction according to the input operation; Sending the operation instruction to the server to instruct the server to perform an instruction interaction operation corresponding to the operation instruction. 8. An audio playback method, characterized in that, comprising: receiving the verification request sent by the earphone, and establishing a communication connection with the earphone after verifying that the identity of the earphone is passed; receiving an audio acquisition request sent by the earphone; Sending audio information to the earphone according to the identity information carried in the audio acquisition request. 9. An audio playback device, characterized in that the device comprises: A communication connection module, configured to establish a communication connection with a server based on the identity of the earphone when the earphone is connected to the wireless network; The identity acquisition module is used to obtain the identity information associated with the user currently wearing the earphone when it is detected that the earphone is inserted into the user's ear; A request sending module, configured to send an audio acquisition request carrying the identity information to the server, where the audio acquisition request is used to instruct the server to send audio information to the earphone according to the identity information; An audio playing module, configured to receive the audio information fed back by the server, and perform audio playback according to the audio information. 10. An audio playback device, characterized in that the device comprises: The verification request receiving module is used to receive the verification request sent by the earphone, and establish a communication connection with the earphone after verifying that the identity of the earphone is passed; an audio request receiving module, configured to receive the audio acquisition request sent by the earphone; An audio information sending module, configured to send audio information to the earphone according to the identity information carried in the audio acquisition request. 11. An earphone, characterized in that it comprises an electro-acoustic transducer, a memory, a processor and a computer program stored on the memory and operable on the processor, the processor and the electro-acoustic transducer and the The memory is electrically connected, and the processor implements the steps of the method according to any one of claims 1 to 7 when executing the computer program. 12 . The earphone according to claim 11 , wherein the electro-acoustic transducer is used to play the audio signal, and to collect echo signals formed after the audio signal is reflected and vibrated by internal structures of the ear. 13 . 13. The earphone according to claim 12, wherein the electroacoustic transducer comprises a loudspeaker and a microphone, the loudspeaker is used to play the audio signal, and the microphone is used to collect the audio signal through the ear The echo signal formed by the reflection and vibration of the internal structure. 14. The earphone according to claim 13, wherein the speaker and the microphone are integrated. 15. A computer-readable storage medium, on which a computer program is stored, wherein, when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.