CN106687958A - Audio playing device, system and method - Google Patents

Abstract

The embodiments of the present invention relate to the field of audio playback technology, and more particularly to an audio playback device, system and method. The audio playing device for receiving the user heart rate and acceleration data transmitted by the earphone, identifying the user movement state according to the user heart rate and acceleration data, transmitting the user's heart rate and the user movement state to the server, receiving a music playlist that matches the user's heart rate and the user's motion state transmitted via the server, and playing the music in the music playlist. The invention can play music which matches the user's heart rate and the user's motion state, thereby increasing the pleasure feeling during the movement and achieving the better movement effect without the user manual operation; user's experience can be improved and the user's personality demand can be met.

Description

An audio playback device, system and method

technical field

The embodiments of the present invention relate to the technical field of audio playback, and in particular, to an audio playback device, system and method.

Background technique

With the continuous improvement of living standards, people pay more and more attention to health and choose various sports, such as walking, running, cycling, mountain climbing and so on. However, exercise itself is a very boring thing, especially when a person is running in the gym or on the playground, some methods that can help people relieve the boredom are needed, and listening to music is a choice for most people. Accompanied by music will not only make people feel happy, but also exciting music will stimulate people's potential for sports and cultivate a strong will, so as to achieve better sports effects.

However, different sports scenes need to be matched with suitable music. If you choose music that matches the rhythm of the person's heartbeat, people will move with the rhythm of the music, which can make the exercise easier and easier to persist; but If you choose inappropriate music, such as playing classical music while running fast, it will not be conducive to the control of your pace and breathing, and you will be more likely to be injured.

At present, mainstream audio playback devices cannot automatically select or switch the type of music to be played according to different exercise states, and there is no music library subdivided according to the music rhythm matched by different exercise states. Users need to manually select music categories, or play specified song. If it can automatically identify the user's exercise state, and automatically play or switch music that matches the user's current exercise state, rhythm and heart rate, it will undoubtedly greatly improve the user's experience and meet the user's individual needs.

Contents of the invention

Embodiments of the present invention provide an audio playback device, system and method, aiming to solve one of the above-mentioned technical problems in the prior art at least to a certain extent.

In order to solve the problems raised above, the technical solutions adopted in the embodiments of the present invention include:

An audio playback device, the audio playback device is used to receive user heart rate and acceleration data transmitted by earphones, identify the user's motion state according to the user's heart rate and acceleration data, and transmit the user's heart rate and user motion state to a server, The music playlist that matches the user's heart rate and the user's exercise state transmitted by the server is received, and the music in the music playlist is played.

The technical solution adopted by the embodiment of the present invention also includes: the audio playback device includes:

The first communication module: used for communication and interaction between the audio playback device, the earphone and the server;

State identification module: used to identify the corresponding user's motion state according to the user's heart rate and acceleration data;

Audio playing module: used for playing music corresponding to the music playlist transmitted by the server.

The technical solution adopted by the embodiment of the present invention also includes: the state identification module includes:

Data preprocessing unit: used for preprocessing the acceleration data transmitted by the earphone;

Feature extraction unit: used to extract acceleration feature information in different motion states according to the preprocessed acceleration data;

The first state recognition unit: used to train state recognition models under different motion states according to the extracted acceleration feature information, and preliminarily recognize the user's current motion state through the state recognition model;

The second state identification unit: used to calculate the user's heart rate value according to the user's heart rate, identify the user's typical exercise state according to the relationship between the user's heart rate value interval and the exercise state, and initially identify the user's current exercise state according to the state recognition model The typical motion state of the user is compensated to obtain the final motion state of the user.

The technical solution adopted by the embodiment of the present invention also includes: the data preprocessing unit preprocesses the acceleration data transmitted by the earphone, specifically: filtering the noise in the acceleration data transmitted by the earphone through a low-pass filter, and then using a third-order The moving average filter further filters random noise in the acceleration data filtered by the low-pass filter to obtain accurate acceleration data; and performs segmentation processing on the accurate acceleration data through different time windows.

Another technical solution adopted by the embodiment of the present invention is: an audio playback system, including an audio playback device, earphones, and a server;

The earphone is used to obtain the user's heart rate and acceleration data, and transmit the obtained user's heart rate and acceleration data to the audio playback device;

The audio playback device is used to identify the user's motion state according to the user's heart rate and acceleration data, and transmit the user's heart rate and user's motion state to a server;

The server is used to match the corresponding music database according to the user's motion state, select a music playlist whose music rhythm matches the user's heart rate in the matched music database, and transmit the music playlist to the audio playback device to play.

The technical solution adopted by the embodiment of the present invention further includes: the earphone includes a heart rate sensor, and the heart rate sensor is used to obtain the user's heart rate.

The technical solution adopted by the embodiment of the present invention further includes: the earphone further includes an acceleration sensor, and the acceleration sensor is used to acquire the acceleration data of the user; the acceleration data acquired by the acceleration sensor includes three directions of x, y, and z data.

The technical solution adopted by the embodiment of the present invention further includes: the earphone further includes a second communication module, and the second communication module is used to transmit the user's heart rate and acceleration data to an audio playback device connected to the earphone.

The technical solution adopted by the embodiment of the present invention also includes: the server includes:

Music classification module: used to classify music according to music type, language, movement state and music rhythm, and establish a corresponding music database according to the classification results;

Music matching module: used to receive the user's heart rate and user's motion state transmitted by the audio playback device, match the corresponding music database according to the user's motion state, select a music playlist whose music rhythm matches the user's heart rate in the matched music database, and set The music playlist is transmitted to an audio playback device.

The technical solution adopted by the embodiment of the present invention also includes: the music classification module classifies the music according to the music rhythm in the following manner: detect the rhythm point and rhythm value of the music from the PCM encoded music signal through the music rhythm detection algorithm, and The rhythm points and rhythm values classify the music in each motion state.

Yet another technical solution adopted by the embodiment of the present invention: an audio playback method, comprising the following steps:

Step a: Receive the user's heart rate and acceleration data transmitted by the headset;

Step b: Identify the user's exercise state according to the user's heart rate and acceleration data, and transmit the user's heart rate and user's exercise state to the server;

Step c: receiving the music playlist transmitted by the server and matching the user's heart rate and user's exercise state, and playing the music in the music playlist.

The technical solution adopted by the embodiment of the present invention also includes: in the step a, a heart rate sensor and an acceleration sensor are respectively provided in the earphone, the heart rate sensor is used to obtain the user's heart rate; the acceleration sensor is used to obtain x, Acceleration data in the three directions of y and z.

The technical solution adopted by the embodiment of the present invention also includes: in the step b, the identification method of identifying the user's exercise state according to the user's heart rate and acceleration data includes:

Step b1: Preprocessing the acceleration data transmitted by the earphone;

Step b2: extracting acceleration characteristic information under different motion states according to the preprocessed acceleration data;

Step b3: Train the state recognition model under different motion states according to the extracted acceleration feature information, and initially identify the user's current motion state through the state recognition model;

Step b4: Calculate the user's heart rate value according to the user's heart rate, identify the user's typical exercise state according to the relationship between the user's heart rate value interval and the exercise state, and based on the user's current exercise state initially identified by the state recognition model. The typical motion state is compensated to obtain the final user motion state.

The technical solution adopted by the embodiment of the present invention also includes: in the step b1, the data preprocessing specifically includes: filtering the noise in the acceleration data transmitted by the earphone through a low-pass filter, and then using a third-order moving average filter The device further filters random noise in the acceleration data filtered by the low-pass filter to obtain accurate acceleration data; and performs segmentation processing on the accurate acceleration data through different time windows.

The technical solution adopted by the embodiment of the present invention also includes: the step c further includes: classifying the music by the server according to the music type, language, exercise state and music rhythm, and establishing a corresponding music database according to the classification result.

The technical solution adopted by the embodiment of the present invention also includes: the classification method of classifying music according to the music rhythm is: detecting the rhythm point and rhythm value of the music from the PCM encoded music signal through the music rhythm detection algorithm, and according to the rhythm point of the music and tempo values classify the music for each motion state.

Compared with the prior art, the beneficial effect of the embodiment of the present invention is that: the audio playback device, system and method of the embodiment of the present invention obtain the user's heart rate and acceleration data in real time through the heart rate sensor and acceleration sensor in the earphone, and compare the user's heart rate and acceleration data The acceleration data is transmitted to the audio playback device connected to the earphone, and the audio playback device accurately identifies the corresponding user's motion state according to the user's heart rate and acceleration data; and transmits the user's heart rate and user motion state to the server, and the server transmits information related to the user's motion state. match, and the music rhythm matches the user's heart rate to play the music playlist. The invention can increase the sense of pleasure during exercise and achieve better exercise effects without manual operation by the user. Compared with the prior art, the present invention adds less hardware, lower cost, simple design, convenient development, expands the use function of ordinary earphones, helps to improve user experience, and meets the individual needs of users.

Description of drawings

Fig. 1 is a schematic structural diagram of an audio playback device according to an embodiment of the present invention;

Fig. 2 is a schematic structural diagram of an audio playback system according to an embodiment of the present invention;

Fig. 3 is a schematic diagram of data acquired by an acceleration sensor;

Figure 4 is the acceleration data obtained during walking;

Fig. 5 is a flowchart of an audio playing method according to an embodiment of the present invention.

detailed description

In order to facilitate the understanding of the present invention, the present invention will be described more fully below with reference to the associated drawings. Preferred embodiments of the invention are shown in the accompanying drawings. However, the present invention can be embodied in many different forms and is not limited to the embodiments described herein. On the contrary, these embodiments are provided to make the understanding of the disclosure of the present invention more thorough and comprehensive.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field of the invention. The terms used herein in the description of the present invention are for the purpose of describing specific embodiments only, and are not intended to limit the present invention.

Please refer to FIG. 1 , which is a schematic structural diagram of an audio playback device according to an embodiment of the present invention. The audio playback device 100 of the embodiment of the present invention is installed with application software. The application software can accurately identify the user's motion state according to the user's heart rate and acceleration data transmitted by the earphone, transmit the user's heart rate and user's motion state to the server, and receive the information transmitted by the server. A music playlist that matches the user's heart rate and the user's exercise state, and plays the music in the music playlist. Specifically, the audio playback device 100 includes a first communication module 110, a state identification module 120 and an audio playback module 130;

The first communication module 110 is used for communication and interaction between the audio playback device 100 and the earphone and the server; specifically, it includes: receiving the user's heart rate and acceleration data transmitted by the earphone, and transmitting the user's motion state identified by the user's heart rate and state recognition module 120 to the The server 300 receives the music playlist transmitted by the server and matches the user's heart rate and user's exercise state; the communication mode of the first communication module 110 includes but not limited to wired, bluetooth or WiFi.

The state identification module 120 is used to identify the corresponding user's exercise state according to the user's heart rate and acceleration data, and transmit the user's heart rate and user's exercise state to the server 300 from the first communication module 110 . Specifically, the state recognition module 120 includes a data preprocessing unit 121, a feature extraction unit 122, a first state recognition unit 123 and a second state recognition unit 124;

The data preprocessing unit 121 is used to preprocess the acceleration data acquired by the earphone; the preprocessing specifically includes: due to the high sensitivity of the acceleration sensor built in the earphone, the acquired acceleration data may contain body elements that are not related to the current state of motion. Abnormal jitter noise and random noise such as system measurement, the data preprocessing unit 121 first eliminates the abnormal jitter noise in the acceleration data through a 5Hz low-pass filter, and then uses a third-order moving average filter to further filter out the low-pass filtered The random noise in the acceleration data filtered by the filter is used to obtain accurate acceleration data; finally, the accurate acceleration data is segmented through different time windows, and the segmented acceleration data contains acceleration characteristic information such as data distribution characteristics and peak-to-valley characteristics.

The feature extraction unit 122 is used to extract the acceleration feature information under different motion states according to the preprocessed acceleration data; the distribution of acceleration data caused by different motion states is different, and the difference in the intensity of motion is reflected in the distribution center and degree of dispersion of the acceleration data Different, by extracting the distribution characteristics of acceleration data in different motion states and combining the peak and valley features, the acceleration characteristic information in different motion states can be obtained; among them, the data distribution characteristics include average value, average difference, interquartile difference, discrete Coefficients, Skew Coefficients, etc.

The first state recognition unit 123 is used to train state recognition models under different motion states according to the extracted acceleration feature information, and initially recognize the user's current motion state through the state recognition model, such as stationary, walking, running, climbing, cycling, etc.

The second state identification unit 124 is used to calculate the user's heart rate value according to the user's heart rate, identify the typical exercise state of the user according to the relationship between the user's heart rate value interval and the exercise state, and provide information to the user based on the user's current exercise state initially identified by the state recognition model. The typical exercise state of the user is compensated to obtain the final user’s exercise state; among them, in a static state, the user’s heart rate value is generally between 60 and 90, and the maximum heart rate of a healthy adult = 220-age, and generally does not exceed this value during exercise. The maximum heart rate, therefore, the user's typical exercise state can be initially identified based on the percentage of the maximum heart rate, as shown in Table 1 below:

Table 1 Relationship between heart rate value and exercise status

The embodiment of the present invention realizes very accurate identification of the user's motion state by combining the user's heart rate and acceleration data, and can distinguish motion states with relatively close heart rate data, such as sleeping and sitting still, and can also distinguish jogging, fast running, and sprinting The state of motion in different stages such as running.

The audio playing module 130 is used for playing the music in the music playlist transmitted by the server.

In the embodiment of the present invention, the audio playback device further includes a setting module, which is used to control the switch of the music switching function. When the user does not need to use the music switching function, the function can be turned off through the setting module to turn off the function. Finally, the earphone stops detecting the user's heart rate and acceleration data, and the audio playback device will resume to manually switch and play music; the setting module can also set parameters such as the interval time for switching music, the number of music in the music playlist transmitted by the server 300 according to individual needs, for example, 10 Minutes, half an hour, etc., to avoid switching music too frequently, or playing the same type of music in the same exercise state, which will affect the user experience.

Please refer to FIG. 2 , which is a schematic structural diagram of an audio playback system according to an embodiment of the present invention. The audio playback system of the embodiment of the present invention includes earphone 200, audio playback device 100 and server 300 shown in FIG.

Specifically, the earphone 200 includes an earphone body (not shown), a heart rate sensor 210, an acceleration sensor 220, and a second communication module 230; The sensor 210 and the acceleration sensor 220 are respectively connected to the second communication module 230 through a network.

Among them, the heart rate sensor 210 is a photoelectric heart rate sensor, which adopts the principle of optical detection. The incident light source adopts light of a certain wavelength (such as green light of 500nm-560nm, red light of 660nm-720nm), which is transmitted to the user at a certain angle, and then received After decomposing the light signal reflected by the user, the PPG signal (ECG signal data) is obtained, and the heart rate of the user is detected according to the PPG signal.

The acceleration sensor 220 is used to obtain the user's acceleration data during the wearing process, such as shaking, rising, falling, etc.; specifically, please refer to Figure 3 and Figure 4 together, Figure 3 is a schematic diagram of the data acquired by the acceleration sensor, and Figure 4 is the walking process Acceleration data obtained in . As shown in FIG. 3 , the data acquired by the acceleration sensor 220 includes acceleration data in three directions of x, y, and z. The greater the positive value of the acceleration data in each direction, the faster the acceleration in this direction is. The smaller the negative value of the data, the faster the acceleration in the opposite direction. Since the contact distance between the heart rate sensor 210 and the user's skin often changes during exercise, resulting in relatively large fluctuations in the obtained PPG signal, the acceleration data of the earphone 200 is synchronously acquired through the acceleration sensor 220 to compensate for the PPG obtained by the heart rate sensor 210 Signal.

The second communication module 230 is used to transmit the user's heart rate acquired by the heart rate sensor 210 and the acceleration data acquired by the acceleration sensor 220 to the audio playback device 100 connected to the earphone 200 . In the embodiment of the present invention, the audio playback device 100 includes, but is not limited to, a smart phone, a tablet computer, or a PC, and the connection method between the earphone 200 and the audio playback device 100 includes, but is not limited to, wired (3.5mm headphone jack), Bluetooth or WiFi, etc. Connection method, if it is a wired connection method, the communication method between the second communication module 230 and the audio playback device 100 is: use the Audio line and the MIC line for communication and interaction, if it is a Bluetooth or WiFi connection method, you can directly use the Bluetooth or WiFi communication interface Communicate and interact.

The earphone 200 of the embodiment of the present invention sets the heart rate sensor 210 and the acceleration sensor 220 respectively on the hardware basis of the ordinary earphone 200. During the process of wearing the earphone 200, the heart rate sensor 210 and the acceleration sensor 220 obtain the user's heart rate and acceleration data in real time. And the user's heart rate and acceleration data are transmitted to the audio playback device 100 connected to the earphone 200 in real time, so that the audio playback device 100 can play music that matches it according to the user's heart rate and acceleration data, without manual operation by the user; the earphone structure It is simple, convenient to develop, and expands the use function of the ordinary earphone 200.

The audio playback device 100 is equipped with supporting application software, and the application software can accurately identify the user's motion state according to the user's heart rate and acceleration data transmitted by the earphone 200, transmit the user's heart rate and user's motion state to the server 300, and receive the information transmitted by the server 300. A music playlist that matches the user's heart rate and the user's exercise state, and plays the music in the music playlist.

Server 300 is used to classify music according to parameters such as music type, language, exercise state (exercise type) and music rhythm, and selects a music playlist matching user's heart rate and user's exercise state from the music database, and plays the music The list is transmitted to an audio playback device for playback.

Specifically, the server 300 includes a music classification module 310 and a music matching module 320;

The music classification module 310 is used to classify music according to parameters such as music type, language, motion state and music rhythm, and establishes a corresponding music database according to the classification results; wherein, the server 300 includes music of various types and languages, First, classify according to music type and language, such as pop, rock, folk, electronic or European, Chinese, Japanese, Korean, etc., and then classify according to exercise status, such as sleeping, sitting, walking, jogging, etc.; and through the music rhythm detection algorithm From the PCM (Pulse Code Modulation, Pulse Code Modulation) coded music signal, the rhythm points and rhythm values of all music in each motion state are detected, and the music in each motion state is further classified according to the rhythm points and rhythm values of the music. Specifically, as shown in FIG. 4, it is a music database diagram of the embodiment of the present invention.

The music rhythm detection algorithm specifically includes: firstly, excitation detection, which analyzes most of the signal excitation positions in the music from the input signal; secondly, rhythm detection, which uses the obtained signal excitation positions to estimate several possible rhythm values of the target music; finally, Rhythm tracking, based on the output of rhythm detection, obtains the rhythm value of the music, and identifies the specific position of the rhythm point.

The music matching module 320 is used to receive the user's heart rate and the user's motion state transmitted by the audio playback device 100, match the corresponding music database according to the user's motion state, select a music playlist whose music rhythm matches the user's heart rate in the music database, and set The music playlist is transmitted to the audio player 100 for playing; in the embodiment of the present invention, at least one piece of music is included in the music playlist, which can be set by the setting module of the audio player 100; the music in the music playlist The information only includes basic information such as the title of the song, the singer, etc., and the actual music information such as lyrics is still in the server 300, that is, the server 300 will tell the audio playback device 100 the music that matches the user's exercise state and user's heart rate, so that the audio playback device 100 The corresponding music is played without buffering the entire piece of music in the audio playback device 100 to avoid occupying the storage space of the audio playback device 100 .

In the audio playback system of the embodiment of the present invention, a heart rate sensor and an acceleration sensor are respectively provided on the hardware basis of an ordinary earphone, and in the process of wearing the earphone, the heart rate sensor and the acceleration sensor can obtain the user's heart rate and acceleration data in real time, and the user's heart rate and acceleration The acceleration data is transmitted to the audio playback device connected to the headset in real time. The audio playback device accurately identifies the corresponding user's motion state according to the user's heart rate and acceleration data, and transmits the user's heart rate and user motion state to the server, and the server transmits the user's motion state. Matching, and the music playlist whose music rhythm matches the user's heart rate can be played to increase the pleasure during exercise and achieve a better exercise effect without the need for manual operation by the user. Compared with the prior art, the present invention adds less hardware, lower cost, simple design, convenient development, expands the use function of ordinary earphones, helps to improve user experience, and meets the individual needs of users.

Please refer to FIG. 5 , which is a flowchart of an audio playing method according to an embodiment of the present invention. The audio playing method of the embodiment of the present invention comprises the following steps:

Step 100: Obtain the user's heart rate and acceleration data in real time through the earphone;

In step 100, the earphones are equipped with a heart rate sensor and an acceleration sensor respectively. The heart rate sensor is a photoelectric heart rate sensor, which adopts the principle of optical detection. The light signal returned, and the light signal reflected by the user is decomposed to obtain the PPG signal, and the user's heart rate is detected through the PPG signal. The acceleration sensor is used to obtain the user's acceleration data such as shaking, rising, falling, etc. The data acquired by the acceleration sensor includes the acceleration data in the three directions of x, y, and z. The larger the positive value of the acceleration data in each direction, the faster the acceleration in this direction, and the smaller the negative value of the acceleration data in each direction, it means the opposite direction. The faster the acceleration in the direction.

Step 200: transmit the user's heart rate and acceleration data to the audio playback device connected to the earphone;

In step 200, the connection or communication methods between the earphone and the audio playback device include but not limited to wired, bluetooth or WiFi.

Step 300: The audio playback device receives the user's heart rate and acceleration data transmitted by the earphone, identifies the corresponding user's motion state according to the user's heart rate and acceleration data, and transmits the user's heart rate and user's motion state to the server;

In step 300, the audio playback device is installed with supporting application software, and the application software can accurately identify the user's motion state according to the user's heart rate and acceleration data. The identification method of the user's motion state specifically includes:

Step 301: Preprocessing the acceleration data transmitted by the earphone;

In step 301, data preprocessing includes: due to the high sensitivity of the acceleration sensor installed in the earphone, the acceleration data acquired by it may contain abnormal jitter noises such as body and other random noises that have nothing to do with the current state of motion and system measurements , the embodiment of the present invention first eliminates the abnormal jitter noise in the acceleration data through a 5Hz low-pass filter, and then uses a third-order moving average filter to further filter out the random noise in the acceleration data filtered by the low-pass filter to obtain accurate Acceleration data; Finally, the accurate acceleration data is segmented through different time windows, and the segmented acceleration data contains acceleration characteristic information such as data distribution characteristics and peak-valley characteristics.

Step 302: extracting acceleration feature information in different motion states according to the preprocessed acceleration data;

In step 302, the distribution of acceleration data caused by different motion states is different. At the same time, the intensity difference of motion is reflected in the distribution center and discrete degree of acceleration data. Value characteristics, so as to obtain the acceleration characteristic information under different motion states; among them, the data distribution characteristics include average value, average difference, interquartile difference, dispersion coefficient, skewness coefficient, etc.

Step 303: Train the state recognition model under different motion states according to the extracted acceleration feature information, and initially identify the user's current motion state through the state recognition model;

Step 304: Calculate the user's heart rate value according to the user's heart rate, identify the user's typical exercise state according to the relationship between the user's heart rate value interval and the exercise state, and compare the user's typical exercise state with the user's current exercise state initially identified by the state recognition model The state is compensated to obtain the final user motion state;

In step 304, different exercise states correspond to different heart rate ranges. In a static state, the user’s heart rate value range is generally between 60 and 90. The maximum heart rate of a healthy adult = 220-age, and generally does not exceed this maximum during exercise. Heart rate, therefore, can perform preliminary identification of the user's typical exercise state based on the percentage of the maximum heart rate. Since the contact distance between the heart rate sensor and the user's skin often changes during exercise, the user's heart rate obtained by the headset fluctuates relatively greatly. Therefore, the acceleration data of the headset is synchronously acquired by the acceleration sensor to compensate for the user's heart rate to achieve very accurate user movement. State recognition can distinguish exercise states with relatively close heart rate data, such as sleeping and sitting still, and can also distinguish exercise states in different stages such as jogging, fast running, and sprinting.

Step 400: The server selects a music playlist from the music database that matches the user's exercise state and whose music rhythm matches the user's heart rate, and transmits the music playlist to the audio playback device for playback;

In step 400, the server includes music of various types and languages. The server first classifies music according to the type and language of music, such as pop, rock, folk, electronic or European, Chinese, Japanese, Korean, etc., and then according to the exercise status Classify, such as sleeping, sitting still, walking, jogging, etc.; and detect the rhythm points and rhythm values of all music in each state of motion from the PCM encoded music signal through the music rhythm detection algorithm, according to the rhythm points and rhythm values of the music. The music for each state of motion is further categorized.

The music rhythm detection algorithm specifically includes: firstly, excitation detection, which analyzes most of the signal excitation positions in the music from the input signal; secondly, rhythm detection, which uses the obtained signal excitation positions to estimate several possible rhythm values of the target music; finally, Rhythm tracking, based on the output of rhythm detection, obtains the rhythm value of the music, and identifies the specific position of the rhythm point.

After the server receives the user's heart rate and the user's exercise state transmitted by the audio playback device, it matches the corresponding music database according to the user's exercise state, selects a music playlist whose music rhythm matches the user's heart rate in the music database, and plays the music The list is transmitted to the audio playback device for playback; in the embodiment of the present invention, the music play list includes at least one piece of music, which can be specifically set through the audio playback device.

In the audio playback method of the embodiment of the present invention, a heart rate sensor and an acceleration sensor are respectively provided on the hardware basis of an ordinary earphone. During the process of wearing the earphone, the user's heart rate and acceleration data are obtained in real time through the heart rate sensor and the acceleration sensor, and the user's heart rate and acceleration The acceleration data is transmitted to the audio playback device connected to the headset in real time. The audio playback device accurately identifies the corresponding user's motion state according to the user's heart rate and acceleration data, and transmits the user's heart rate and user motion state to the server, and the server transmits the user's motion state. Matching, and the music playlist whose music rhythm matches the user's heart rate can be played to increase the pleasure during exercise and achieve a better exercise effect without manual operation by the user. Compared with the prior art, the present invention adds less hardware, lower cost, simple design, convenient development, expands the use function of ordinary earphones, helps to improve user experience, and satisfies individual needs of users.

Through the above description of the implementations, those skilled in the art can clearly understand that each implementation can be implemented by means of software plus a necessary general hardware platform, and of course also by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, magnetic discs, optical discs, etc., including several instructions to make a computer device (which may be a personal computer, server, or network device, etc.) execute the methods described in various embodiments or some parts of the embodiments.

The above-mentioned embodiment is a preferred embodiment of the present invention, but the embodiment of the present invention is not limited by the above-mentioned embodiment, and any other changes, modifications, substitutions, combinations, Simplifications should be equivalent replacement methods, and all are included in the protection scope of the present invention.

Claims (16)

1. An audio playback device, characterized in that the audio playback device is used to receive the user's heart rate and acceleration data transmitted by the earphone, identify the user's motion state according to the user's heart rate and acceleration data, and compare the user's heart rate and user's motion state. The exercise state is transmitted to the server, and the music playlist that matches the user's heart rate and the user's exercise state is received from the server, and the music in the music playlist is played. 2. audio playback device according to claim 1, is characterized in that, described audio playback device comprises: The first communication module: used for communication and interaction between the audio playback device, the earphone and the server; State identification module: used to identify the corresponding user's motion state according to the user's heart rate and acceleration data; Audio playing module: used for playing music corresponding to the music playlist transmitted by the server. 3. audio playback device according to claim 2, is characterized in that, described state identification module comprises: Data preprocessing unit: used for preprocessing the acceleration data transmitted by the earphone; Feature extraction unit: used to extract acceleration feature information in different motion states according to the preprocessed acceleration data; The first state recognition unit: used to train state recognition models under different motion states according to the extracted acceleration feature information, and preliminarily recognize the user's current motion state through the state recognition model; The second state identification unit: used to calculate the user's heart rate value according to the user's heart rate, identify the user's typical exercise state according to the relationship between the user's heart rate value interval and the exercise state, and initially identify the user's current exercise state according to the state recognition model The typical motion state of the user is compensated to obtain the final motion state of the user. 4. The audio playback device according to claim 3, wherein the data preprocessing unit performs preprocessing on the acceleration data transmitted by the earphone, specifically: filtering the acceleration data transmitted by the earphone through a low-pass filter Noise, and then use the third-order moving average filter to further filter out the random noise in the acceleration data filtered by the low-pass filter to obtain accurate acceleration data; and segment the accurate acceleration data through different time windows deal with. 5. An audio playback system, characterized in that it comprises the audio playback device according to any one of claims 1 to 4, earphones and a server; The earphone is used to obtain the user's heart rate and acceleration data, and transmit the obtained user's heart rate and acceleration data to the audio playback device; The audio playback device is used to identify the user's motion state according to the user's heart rate and acceleration data, and transmit the user's heart rate and user's motion state to a server; The server is used to match the corresponding music database according to the user's motion state, select a music playlist whose music rhythm matches the user's heart rate in the matched music database, and transmit the music playlist to the audio playback device to play. 6 . The audio playback system according to claim 5 , wherein the earphone includes a heart rate sensor, and the heart rate sensor is used to obtain the user's heart rate. 7 . 7. The audio playback system according to claim 6, wherein the earphone further comprises an acceleration sensor, and the acceleration sensor is used to obtain acceleration data of the user; the acceleration data obtained by the acceleration sensor includes x, y, z data in three directions. 8. The audio playback system according to claim 7, wherein the earphone further comprises a second communication module, and the second communication module is used to transmit the user's heart rate and acceleration data to a device connected to the earphone. audio playback device. 9. audio playback system according to claim 5, is characterized in that, described server comprises: Music classification module: used to classify music according to music type, language, movement state and music rhythm, and establish a corresponding music database according to the classification results; Music matching module: used to receive the user's heart rate and user's motion state transmitted by the audio playback device, match the corresponding music database according to the user's motion state, select a music playlist whose music rhythm matches the user's heart rate in the matched music database, and set The music playlist is transmitted to an audio playback device. 10. audio playback system according to claim 9, is characterized in that, the classification mode that described music classification module classifies music according to music rhythm is: detect the rhythm point of music from PCM coded music signal by music rhythm detection algorithm And the rhythm value, according to the rhythm point and rhythm value of the music, the music in each motion state is classified. 11. An audio playback method, characterized in that, comprising the following steps: Step a: Receive the user's heart rate and acceleration data transmitted by the headset; Step b: Identify the user's exercise state according to the user's heart rate and acceleration data, and transmit the user's heart rate and user's exercise state to the server; Step c: receiving the music playlist transmitted by the server and matching the user's heart rate and user's exercise state, and playing the music in the music playlist. 12. The audio playback method according to claim 11, characterized in that, in the step a, a heart rate sensor and an acceleration sensor are respectively arranged in the earphone, and the heart rate sensor is used to obtain the user's heart rate; the acceleration The sensor is used to obtain acceleration data in the three directions of x, y, and z. 13. The audio playback method according to claim 12, wherein, in the step b, the identification method for identifying the user's motion state according to the user's heart rate and acceleration data includes: Step b1: Preprocessing the acceleration data transmitted by the earphone; Step b2: extracting acceleration characteristic information under different motion states according to the preprocessed acceleration data; Step b3: Train the state recognition model under different motion states according to the extracted acceleration feature information, and initially identify the user's current motion state through the state recognition model; Step b4: Calculate the user's heart rate value according to the user's heart rate, identify the user's typical exercise state according to the relationship between the user's heart rate value interval and the exercise state, and based on the user's current exercise state initially identified by the state recognition model. The typical motion state is compensated to obtain the final user motion state. 14. The audio playback method according to claim 13, wherein in the step b1, the data preprocessing specifically comprises: filtering the noise in the acceleration data transmitted by the earphone through a low-pass filter, and then A third-order moving average filter is used to further filter random noise in the acceleration data filtered by the low-pass filter to obtain accurate acceleration data; and the accurate acceleration data is segmented through different time windows. 15. The audio playback method according to claim 11, wherein said step c further comprises: classifying music by said server according to music type, language, motion state and music rhythm, and establishing corresponding music database. 16. The audio playback method according to claim 15, characterized in that, the classification method of classifying music according to the music rhythm is: detecting the rhythm point and the rhythm value of the music from the PCM coded music signal through the music rhythm detection algorithm , to classify the music in each motion state according to the rhythm point and rhythm value of the music.