CN114422934A - Media system and method for adaptation to hearing loss - Google Patents

Abstract

The present invention relates to a media system and method for adapting to hearing loss, and specifically describes a media system and a method for adapting to a user's hearing loss using the media system. The method includes selecting an individual level and frequency dependent audio filter corresponding to the user's hearing loss profile. The personal level and frequency dependent audio filter may be one of several level and frequency dependent audio filters with corresponding average gain levels and corresponding gain profiles. The adaptive audio output signal may be generated by applying a personal level and frequency dependent audio filter to the audio input signal to enhance the audio input signal based on the input level and input frequency of the audio input signal. The audio output signal may be played by the audio output device to deliver speech or music clearly perceived by the user despite the user's hearing loss. Other aspects are also described and claimed for protection.

Description

Media system and method for adaptation to hearing loss

This divisional application is based on the divisional application of the Chinese patent application with the application number of 202010482726.9 and the filing date of June 1, 2020, and the invention name is "data processing device".

technical field

The present invention discloses aspects related to audio-capable media systems. More particularly, aspects related to media systems for playing audio content to a user are disclosed.

Background technique

Audio-enabled devices, such as laptops, tablets, or other mobile devices, can deliver audio content to users. For example, a user may use an audio-enabled device to listen to audio content. The audio content may be pre-stored audio content played by the speaker to the user, such as music files, podcasts, virtual assistant messages, and the like. Alternatively, the rendered audio content may be real-time audio content, such as audio content from phone calls, video conferences, and the like.

Noise exposure, aging, or other factors can cause an individual to experience hearing loss. Individual hearing loss profiles can vary widely, and can even be attributed to people who have not been diagnosed with hearing loss. That is, each individual may have some frequency-dependent loudness perception that differs from normal. Such differences may vary widely across the population and may correspond to the spectrum of the population's hearing loss curve. Given that each individual hears different sounds, each individual may have a different experience with audio content reproduced to several people in the same way. For example, a person with substantial hearing loss at a particular frequency may experience muted playback of audio content that contains substantial components at that frequency. In contrast, a person without hearing loss at a particular frequency may experience clear playback of the same audio content.

An individual may adjust the audio-enabled device to modify the playback of audio content in order to enhance the user's experience. For example, a person with substantial hearing loss at certain frequencies may adjust the overall level of audio signal volume to increase the loudness of the reproduced audio. Such adjustments can be made in the hope that the modified playback will compensate for the person's hearing loss.

SUMMARY OF THE INVENTION

Modifying the playback volume adjustment as described above may not compensate for hearing loss in a personalized way. For example, increasing the overall level of the audio signal may increase the loudness, but increase the loudness across the audible frequency range, regardless of whether the user experiences hearing loss across the entire range. The result of such massive leveling can be an uncomfortable loud and disturbing listening experience for the user.

The present invention describes a media system and a method of using the media system to accommodate a user's hearing loss. In one aspect, the media system performs the method by selecting an audio filter (eg, a level and frequency dependent audio filter) from a number of audio filters (eg, a number of level and frequency dependent audio filters) ; and applying the audio filter to the audio input signal to generate an audio output signal that can be played back to the user. The audio filter may be a personal audio filter, such as a personal level and frequency dependent audio filter corresponding to the user's hearing loss profile.

Selection of the individual level and frequency dependent audio filters may be made by the media system from among level and frequency dependent audio filters corresponding to respective preset hearing loss curves. Since the level and frequency dependent audio filters have corresponding average gain levels and corresponding gain profiles corresponding to the average loss levels and loss profiles of the hearing loss profile, the level and frequency dependent audio filters compensate for the preset hearing loss profile . The personal level and frequency dependent audio filter can amplify the audio input signal based on the input level and input frequency of the audio input signal, and thus, the user can experience the sound from the reproduced audio output signal normally (rather than playing as uncorrected audio). muting as in the case of the input signal).

Selection of individual level and frequency dependent audio filters can be made through a short and straightforward registration process. In one aspect, the first audio signal is output during a first stage of the registration process using one or more predetermined gain levels or using a first set of level and frequency dependent audio filters having different average gain levels. The first audio signal may be played back to a user experiencing audio content (eg, speech) at different loudnesses. The user can select audible or preferred loudness. More specifically, the media system receives the selection of the personal average gain level in response to outputting the first audio signal using one or more predetermined gain levels or a first set of one or more levels and a frequency-dependent audio filter. Selection of the personal average gain level may indicate that the first audio signal (eg, a speech signal) is output at a level audible to the user. Selection of the personal average gain level may indicate that the first audio signal is output at a preferred loudness. The media system may select the personal level and frequency dependent audio filter based in part on the personal level and frequency dependent audio filter having the personal average gain level. For example, the respective average gain levels of the personal level and frequency dependent audio filter may be equal to the personal average gain levels.

In one aspect, the second audio signal is output using a second set of level and frequency dependent audio filters having different gain profiles during the second stage of the registration process. A second set of level and frequency dependent audio filters may be selected for exploration based on user selections made during the first stage of the registration process. For example, each level and frequency dependent audio filter in the second set may have an individual average gain level corresponding to the audibility selection made during the first stage. The second audio signal may be played back to a user experiencing the audio content (eg, music) in a different tone or tone setting and selecting a preferred tone or tone setting. More specifically, the media system receives the selection of the personal gain profile in response to outputting the second audio signal. The media system may select the personal level and frequency dependent audio filter based in part on the personal level and frequency dependent audio filter having the personal gain profile. For example, the respective gain profiles of the personal level and frequency dependent audio filters may be equal to the personal gain profiles.

In one aspect, the registration process may modify the first audio signal and the second audio signal for playback using level and frequency dependent audio filters corresponding to preset hearing loss profiles. For example, audio filters corresponding to the most common hearing loss profiles in the population may be used. The audio filter may alternatively correspond to a hearing loss profile from a population that is closely related to the user's audiogram. For example, the media system may receive a user's personal audiogram, and may determine, based on the personal audiogram, a number of preset hearing loss profiles that encompass the user's hearing loss profile represented by the audiogram. The media system may then determine level and frequency dependent audio filters corresponding to the determined hearing loss profile, and may use those audio filters during presentation of audio in the first or second stage of the registration process.

The media system can select individual level and frequency dependent audio filters directly based on the user's audiogram without utilizing a registration process. For example, the media system may receive the user's personal audiogram, and based on the personal audiogram, may select a preset personal hearing loss profile that most closely matches the user's hearing loss profile represented by the audiogram. For example, a personal audiogram may indicate that the user has an average level of hearing loss and a loss profile, and the media system may select a preset hearing loss profile that fits the audiogram. The media system may then determine a level and frequency dependent audio filter corresponding to the individual's hearing loss profile. For example, the media system may determine an audio filter having an average gain level corresponding to an average hearing loss level of an audiogram and/or a level and frequency dependent audio filter having a gain profile corresponding to a loss profile. The media system may use the audio filter as a personal level and frequency dependent audio filter to enhance the audio input signal and compensate for the user's hearing loss when playing back the audio content.

The above summary does not include an exhaustive list of all aspects of the invention. It is contemplated that the present invention includes all systems and methods that may be practiced in all suitable combinations of the various aspects outlined above as well as those disclosed in the Detailed Description below and particularly pointed out in the claims filed with this patent application. Such combinations have certain advantages not specifically recited in the summary above.

Description of drawings

1 is an illustration of a media system according to an aspect.

2 is a graph of a loudness curve for an individual with sensorineural hearing loss, according to one aspect.

3 is a graph of amplification required to normalize the perceived loudness of individuals with different hearing loss profiles, according to one aspect.

4 is an illustration of an individual level and frequency dependent audio filter applied to an audio input signal to accommodate a user's hearing loss, according to one aspect.

5 is an illustration of an audiogram of a user according to an aspect.

6-8 are diagrams of hearing loss curves according to an aspect.

9 is a diagram of a multi-band compression gain table representing a level and frequency dependent audio filter corresponding to a hearing loss curve, according to an aspect.

10 is a flowchart of a method of enhancing an audio input signal to accommodate hearing loss, according to an aspect.

11 is an illustration of a user interface for controlling output of a first audio signal, according to an aspect.

12 is an illustration of selection of level and frequency dependent audio filter banks for exploration in a second stage of a registration procedure, according to an aspect.

13 is an illustration of a user interface for controlling output of a second audio signal, according to an aspect.

14A-14B are diagrams of selection of level and frequency dependent audio filters with different gain profiles, according to an aspect.

15 is a flowchart of a method of selecting a personal level and frequency dependent audio filter having a personal average gain level and a personal gain profile, according to an aspect.

16 is an illustration of a user interface for controlling output of a first audio signal, according to an aspect.

17A-17B are diagrams of selection of level and frequency dependent audio filters with different average gain levels, according to an aspect.

18 is an illustration of a user interface for controlling output of a second audio signal, according to an aspect.

19A-19B are diagrams of selection of level and frequency dependent audio filters with different gain profiles, according to one aspect.

20 is a flowchart of a method of selecting a personal level and frequency dependent audio filter having a personal average gain level and a personal gain profile, according to an aspect.

21A-21B are flowcharts and diagrams, respectively, of a method of determining a number of hearing loss curves based on a personal audiogram, according to an aspect.

22A-22B are a flowchart and diagram, respectively, of a method of determining an individual's hearing loss profile based on an individual's audiogram, according to an aspect.

23 is a block diagram of a media system according to an aspect.

Detailed ways

This application claims the benefit of priority from US Provisional Patent Application No. 62/855,951, filed June 1, 2019, and this application incorporates this provisional patent application herein by reference.

Aspects describe a media system and a method of using the media system to accommodate a user's hearing loss. The media system may include a mobile device (such as a smartphone) and an audio output device (such as a handset). However, the mobile device may be another device used to present audio to the user, such as a desktop computer, laptop computer, tablet computer, smart watch, etc., and the audio output device may include other types of devices such as headphones, headsets, etc. Headphones, computer speakers, etc., to name a few possible applications.

In various aspects, the description is made with reference to the accompanying drawings. However, certain aspects may be practiced without one or more of these specific details or in combination with other known methods and configurations. In the following description, numerous specific details are set forth such as specific configurations, dimensions, and processes in order to provide a thorough understanding of the aspects. In other instances, well-known processes and fabrication techniques have not been described in particular detail so as not to unnecessarily obscure the description. Reference throughout this specification to "an aspect," "aspect," etc. means that a particular feature, structure, configuration or characteristic described is included in at least one aspect. Thus, appearances of the phrases "an aspect," "aspect," etc. in various places throughout this specification are not necessarily referring to the same aspect. Also, the particular features, structures, configurations or characteristics may be combined in any suitable manner in one or more aspects.

The use of relative terms throughout the description may refer to relative positions or orientations. For example, "in front of" may indicate a first direction away from the reference point. Similarly, "behind" may indicate a position in a second direction away from the reference point and opposite the first direction. However, such terms are provided to establish a relative frame of reference and are not intended to limit the use or orientation of the media system to the specific configurations described in the various aspects below.

In one aspect, a media system is used to accommodate a user's hearing loss. The media system may compensate for the user's mild or moderate hearing loss profile. Furthermore, the compensation may be individualized, meaning that it adjusts the audio input signal in a level-dependent and frequency-dependent manner based on the individual's unique hearing preferences, rather than just the balance or overall level of the audio input signal. The media system can personalize audio tuning based on selections made during a short and straightforward registration process. During the registration process, the user may experience sounds from several audio signals filtered in different ways, and the user may make a binary selection to select a personal audio setting based on a subjective assessment or comparison of the experience. Personal audio settings include the average gain level and gain profile of the preferred audio filter. When the user has selected a personal audio setting, the media system may generate an audio output signal by applying a personal level and frequency dependent audio filter with the personal audio setting to amplify the audio input signal based on the input level and input frequency of the audio input signal . Playback of the audio output signal may deliver speech or music to the user that is clear to the user despite the user's hearing loss profile.

Referring to FIG. 1, a diagram of a media system is shown according to one aspect. The media system 100 may be used to deliver audio to a user. The media system 100 may include an audio signal device 102 that outputs and/or transmits an audio output signal and an audio output device 104 that converts the audio output signal (or a signal derived from the audio output signal) to sound. In one aspect, the audio signaling device 102 is a smartphone. However, the audio signaling device 102 may include other types of audio-enabled devices, such as laptops, tablets, smart watches, televisions, and the like. In one aspect, the audio output device 104 is a handset (wired or wireless). However, the audio output device 104 may include other types of devices, including audio speakers such as headphones. The audio output device 104 may also be an internal or external speaker of the audio signal device 102, such as a speaker of a smartphone, laptop, tablet, smart watch, television, or the like. In any event, the media system 100 may include hardware, such as one or more processors, memory, etc., that enable the media system 100 to perform a method of enhancing an audio input signal to accommodate a user's hearing loss. More specifically, the media system 100 may provide personalized media enhancements by applying the user's personalized audio filters to the audio input signal to enable playback of audio content adapted to the user's hearing preferences and/or hearing abilities.

Referring to FIG. 2, a graph of a loudness curve for an individual with sensorineural hearing loss is shown, according to one aspect. Sensorineural hearing loss is the main type of hearing loss, however, other types of hearing loss, such as conductive hearing loss, also exist. Individuals with sensorineural hearing loss have higher thresholds of audibility than normal listeners, but also experience uncomfortable loudness levels. Individuals with conductive hearing loss will have different loudness curves. More specifically, individuals with conductive hearing loss have higher audibility thresholds and uncomfortable loudness levels than their normal hearing counterparts. The loudness level curve 200 is used by way of example.

A user's hearing preference and/or hearing ability is frequency-dependent and level-dependent. Individuals with hearing impairment require higher sound pressure levels in the ears to achieve the same perceived loudness as individuals with less hearing loss. The graph shows a loudness level curve 200 describing perceived loudness (PHON) as a function of sound pressure level (SPL) for several individuals at a particular frequency (eg, 1 kHz). Curve 202 has a 1:1 slope and zero origin because a loudness unit (eg, 50PHON) is defined as the loudness of a 1 kHz tone corresponding to an SPL (eg, 50dB SPL) as perceived by a normal hearing listener. In contrast, individuals with impaired hearing 204 do not perceive loudness until the sound pressure level reaches a threshold level. For example, when an individual has 60dB hearing loss, the individual will not perceive loudness until the sound pressure level reaches 60dB.

Referring to FIG. 3, a graph of amplification required to normalize the perceived loudness of individuals with different hearing loss profiles is shown, according to one aspect. To compensate for an individual's hearing loss, a gain may be applied to the input signal to raise the sound pressure level in the ear of an individual with hearing loss. The graph shows a gain curve 302 that describes the gain required to match normal hearing loudness as a function of the sound pressure level of an individual having the loudness level curve of FIG. 2 . Clearly, at certain frequencies, an individual 202 with normal hearing does not need amplification, since apparently the individual already has normal hearing loudness at all sound pressure levels. In contrast, an individual with impaired hearing 204 requires substantial amplification at low sound pressure levels in order to perceive sound applied below the threshold level of FIG. 2 (eg, below 60 dB).

The amount of amplification required to compensate for an individual's hearing loss decreases as the sound pressure level increases. More specifically, the amount of amplification required to compensate for hearing loss depends on both frequency and input signal level. That is, when the input signal level of the audio input signal produces a higher sound pressure level for a given frequency, less amplification is required to compensate for hearing loss at that frequency. Similarly, an individual's hearing loss is frequency dependent, so the loudness level curve and gain curve may be different at another frequency (eg, 2 kHz). By way of example, if the gain curve of an individual with impaired hearing is shifted upwards (more hearing loss at 2 kHz than at 1 kHz), greater amplification is required to properly perceive sound at that frequency. Therefore, when the input signal level of the audio input signal has a component at a certain frequency (2 kHz), greater amplification is required to compensate for the hearing loss at that frequency. The method of adjusting the audio input signal to amplify the audio input signal based on the input level and the input frequency of the audio input signal may be referred to herein as multi-band up-compression.

Multiband up-compression can achieve the desired enhancement of audio content by bringing sounds that are not perceived or perceived as too quiet into the audible range without adjusting sounds that have been perceived as sufficiently or generally loud. In other words, multi-band up-compression can enhance the audio input signal in a level-dependent and frequency-dependent manner to allow hearing-impaired individuals to perceive sound normally. Normalization of loudness level curves for hearing-impaired individuals avoids over- or under-amplification at certain levels or frequencies, which is associated with simply turning up the volume and amplifying the audio input signal across the entire audible frequency range connection problem.

Referring to FIG. 4, a diagram of an individual level and frequency dependent audio filter applied to an audio input signal to accommodate a user's hearing loss is shown, according to an aspect. In view of the above discussion, it should be appreciated that the media system 100 may accommodate an individual's hearing loss by applying an individual level and frequency dependent audio filter 402 to the audio input signal 404 . An individual level and frequency dependent audio filter 402 may convert the audio input signal 404 into an audio output signal 406 that would normally be perceived by the individual. By way of example, audio input signal 404 may represent speech in a phone call, music in an audio track, speech from a virtual assistant, or other audio content. As indicated by the dashed and dotted lines, when reproduced without multiband upward compression, certain frequencies of sound can be perceived normally (indicated by solid lines), while other frequencies of sound can be perceived quietly (voiced or muted) or not perceived at all (indicated by dashed and dashed lines of varying density). In contrast, after applying the personal level and frequency dependent audio filter 402 to the audio input signal 404, the resulting audio output signal 406 may contain normally perceived sound of a particular frequency (indicated by solid lines). Thus, the personal level and frequency dependent audio filter 402 can restore details of speech, music and other audio content to enhance the sound played back by the audio output device 104 to the user.

Referring to FIG. 5, a diagram of an audiogram of a user is shown according to one aspect. In order to understand how individual level and frequency dependent audio filters 402 can be selected or determined for use in enhancing the audio input signal 404, it is possible to understand how a user's hearing loss profile can be identified and mapped to a user-specific multiband compression filter that may is helpful. In one aspect, the user's personal audiogram 500 may include one or more audiogram curves representing audible thresholds as a function of frequency. For example, the first audiogram curve 502a may represent the audible threshold of the user's right ear, and the second audiogram curve 502b may represent the audible threshold of the user's left ear. Personal audiogram 500 can be determined using known techniques. In one aspect, the average hearing loss 504 can be determined from one or both of the audiogram curves 502a, 502B. For example, in the illustrated example, the average hearing loss 504 for the two curves may be 30 dB. Thus, the personal audiogram 500 indicates both the average hearing loss and the frequency-dependent hearing loss of the user across a person's primary audible range (eg, between 500 Hz and 8000 kHz). It should be noted that the primary audible range referred to herein may be less than the human audible range (known as 20 Hz to 20 kHz).

6-8 include graphs of hearing loss curves for a population. As described below, each hearing loss curve can have a combination of level parameters and profile parameters. The level parameter of the hearing loss curve may indicate the average hearing loss as determined by pure tone audiometry. Profile parameters may indicate changes in hearing loss over an audible frequency range, eg, whether hearing loss is more pronounced at certain frequencies. The hearing loss curves shown in Figures 6-8 may be grouped according to level parameters and profile parameters. In one aspect, the hearing loss curve is the most common curve of hearing loss that exists in the population based on analysis of real audiograms. More specifically, each hearing loss curve may represent a common audiogram in the three-dimensional space of the audiogram with unique level and profile parameters.

FIG. 6 shows a first set 602 of hearing loss curves. The hearing loss curves in the first set 602 may have level parameters corresponding to listeners with mild hearing loss. For example, the average hearing loss 604 of the first set of 602 curves may be 20 dB. More specifically, each of the hearing loss curves included in the first set 602 may have the same average hearing loss 604 . However, the hearing loss curves can vary in shape.

In one aspect, the first set 602 may include hearing loss curves with different profile parameters. Profile parameters may include flat loss profile 606 , notch loss profile 608 , and sloped loss profile 610 . Different shapes can have significant hearing loss at corresponding frequencies. For example, flat loss profile 606 may have more hearing loss at low-band frequencies (eg, at 500 Hz) than notch loss profile 608 or sloping loss profile 610 . In contrast, the notched loss profile 608 may have more hearing loss at mid-band frequencies (eg, at 4 kHz) than the flat loss profile 606 or the sloping loss profile 610 . Sloped loss profile 610 may have more hearing loss at high band frequencies (eg, at 8 kHz) than flat loss profile 606 or notch loss profile 608 .

Hearing loss curve shapes may have other general differences. For example, flat loss profile 606 may have minimal hearing loss variation compared to notch loss profile 608 and sloped loss profile 610 . That is, the flat loss profile 606 exhibits more consistent hearing loss at each frequency. Additionally, for the same curve, the notch loss profile 608 may have more hearing loss at mid-band frequencies than at other frequencies.

FIG. 7 shows a diagram of a second set 702 of hearing loss curves. The average hearing loss for each of the sets of hearing loss curves may be sequentially increased from FIGS. 6-8 . More specifically, the hearing loss curves in the second set 702 may have level parameters corresponding to listeners with mild to moderate hearing loss. For example, the average hearing loss 704 for the second group 702 may be 35 dB. However, the hearing loss curves of the second set 702 may have different profile parameters, eg, a flat loss profile 706 , a notch loss profile 708 , and a sloped loss profile 710 . Due to the regularity of hearing loss across populations, the shape of each horizontal group can be correlated by shape. More specifically, the shapes of the loss contours 706-710 may share the general differences described above with respect to the loss contours 606-610, although the shapes may not be equally scaled. For example, the notch loss profile 708 may have the highest loss at mid-band frequencies compared to the other loss profiles of FIG. 7 , but the maximum loss of the notch loss profile 708 may be at high-band frequencies (compared to the mid-band frequencies in FIG. 6 ). compared to). Thus, the hearing loss curve of Figure 7 may represent the most common hearing loss curve for persons with mild to moderate hearing loss in the population.

FIG. 8 shows a diagram of a third set 802 of hearing loss curves. The average hearing loss 804 of the third group 802 may be higher than the average hearing loss 704 of the second group 702 . The average hearing loss of the third group 802 may represent a person with moderate hearing loss. For example, the average hearing loss 804 may be 50 dB. As with the other groups, the hearing loss curves of the third group 802 may differ in shape and may include a flat loss profile 806 , a notched loss profile 808 , and a sloped loss profile 810 . The shapes of loss profiles 806-810 may share the general differences described above with respect to loss profiles 606-610 or 706-710. Thus, the hearing loss curve of FIG. 8 may represent the most common hearing loss curve for persons with moderate hearing loss in the population.

The hearing loss curves shown in FIGS. 6-8 represent nine presets for hearing loss curves stored by the media system 100 . More specifically, the media system 100 may store any number of hearing loss curve presets obtained from the 3D space of the audiogram described above. Each preset may have a combination of level and profile parameters that can be compared to the personal audiogram 500 . One of the nine presets of groups 602 , 702 and 802 may be similar to personal audiogram 500 . For example, by visual inspection, it is apparent that the personal audiogram 500 of FIG. 5 has an average hearing loss level (30 dB, compared to 35 dB) that is closest to the hearing loss curve of the second group 702 and appears to correlate closely with the flat loss profile 706 shape. Thus, flat loss profile 706 may be identified as the personal hearing loss profile for the user with personal audiogram 500 .

The comparison between the audiogram and the hearing loss curve as described above is introduced by way of example and will be referenced again below with respect to FIGS. 21 to 22 . At this level, the example illustrates the concept that each individual may have an actual hearing loss (as represented by an audiogram) that closely matches a common hearing loss profile (as determined from a population and stored as a preset within the media system 100). To compensate for actual hearing loss, media system 100 may apply individual-level and frequency-dependent audio filters 402 that correspond to and compensate for closely matched hearing loss curves.

Referring to FIG. 9, a diagram of a multi-band compression gain table representing a level and frequency dependent audio filter corresponding to a hearing loss curve is shown, according to an aspect. Each hearing loss curve can be mapped to a corresponding level and frequency dependent audio filter. For example, whichever of the hearing loss curves of the group 602-802 that most closely matches the individual's audiogram 500 may be mapped to the level and frequency-dependent audio filter as the individual's level and frequency-dependent audio filter 402. Thus, the media system 100 may store several preset hearing loss curves and several level and frequency dependent audio filters corresponding to the hearing loss curves, eg, in memory.

In one aspect, the personal level and frequency dependent audio filter 402 may be a multi-band compression gain table. The multi-band compression gain table may be a user-specific prescription to compensate for an individual's hearing loss, thereby providing personalized media enhancement. In one aspect, the audio input signal 404 is amplified based on the input level 902 and the input frequency 904 using a personal level and frequency dependent audio filter 402 . The input level 902 of the audio input signal 404 may be determined in a range spanning from a low sound pressure level to a high sound pressure level. By way of example, the audio input signal 404 may have a sound pressure level shown to the left of the gain table, which may be, for example, 20 dB. The input frequency 904 of the audio input signal 404 may be determined within the audible frequency range. By way of example, the audio input signal 404 may have a frequency at the top of the gain table, which may be, for example, 8 kHz. Based on the input level 902 and the input frequency 904 of the audio input signal 404 , the media system 100 may determine that a particular gain level (eg, 30 dB) is to be applied to the audio input signal 404 to generate the audio output signal 406 . It should be understood that this example is consistent with the hearing loss and gain curves of FIGS. 2-3 .

The gain table of FIG. 9 illustrates that, for each hearing loss profile of the user, a corresponding level and frequency dependent audio filter may be determined or selected to compensate for the user's hearing loss. Level and frequency dependent audio filters define a gain level at each input frequency that corresponds inversely to an individual's hearing loss at those frequencies. By way of example, a user with a personal audiogram 500 that matches the flat loss profile 706 within the second set 702 may have a personal level and frequency dependent audio filter 402 that amplifies at 8 kHz than at 500 Hz. Audio input signal 404 is more. The gain applied by the gain table across audible frequencies may invalidate the hearing loss represented by the loss profile.

Referring to FIG. 10, a flow diagram of a method of enhancing an audio input signal to accommodate hearing loss is shown according to an aspect. The media system 100 may perform the method to provide personalized enhancement of audio content. At operation 1002, the one or more processors of the media system 100 may select an individual level and frequency dependent audio filter 402 from a number of level and frequency dependent audio filters corresponding to a corresponding hearing loss curve. This selection process can be performed in various ways. For example, as mentioned above and discussed further below with respect to FIG. 22, the selection may include matching the user's personal audiogram to a preset hearing loss curve. However, it is contemplated that some users of the media system 100 may not have existing audiograms available for matching. Furthermore, even when such audiograms are available, there may be suprathreshold differences in loudness perception by different users. For example, two users with similar audiograms may still subjectively experience sound pressure levels in different ways at a given frequency, eg a first user may be comfortable with sound pressure levels while a second user may feel sound pressure levels The level is uncomfortable. Therefore, it may be beneficial to personalize the audio filter selection to the user rather than relying solely on audiogram data. More specifically, the user may have preferences that are not fully captured by the audiogram data, and therefore, it may be beneficial to allow the user to select from different level and frequency dependent audio filters that do not necessarily exactly match the individual audiogram.

In one aspect, a convenient and noise-robust registration procedure may be used to drive the selection of individual level and frequency dependent audio filters adapted to the user's hearing preferences. The registration procedure may play back one or more audio signals modified by one or more predetermined gain levels and/or one or more level and frequency dependent audio filters, the one or more level and frequency dependent audio filters The device corresponds to the most common hearing loss profiles of pre-determined demographics. The user may make selections during the registration procedure, eg, select one or more of the level and frequency dependent audio filters, and through the user selection, the media system 100 may determine and/or select the appropriate personal level and frequency dependent audio filter to apply to the user's audio input signal. Several implementations of the registration procedure are described below. The registration procedure may combine several stages, and one or more stages of the implementation may differ. For example, Figures 11-15 describe a registration procedure including a first level in which a user's selection indicates whether the played back audio signal is audible, and Figures 16-20 describe a registration procedure including a user's selection indicating whether the audio signal is audible from having different average gains A level set of audio filters for the preferred audio filter registration procedure for the first level.

Referring to FIG. 11, a diagram of a user interface for controlling output of a first audio signal is shown according to an aspect. During the registration process, the media system 100 may output the first audio signal using one or more predetermined gain levels. The predetermined gain level may be a scalar gain level (wideband or frequency independent gain) that is applied to allow the audio signal to be played back at different loudness for listening by the user. For example, the media system may generate the first audio signal for playback on the speaker to the user. The first audio signal may represent speech (eg, a speech file) containing recorded greetings spoken in languages from around the world. Speech has good contrast between gain levels (compared to music) and thus may facilitate selection of an appropriate average gain level during the first stage of the registration process.

During the first stage, the audio input signal 404 may be reproduced for the user at a first predetermined gain level. For example, the speech signal may be output at a low level (eg, 40 dB or less). The first predetermined gain level may correspond to one of the different average hearing loss levels (eg, levels 604, 704, or 804). For example, a demographer who has an average hearing loss level 604 and may not have hearing loss levels 704 and 804 would expect to hear levels of 40 dB or less.

During playback of the first audio signal at the first amplification level, the user may select the audibility selection element 1102 or the inaudibility selection element 1104 of the graphical user interface displayed on the audio signal device 102 of the media system 100 . More specifically, after listening to the first setting, the user may make a selection indicating whether the output audio signal has a loudness audible to the user. The user may select the audibility selection element 1102 to indicate that the output level is audible. In contrast, the user may select the inaudibility selection element 1104 to indicate that the output level is inaudible.

After selection of audibility selection element 1102 or inaudibility selection element 1104, the user may select selection element 1106 to provide a selection to the system. When the system receives a selection of the audibility selection element 1102, the system may determine the user's personal average gain level based on the selection indicating whether the output audio signal is audible to the user. For example, when the system receives a selection of the audibility selection element 1102 during the first stage of the first level, the system may determine that the user's personal average gain level corresponds to the average hearing loss level 604 of the mild hearing loss curve set. This set of hearing loss curves can be used as a basis for further exploration of level and frequency dependent audio filters in the second stage of the registration procedure. In contrast, selection of the inaudibility selection element 1104 during the first stage may cause the registration process to proceed to the second stage of the first level of the registration process.

In the second stage of the first stage, the first audio signal may be played at a second amplification level. For example, the speech signal may output a higher level (eg, 55dB). After listening to the second setting, the user may select the audibility selection element 1102 or the inaudibility selection element 1104 to indicate whether the speech signal is audible.

After selection of audibility selection element 1102 or inaudibility selection element 1104, the user may select selection element 1106 to provide a selection to the system. The system may determine the personal average gain level based on a selection indicating whether the output audio signal is audible to the user. For example, when the system receives a selection of the audibility selection element 1102 during the second stage of the first stage, the system may determine that the user's personal average gain level corresponds to the average hearing loss of the mild to moderate hearing loss curve set Level 704. This set of hearing loss curves can be used as a basis for further exploration of level and frequency dependent audio filters in the second stage of the registration procedure. In contrast, when the system receives a selection of the inaudibility selection element 1104 during the second stage, the system may determine that the user's personal average gain level corresponds to the average hearing loss level 804 of the moderate hearing loss curve set. This set of hearing loss curves can be used as a basis for further exploration of level and frequency dependent audio filters in the second stage of the registration procedure.

The first audio signal may be generated and/or output in order of increasing gain during the first stage using one or more predetermined gain levels. For example, as described above, as the user progresses through the first stage of the registration procedure, the first audio signal may be output at 40 dB during the first stage and then at 55 dB during the second stage. The speech signal may continue to be played back with increasing predetermined gain levels until an individual average gain level is determined. The individual average gain level may be determined by selecting the audibility selection element 1102 or by selecting the inaudibility selection element 1104 . For example, if the user selects the audibility selection element 1102 when the speech signal is output at 55 dB, then the individual average gain level corresponding to the mild to moderate hearing loss profile is determined. In contrast, if the user selects the inaudibility selection element 1104 after outputting the speech signal at 55 dB, then the individual average gain level corresponding to the moderate hearing loss profile is determined.

The first audio signal may be set at a calibration level, and therefore volume adjustment during the first stage of the registration process may not be allowed. More specifically, one or more processors of the media system 100 may disable volume adjustment of the media system 100 during output of the first audio signal. By locking the volume control of the media system 100 during the first stage of the registration process, the gain level to compensate for hearing loss can be set to a predetermined gain level corresponding to the common hearing loss profile being tested. Thus, these levels can be explored using predetermined levels of speech stimuli that are fixed during the assessment.

Referring to FIG. 12, an illustration of the selection of a level and frequency dependent audio filter bank for exploration in the second stage of the registration procedure is shown in accordance with an aspect. Selection during the first stage of the registration procedure drives the level and frequency dependent audio filter banks that can be used for exploration during the second stage of the registration procedure.

When the speech signal is presented at a first level (eg, 40 dB) during the first stage of the first stage of the registration procedure, the user makes a selection to indicate whether the output audio signal is audible. Selection of audibility selection element 1102 indicates that the first level is audible, and may be referred to as first stage audibility selection 1200 . The system may determine, based on the first stage audibility selection 1200, that the zero gain audio filter and/or the first set of level and frequency dependent audio filters (1F, 1N and 1S) have corresponding levels equal to the user's personal average gain level Average gain level. More specifically, the system may determine, in response to the first stage audibility selection 1200, that the user's personal average gain level is a zero gain audio filter or an average of a first set of level and frequency dependent audio filters (1F, 1N, and 1S). one of the gain levels. For example, a zero gain audio filter may have an average gain level of zero, and the first set of filters may have an average gain level corresponding to the first set 602 of the hearing loss curves. One or more of the audio filters may be explored during the second stage of the registration procedure to further narrow the determination, as described below.

When the speech signal is presented at a second level (eg, 55dB) during the second stage of the first stage of the registration procedure, the user makes a selection to indicate whether the output audio signal is audible. Selection of audibility selection element 1102 indicates that the second level is audible, and may be referred to as second stage audibility selection 1204 . The system may determine, based on the second stage audibility selection 1204, that the second set of level and frequency dependent audio filters (2F, 2N and 2S) have an average gain level equal to the user's personal average gain level. More specifically, the user's individual average gain level may be determined as the average gain level of the second group. For example, the second set of filters may have an average gain level corresponding to the second set 702 of the hearing loss curves. One or more of the second set of audio filters may be explored during the second stage of the registration procedure, as described below.

Selection of inaudibility selection 1104 during presentation of the speech signal at the second level indicates that the second level is inaudible and may be referred to as second stage inaudibility selection 1206 . The system may determine, based on the second stage inaudibility selection 1206, that the third set of level and frequency dependent audio filters (3F, 3N and 3S) have an average gain level equal to the user's personal average gain level. More specifically, the user's individual average gain level may be determined as the average gain level of the third group. For example, the third set of filters may have an average gain level corresponding to the third set 802 of the hearing loss curves. One or more of the third set of audio filters may be explored during the second stage of the registration process, as described below.

In the second stage of the registration process, the user may explore the determined set of level and frequency dependent audio filters to select an individual gain profile. The personal gain profile may correspond to a user-preferred gain profile (flat profile, notched profile, or sloping profile) that adjusts the tonal characteristics of the audio input signal according to the user's preference.

Referring to FIG. 13, a diagram of a user interface for controlling output of a second audio signal is shown according to an aspect. During the registration process, the media system 100 may output the second audio signal using a set of level and frequency dependent audio filters. The second audio signal may represent music, such as a music file containing recorded music. Music provides good contrast between timbres (compared to speech) and thus may facilitate selection of an appropriate gain profile during the second stage of the registration process. More specifically, playing music instead of speech during the second level allows the user's timbre or tone preference to be accurately determined.

During the second stage, the audio input signal 404 may be reproduced sequentially with different pitch enhancement settings for the user. More specifically, the second audio is output using a level and frequency dependent audio filter bank determined in response to the first stage audibility selection 1200, the second stage audibility selection 1204, or the second stage inaudibility selection 1206. Signal. Each member of the group can have a different gain profile. For example, each group (other than the zero gain audio filter) may include a flat audio filter corresponding to the flat loss profile of the common hearing loss curve, a notch audio filter corresponding to the notch loss profile of the common hearing loss curve and a sloped audio filter corresponding to the sloped loss profile of common hearing loss curves. It should be understood that with reference to the loss profiles above and the inverse relationship between the loss profiles and the corresponding gain profiles, the gain profile of a flat audio filter has the highest gain in the low frequency band and the gain profile of a notch audio filter has the highest gain in the mid frequency band. gain, and the gain profile of the oblique audio filter has the highest gain in the high frequency band. An audio filter is applied to the second audio signal to play back the audio signal so that different frequencies corresponding to different hearing loss profiles are apparent.

The user may select the current tuning element 1304 to play the second audio signal with the first playback setting. For example, when the first stage audibility selection 1200 is performed in FIG. 12, the second audio signal may be played back without audio filtering (zero gain filter) as the current tuning. The user may select the modified tuning element 1306 to play the second audio signal with a second audio filter having a corresponding gain profile that differs from that of the first setting. For example, the altered tuning can play the second audio signal with the (1F) audio filter. When the user has identified a preferred setting (eg, a tuning that allows the user to better listen to the music of the second audio signal), the user may select the selection element 1106 . Alternatively, the user may select through a physical switch, such as by tapping a button on the audio signal device 102 or the audio output device 104 .

Referring to FIG. 14A, a diagram is shown of a selection of level and frequency dependent audio filters with different gain profiles, according to an aspect. During the second stage of the registration process, the user is presented with different enhanced settings and asked to select a preferred setting. The enhancement settings include a level and frequency dependent audio filter bank applied to the second audio signal based on selections made during the first stage of the registration process. The audio filters in this set may correspond to hearing loss curves with different loss profiles.

In the illustrated example, a second stage audibility selection 1204 is made in FIG. 12 . Therefore, the system may select a second set of level and frequency dependent audio filters to explore. Selection of the current tuning element 1304 uses a flat gain profile (2F) audio filter corresponding to the flat loss profile 706 of FIG. 7 to playback the second audio signal. In contrast, selection of the modified tuning element 1306 uses a notch gain profile (2N) audio filter corresponding to the notch loss profile 708 of FIG. 7 to play back the second audio signal. The user may select a preference and then select select element 1106 to advance to the next action in the second level. For example, the user may (as shown) select the current tuning element 1304 to select the filter corresponding to the flat loss profile and proceed to the next operation.

The second stage of the registration process may require presenting all gain profile settings in the vertical direction across the grid of Figure 14A. More specifically, even when the user selects the current tuning (eg, (2F) audio filter) during the second stage, the registration process may provide additional comparisons between the current tuning and subsequent tunings. Subsequent tunings applicable to the second audio signal are shown in the columns of the grid of Figure 14A. More specifically, the additional modified tuning may correspond to the tilt loss profile for each of the possible average gain level settings.

Referring to FIG. 14B, a diagram is shown of a selection of level and frequency dependent audio filters with different gain profiles, according to an aspect. At the next operation in the second stage of registration, the second audio signal may be modified by a (2F) level and frequency dependent audio filter corresponding to the previously selected gain profile setting and the next gain profile setting (2S) . In one aspect, all tunings applied to the second audio signal during the second stage of registration have the same average gain level. More specifically, the flat gain profile (2F), notch gain profile (2N), and sloping gain profile (2S) applied to the second audio signal for comparison pitch adjustment may all have the values determined during the first stage of registration. the average individual gain level. The individual average gain level may correspond to, for example, the average gain loss 704 of the mild to moderate hearing loss group curve. When the user has heard the second audio signal modified by all filters, the user may select a preferred tuning (eg, modified tuning 1306). The media system 100 may receive the user selection as a selection of the personal gain profile 1402 . For example, the personal gain profile 1402 may be a sloping gain profile (2S).

Compared to the first stage of the registration process, volume adjustment of the media system 100 may be enabled during output of the second audio signal. Allowing volume adjustment can help distinguish the tonal characteristics of different audio signal adjustments. More specifically, allowing the user to adjust the volume of the media system 100 using the volume control 1302 (FIG. 13) may allow the user to hear the difference between each tone setting. Thus, the second stage of the registration process allows the user to explore gain profiles using musical stimuli that excite all frequencies in the audible frequency range, and encourages volume changes to allow the user to distinguish the tonal characteristics of the altered musical stimuli.

The presentation sequence of the filtered audio signal allows the user to step through the registration process to first determine the personal average gain level and then the personal gain profile. More specifically, the user may first select the personal average gain level by selecting a setting where the first audio signal is audible, and then select the personal gain profile 1402 by stepping through the grid in the vertical direction along the shape axis. Each square of the grid represents a level- and frequency-dependent audio filter with a corresponding average gain level and gain profile, and thus, the illustrated example (3x3 grid) assumes that the individual level and frequency-dependent results produced by the registration process The audio filter 402 will be one of 9 level and frequency dependent audio filters corresponding to 9 common hearing loss curves. This level of granularity (eg, three level sets and three contour sets) has been shown to consistently guide the user to select a preset that is consistently preferred by the user, regardless of whether the selected preset exactly matches its hearing loss curve. However, it should be understood that the preset number used in the registration process may vary. For example, the first stage of the registration process may allow the user to step through four or more predetermined gain levels to drive selection of an audio filter bank with an individual average gain level. Similarly, more or fewer gain profiles can be represented across the shape axis of the grid to allow the user to evaluate different pitch enhancements.

15, a flowchart of a method of selecting a personal level and frequency dependent audio filter having a personal average gain level and a personal gain profile is shown, according to an aspect. The flowchart shows the registration process stages for selecting level and frequency dependent audio filters from an audio filter grid with columns and rows.

As mentioned above, the registration process allows the user to first explore the levels to determine the correct column within the audio filter grid to further explore the contours. At operation 1502, in a first stage of the registration process, the user listens to an audio signal at a predetermined level (eg, a 40 dB level). The predetermined level is a presentation level resulting from a predetermined gain level applied to the speech audio signal. At operation 1504, the media system 100 determines whether the current presentation level is audible to the user. For example, if the user can hear the 40 dB level produced by the predetermined gain level audio filter, the user selects the audibility selection element 1102 to identify the current level as corresponding to the personal average gain level. In this case, the system determines the individual average gain level of the zero gain filter or the average gain level of the (IF, 1N, 1S) audio filter bank. However, if the user selects the inaudibility selection element 1104, then at operation 1506, the first decision sequence iterates to the next predetermined level (eg, the 55dB level). The next predetermined level is the presentation level resulting from the next predetermined gain level applied to the speech audio signal. The audio signal may be rendered at a predetermined level at operation 1502 . At operation 1504, the media system 100 determines whether the user can hear the current level. If the user can hear the current level, the user selects the audibility selection element 1102 to identify the current level as corresponding to the personal average gain level. In this case, the system determines that the individual average gain level is the average gain level of the (2F, 2N, 2S) audio filter bank. However, if the user selects the inaudibility selection element 1104, the system determines that the individual average gain level is the average gain level of the (3F, 3N, 3S) audio filter bank. Which level the user selects to be audible during the iteration can be used to drive the determination of the individual average gain level. When the user selects an audible level, the system may determine an audio filter bank for further exploration with an average gain level corresponding to the selected predetermined gain level. More specifically, the individual average gain level may be determined based on the audibility selection, and the registration process may continue to the second level.

As described above, the registration process allows the user to explore the gain profile within the selected audio filter bank to determine the correct row within the audio filter grid, and thus to reach the position within the grid representing the individual level and frequency dependent audio filters 402 square. At operation 1508, in the second stage of the registration process, the user compares several shape audio signals.

In a special case, the user makes a first stage audibility selection 1200, and the system determines that a zero gain audio filter or (1F, 1N, 1S) audio filter bank corresponds to the user's personal average gain level. In this case, at decision sequence 1508 the music file is played. At decision sequence 1508, a comparison may be made between a zero gain audio filter (or no filter) applied to the music audio signal and a low gain flat audio filter (IF) applied to the music audio signal. If the zero-gain audio filter is selected again, eg, via the current tuning element 1304, the process may iterate to compare the zero-gain audio filter to the low-gain notch audio filter (IN). If the zero-gain audio filter is selected again, eg, via the current tuning element 1304 , the registration process may end and no audio filter is applied to the audio input signal 404 . More specifically, as the flow diagram proceeds through a sequence in which the user selects a number of levels corresponding to the hearing loss curve and a zero gain audio filter on the associated audio filter, the media system 100 determines that the user has normal hearing and does not agree with the default of the system. Adjust the audio settings. It can also be constructed as a personal level and frequency dependent audio filter where the personal average gain level is zero and the personal gain profile is non-adjusted.

However, where the user selects a non-zero personal average gain level, for example, during the first stage, the second stage audibility selection 1204 or the second stage inaudibility selection 1206 is selected, or at the initial operation 1508 of the second stage The audio filter is selected at (1F) or (1N), the shape audio signal comparison at operation 1508 is performed between the non-zero gain audio filters applied to the music audio signal. For example, if the second stage audibility selection 1204 drives the selection of the (2F, 2N, 2S) audio filter bank for further exploration, then at operation 1508 the (2F) audio filter may be applied to the music audio signal as the current tuning and a low level notch audio filter (2N) can be applied to the music audio signal as the changed tuning. The filtered audio signal may be presented to the user as a corresponding shaped audio signal. At operation 1510, the media system 100 determines whether the user has selected a personal gain profile 1402. After the user has listened to all shape audio signals and selected a preferred shape audio signal, a personal gain profile 1402 is selected. For example, if the user selects the (2F) audio filter at operation 1508 instead of the (2N) audio filter, the (2F) audio filter is a candidate for the personal gain profile 1402 . At operation 1512, the second stage iterates to the next shape audio signal comparison. For example, the (2F) audio filter selected during the previous iteration may be applied to the music audio signal, and the low level shelving audio filter (2S) may be applied to the music audio signal. At operation 1508, the filtered audio signal may be presented to the user as a corresponding shape audio signal, and the user may select a preferred shape audio signal. At operation 1510, the media system 100 determines whether the user has selected a personal gain profile 1402. For example, if the user selects a (2S) audio filter, the media system 100 identifies the selection as a personal gain profile 1402, as long as the user selects the audio filter and all shape audio signals have been presented to the user for selection.

After exploring level and contour settings, at operation 1002 the media system selects a personal level and frequency dependent audio filter 402 . More specifically, the user is based, for example, in part on the personal level with the personal average gain level determined from the first stage and the frequency dependent audio filter 402, and in part based on the personal level with the personal gain profile 1402 determined from the second stage. A frequency dependent audio filter 402 is used to identify specific squares in the grid. The process may use the selected filter with the personal average gain level and personal gain profile 1402 in the verification operation. In a verification operation, an audio signal (eg, a music audio signal) may be output and played back by the media system 100 using the personal level and frequency dependent audio filter 402 identified during the registration process. The verification operation allows the user to adjust between the selected preset playback and normal playback (no adjustment) so that the user can confirm that the adjustment is in fact an improvement. When the user agrees that the personal level and frequency dependent audio filters improve the listening experience, the user can select an element (eg, "Done") to complete the registration process.

At the end of the registration process, the personal level and frequency dependent audio filters 402 are identified as audio filters with the user's preferred personal average gain and/or personal gain profile 1402 . Thus, at operation 1002 , the media system 100 may be based in part on the personal level and frequency dependent audio filter 402 with the personal average gain level and in part on the personal level and frequency dependent audio filter 402 with the personal gain profile 1402 to select individual level and frequency dependent audio filters 402, as determined by the registration process.

In alternative embodiments, the registration procedure may differ from the process described above with respect to FIGS. 11-15 . Alternative embodiments are described below with respect to FIGS. 16-20 . Similar to the embodiments of Figures 11 and 15, the embodiments of Figures 16-20 allow the user to select one or more of the level and frequency dependent audio filters, and through the user selection, the media system 100 may determine and/or An appropriate personal level and frequency dependent audio filter is selected to apply to the user's audio input signal. Referring to 16, a diagram of a user interface for controlling output of a first audio signal is shown according to an aspect. During the registration process, the media system 100 may output a first audio signal using a first set of level and frequency dependent audio filters. For example, the first audio signal may represent speech (eg, a speech file) containing recorded greetings spoken in languages from around the world. Speech has good contrast between gain levels (compared to music) and thus may facilitate selection of an appropriate average gain level during the first stage of the registration process. During the first stage, the audio input signal 404 may be reproduced sequentially with different enhancement settings for the user. More specifically, level- and frequency-dependent audio filters with different average gain levels may be applied to the first audio signal to provide at different average gains corresponding to different average hearing loss levels (eg, levels 604, 704, or 804). Plays back the audio signal horizontally.

The user may select the current tuning element 1602 of the graphical user interface displayed on the audio signal device 102 of the media system 100 to play the first audio signal at the first amplification level. After listening to the first setting, the user may select the modified tuning element 1604 of the graphical user interface to play the first audio signal at a second amplification level higher than the first amplification level. When the user has identified a preferred setting (eg, a tuning of the voice that allows the user to better hear the first audio signal), the user may select selection element 1606 of the graphical user interface. Alternatively, the user may select through a physical switch, such as by tapping a button on the audio signal device 102 or the audio output device 104 . If the user selects the selection element 1606 when the current tuning element 1602 is enabled, the selection may be the personal average gain level 1702 . More specifically, the personal average gain level 1702 may be the average gain level applied to the first audio signal when the user decides to continue the registration process using the current tuning. Alternatively, the user may choose to continue registration with the modified tuning element 1604 enabled. In this case, the selection advances the registration process to the next operation in the first level. In a next operation, the first audio signal may be reproduced by another pair of level and frequency dependent audio filters.

Referring to FIG. 17A, a diagram is shown of a selection of level and frequency dependent audio filters with different average gain levels, according to an aspect. During the first stage of the registration process, the listener is presented with different enhancement settings and asked to select a preferred setting. The enhancement settings include a first set of level and frequency dependent audio filters applied to the first audio signal, and these filters may correspond to hearing loss curves having different average gain levels. For example, the current tuning may initially be a zero average gain level (no gain level applied to the input signal, or "off"). The modified tuning may be a level and frequency dependent audio filter (IF) corresponding to one of the loss profiles in the first set 602 of FIG. 6 (first level, flat profile). It will be appreciated that subsequent tunings applicable to the first audio signal are shown in the top row of the grid of Figure 17A. More specifically, the additional modified tunings (2F) and (3F) correspond to the loss profiles of the second set 702 of FIG. 7 (second horizontal, flat profile) and the loss profiles of the third set 802 of FIG. three levels, flat profile). In the first stage shown in Figure 17A, the user may listen to the first audio signal with the current tuning and the applied modified tuning, and select the modified tuning, indicating the user's preference to apply more gain to the first audio Signal. Referring to FIG. 17B, a diagram is shown of a selection of level and frequency dependent audio filters with different average gain levels, according to an aspect. At the next operation in the first stage of registration, the first audio signal may be modified by the (IF) level and frequency dependent audio filter as the current tuning. The first audio signal can also be modified by a (2F) level and frequency dependent audio filter as an altered tuning. In one aspect, all tunings applied to the first audio signal during the first stage of registration have the same gain profile. For example, the tuning may be a filter corresponding to the flat loss profile shown in Figures 6-8, and thus may all have a flat gain profile (inversely related to the flat loss profile). Thus, the current tuning in FIG. 17B may have an average gain level corresponding to the average loss level 604 of FIG. 6 , and the modified tuning may have an average gain level corresponding to the average loss level 704 of FIG. 7 . When the user has heard the first audio signal modified by these two filters, the user can select the current tuning as the preferred tuning. The media system 100 may receive a user selection as a selection of a personal average gain level 1702 (eg, 20 dB).

It should be understood that if the user prefers the modified tuning in Figure 17B, selecting the modified tuning will cause the registration process to advance to the next operation in the first level. In the next operation, the first audio signal may be reproduced using level and frequency dependent audio filters ( 2F ) and ( 3F ) corresponding to the loss profiles in FIGS. 7 and 8 . For the sake of brevity, the description of such operations is omitted here.

In one aspect, the first audio signal is output to the user in order of increasing average gain level using the first set of level and frequency dependent audio filters. For example, in FIG. 17A , a first audio signal with a current tuning of zero gain and an altered tuning (IF) corresponding to the average hearing loss 604 of FIG. 6 (eg, an average gain level of 20 dB) is presented. In Figure 17B, a first audio signal is presented with tunings (1F) and (2F) corresponding to the average hearing loss of Figures 6 and 7 (eg, average gain levels of 20dB and 35dB). Thus, audio signal changes may be presented in order of increasing gain. It will be appreciated that, as described above, presenting the audio signal level comparisons in increasing order may speed up the registration process. More specifically, since it is uncommon for a user to want the third gain level more than the first gain level, but not the second gain level more than the first gain level, if the user has selected the With one gain level instead of the second gain level, there is no point in presenting the third gain level. Eliminating the additional comparison (comparing the third gain level with the first gain level) can shorten the registration process.

In an aspect, the first audio signal may have some noise embedded in it to provide realism to the listening experience. By way of example, the first audio signal may include a speech signal representing speech and a noise signal representing noise. The speech signal and the noise signal may be embedded at a certain ratio such that an increase in the level of the first audio signal causes an increase in the level of both speech and noise audio content in the speech file. For example, the ratio of speech signal to noise signal may be in the range of 10dB to 30dB (eg, 15dB). The ratio can be high enough so that the noise does not overpower the speech. However, with each increase in the average gain level, the progressive amplification of noise may prevent the user from selecting levels and frequency dependent audio filters that unnecessarily increase the volume of the audio signal. More specifically, the embedded noise provides a sense of realism to help the user select a level of amplification that compensates for, but does not overcompensate for, the user's hearing loss.

The first audio signal may be set at a calibration level, and therefore volume adjustment during the first stage of the registration process may not be allowed. More specifically, one or more processors of the media system 100 may disable volume adjustment of the media system 100 during output of the first audio signal. By locking the volume control of the media system 100 during the first stage of the registration process, the gain level to compensate for hearing loss can be set to the level corresponding to the common hearing loss curve being tested and the average gain level of the frequency dependent audio filter. Thus, levels can be explored using a fixed level of speech stimuli.

In addition to allowing selection of a personal average gain level 1702 during the first stage, the registration process may include a second stage to select a personal gain profile. The personal gain profile may correspond to a user-preferred gain profile (flat profile, notched profile, or sloping profile) that adjusts the tonal characteristics of the audio input signal according to the user's preference.

Referring to 18, an illustration of a user interface for controlling output of a second audio signal is shown according to an aspect. During the registration process, the media system 100 may output a second audio signal using a second set of level and frequency dependent audio filters. The second audio signal may represent music, such as a music file containing recorded music. Music provides good contrast between timbres (compared to speech) and thus may facilitate selection of an appropriate gain profile during the second stage of the registration process. More specifically, playing music instead of speech during the second level allows the user's timbre or tone preference to be accurately determined.

During the second stage, the audio input signal 404 may be reproduced sequentially with different pitch enhancement settings for the user. More specifically, the second set of level and frequency dependent audio filters for outputting the second audio signal may have different gain profiles. The second set may include a flat audio filter corresponding to the flat loss profile of the common hearing loss curve, a notch audio filter corresponding to the notch loss profile of the common hearing loss curve, and a notch audio filter corresponding to the sloping loss profile of the common hearing loss curve Shelving audio filter. It should be understood that with reference to the loss profiles above and the inverse relationship between the loss profiles and the corresponding gain profiles, the gain profile of a flat audio filter has the highest gain in the low frequency band and the gain profile of a notch audio filter has the highest gain in the mid frequency band. gain, and the gain profile of the oblique audio filter has the highest gain in the high frequency band. An audio filter is applied to the second audio signal to play back the audio signal so that different frequencies corresponding to different hearing loss profiles are apparent.

The user may select the current tuning element 1602 to play the second audio signal with the first audio filter with the corresponding gain profile. After listening to the first setting, the user may select the altered tuning element 1604 to play the second audio signal with a second audio filter having a corresponding gain profile that is different from that of the first audio filter. When the user has identified a preferred setting (eg, a tuning that allows the user to better listen to the music of the second audio signal), the user may select the selection element 1606 . Alternatively, the user may select through a physical switch, such as by tapping a button on the audio signal device 102 or the audio output device 104 .

Referring to FIG. 19A, a diagram is shown of a selection of level and frequency dependent audio filters with different gain profiles, according to an aspect. During the second stage of the registration process, the listener is presented with different enhancement settings and asked to select a preferred setting. The enhancement settings include a second set of level and frequency dependent audio filters applied to the second audio signal, and these filters may correspond to hearing loss curves with different loss profiles. For example, the current tuning may initially be a flat gain profile ( IF ) corresponding to flat loss profile 606 of FIG. 6 . The modified tuning may be a (IN) level and frequency dependent audio filter corresponding to the notch loss profile 608 of FIG. 6 . The user may prefer a filter corresponding to a flat loss profile, and may choose to select element 1606 to proceed to the next operation in the second stage.

The first stage of the registration process need not present all average gain level settings (as represented in the horizontal direction across the grid of FIG. 17A ), while the second stage of the registration process may need to be in the vertical direction across the grid of FIG. 19A All gain profile settings are rendered in the direction. More specifically, even when the user selects the current tuning during the second stage, the registration process may provide additional comparisons between the current tuning and subsequent tunings. Subsequent tunings applicable to the second audio signal are shown in the columns of the grid of Figure 19A. More specifically, the additional modified tuning may correspond to the tilt loss profile for each of the possible average gain level settings.

Referring to FIG. 14B, a diagram is shown of a selection of level and frequency dependent audio filters with different gain profiles, according to an aspect. At the next operation in the second stage of registration, the second audio signal may be modified by a (1F) level and frequency dependent audio filter corresponding to the previously selected gain profile setting and the next gain profile setting (1S) . In one aspect, all tunings applied to the second audio signal during the second stage of registration have the same average gain level. More specifically, the flat gain profile (1F), the notch gain profile (1N), and the sloping gain profile (1S) applied to the second audio signal for comparison pitch adjustment may all have the ones selected during the first stage of registration The average personal gain level of 1702. When the user has heard the second audio signal modified by all filters, the user may select a preferred tuning (eg, modified tuning). The media system 100 may receive the user selection as a selection of the personal gain profile 1902 . For example, the personal gain profile 1902 may be a sloped gain profile (1S).

Compared to the first stage of the registration process, volume adjustment of the media system 100 may be enabled during output of the second audio signal. Allowing volume adjustment can help distinguish the tonal characteristics of different audio signal adjustments. More specifically, allowing the user to adjust the volume of the media system 100 using the volume control 2302 (FIG. 18) may allow the user to hear the difference between each tone setting. Thus, the second stage of the registration process allows the user to explore gain profiles using musical stimuli that excite all frequencies in the audible frequency range, and encourages volume changes to allow the user to distinguish the tonal characteristics of the altered musical stimuli.

The presentation sequence of the filtered audio signal allows the user to step through the grid in the horizontal direction during the first stage and vertically through the grid during the second stage. More specifically, the user may first select the personal average gain level 1702 by stepping through the grid in the horizontal direction along the horizontal axis, and then select the personal gain profile 1902 by stepping through the grid vertically along the shape axis. Each square of the grid represents a level- and frequency-dependent audio filter with a corresponding average gain level and gain profile, and thus, the illustrated example (3x3 grid) assumes that the individual level and frequency-dependent results produced by the registration process The audio filter 402 will be one of 9 level and frequency dependent audio filters corresponding to 9 common hearing loss curves. This level of granularity (eg, three level sets and three contour sets) has been shown to consistently guide the user to select a preset that is consistently preferred by the user, regardless of whether the selected preset exactly matches its hearing loss curve. However, it should be understood that the preset number used in the registration process may vary. For example, the first stage of the registration process may allow the user to step through four or more average gain levels across a grid with more columns. Similarly, more or fewer gain profiles can be represented across the shape axis of the grid to allow the user to evaluate different pitch enhancements.

Referring to FIG. 20, a flow diagram of a method of selecting a personal level and frequency dependent audio filter having a personal average gain level and a personal gain profile is shown, according to an aspect. The flowchart shows the registration process stages for selecting level and frequency dependent audio filters from an audio filter grid with columns and rows.

As mentioned above, the registration process allows the user to first explore the levels to determine the correct column within the audio filter grid. At operation 2002, in a first stage of the registration process, the user compares several levels of audio signals, eg, a current gain level and a next gain level. For example, a zero gain audio filter (no gain or "off") may be applied to the speech audio signal as the current gain level, and a low gain flat audio filter (IF) may be applied to the speech audio signal as the next gain level. The filtered audio signal may be presented to the user as a corresponding horizontal audio signal. At operation 2004, the media system 100 determines whether the user is satisfied with the current level. For example, if the user is satisfied with the zero gain audio filter, the user selects the zero gain audio filter as the personal gain level 1702 . However, if the user selects the next audio level at operation 2006 (eg, a (IF) level and a frequency dependent audio filter), the first decision sequence iterates to the next level audio signal comparison. For example, a (1F) filter may be applied to the speech audio signal as the current gain level, and a medium gain flat audio filter (2F) may be applied to the speech audio signal as the next gain level. The filtered audio signal may be presented to the user as a corresponding horizontal audio signal at operation 2002, and the user may select a preferred horizontal audio signal. At operation 2004, the media system 100 determines whether the user is satisfied with the current level. If the user is satisfied with the current level, the user selects the current level, which the system determines as the personal gain level 1702 . If the user is more satisfied with the next level, the user selects the next gain level and the system iterates to allow the next set of level audio signals to be compared. For example, the sequence advances to allow the user to also compare a medium gain flat audio filter (2F) and a high gain flat audio filter (3F). Whichever of the current levels the user selects during the iteration may be determined as the personal average gain level 1702 . More specifically, when the user selects a zero gain audio filter, (1F) filter, (2F) at the point in the process when the selected filter is the current audio filter (compared to the next audio filter) ) filter or (3F) filter, the selected audio filter can be determined to have a personal gain profile 1702 and the registration process can continue to the second stage.

As described above, the registration process allows the user to explore the gain profile within the selected gain level to determine the correct row within the audio filter grid, and thus arrive at the square within the grid representing the personal level and frequency dependent audio filters 402 . At operation 2008, in a second stage of the registration process, the user compares several shape audio signals.

In special cases, the user selects a zero-gain audio filter as the personal gain level during the first stage. In this case, at decision sequence 2008 the speech file is played. Similar to decision sequence 2002, at decision sequence 2008, a comparison may be made between a zero gain audio filter applied to the speech audio signal and a low gain notch audio filter (IN) applied to the speech audio signal. If a zero gain audio filter is selected again, the process may iterate to compare the zero gain audio filter with the high gain shelving audio filter (1S). If a zero gain audio filter is selected again, the registration process may end and no audio filter is applied to the audio input signal 404 . More specifically, as the flow diagram proceeds through a sequence in which the user selects a number of levels corresponding to the hearing loss curve and a zero gain audio filter on the associated audio filter, the media system 100 determines that the user has normal hearing and does not agree with the default of the system. Adjust the audio settings.

Where the user selects a non-zero personal gain level during the first stage, the shape audio signal comparison at operation 2008 is between non-zero gain audio filters applied to the music audio signal. For example, if at operation 2004 the (1F) audio filter is selected as the personal gain level, then at operation 2008 the (1F) audio filter may be applied to the music audio signal and the low level notch audio filter (1N) may be applied ) applied to music audio signals. The filtered audio signal may be presented to the user as a corresponding shaped audio signal. At operation 2010, the media system 100 determines whether the user has selected a personal gain profile 1902. After the user has listened to all shape audio signals and selected a preferred shape audio signal, a personal gain profile 1902 is selected. For example, if the user selects the (1F) audio filter at operation 2008 instead of the (1N) audio filter, the (1F) audio filter is a candidate for the personal gain profile 1902 . At operation 2012, the second stage iterates to the next shape audio signal comparison. For example, the (IF) audio filter selected during the previous iteration may be applied to the music audio signal, and the low level shelving audio filter (1S) may be applied to the music audio signal. The filtered audio signal may be presented to the user as a corresponding shape audio signal at operation 2008, and the user may select a preferred shape audio signal. At operation 2010 , the media system 100 determines whether the user has selected a personal gain profile 1902 . For example, if the user selects an (1S) audio filter, the media system 100 identifies the selection as a personal gain profile 1902, as long as the user selects the audio filter and all shape audio signals have been presented to the user for selection.

After exploring level and contour settings, at operation 1002 the media system selects a personal level and frequency dependent audio filter 402 . More specifically, the user identifies a network, for example, based in part on the personal level and frequency dependent audio filter 402 having the personal average gain level 1702, and in part based on the personal level and the frequency dependent audio filter 402 having the personal gain profile 1902. specific squares in the grid. The process may use the selected filter with personal gain level 1702 and personal gain profile 1902 in the verification operation. In a verification operation, an audio signal (eg, a music audio signal) may be output and played back by the media system 100 using the personal level and frequency dependent audio filter 402 identified during the registration process. The verification operation allows the user to adjust between the selected preset playback and normal playback (no adjustment) so that the user can confirm that the adjustment is in fact an improvement. When the user agrees that the personal level and frequency dependent audio filters improve the listening experience, the user can select an element (eg, "Done") to complete the registration process.

At the end of the registration process, the personal level and frequency dependent audio filter 402 is identified as the audio filter with the user's preferred personal average gain level 1702 and personal gain profile 1902 . Thus, at operation 1002 , the media system 100 may be based in part on the personal level and frequency dependent audio filter 402 with the personal average gain level 1702 and in part on the personal level and frequency dependent audio filter with the personal gain profile 1902 402 to select a personal level and frequency dependent audio filter 402, as determined by the registration process.

The registration process described above drives the media system 100 to select the individual level and frequency dependent audio filters 402 based on the assumption that the user's actual hearing loss will be similar to the common hearing loss curve presets stored by the system. No knowledge of the user's personal audiogram 500 is required to complete the registration process. However, when the personal audiogram 500 is available, it can lead to as good or better results than the selection process described above.

Referring to FIGS. 21A-21B , a flowchart and diagram, respectively, of a method of determining several hearing loss curves based on a personal audiogram according to an aspect are shown.

The personal audiogram 500 may be used to determine user-specific presets compared to the general presets stored for the registration process described above. For example, if the individual audiogram 500 is known, the media system 100 may select a hearing loss curve preset covering the known audiogram and corresponding level and frequency dependent audio filters. The determination of user-specific presets may constrain the range of level and frequency-dependent audio filters available for selection during the registration process, which may allow greater granularity for the user's selection of personal presets.

In one aspect, using the personal audiogram 500 to drive the presets available for selection during the registration process may be particularly helpful for users with unusual hearing loss profiles. The media system 100 may receive the personal audiogram 500 at operation 2102 . At operation 2104 , the media system 100 may determine a number of hearing loss curves 2110 based on the personal audiogram 500 . Similarly, at operation 2106, the media system 100 may determine a preset level and frequency-dependent audio filter corresponding to the user-specific hearing loss profile. The determined hearing loss profile and/or level and frequency dependent audio filters may be user-specific presets personalized for the user to ensure a good listening experience. For example, a user's average hearing loss 504 may be determined from the personal audiogram 500 , and the determined several user-specific presets may include hearing loss curves each having average hearing loss values similar to the personal audiogram 500 average hearing loss value. In one aspect, the average hearing loss value for each of the user-specific presets is within a predetermined difference (eg, +/- 10 dB hearing loss) of the average hearing loss value of the personal audiogram 500 . As shown in FIG. 21B, each of the user-specific presets may have different hearing loss profiles, even though the presets have similar average loss levels. For example, one of the hearing loss curves may have a flat loss profile 2112 that gradually decreases with increasing frequency, one of the hearing loss curves may have a flat loss profile 2114 with an upward inflection point at about 4 kHz, and one of the hearing loss curves may have a flat loss profile 2114 One may have a flat loss profile 2116 with a downward knee point at about 2 kHz. Such loss contours may be uncommon in a population, but media system 100 may use audio filters corresponding to uncommon contours during the registration process.

In one aspect, the determined level and frequency dependent audio filter corresponding to the user-specific preset is applied to the speech and/or music audio signal. More specifically, audio filters may be evaluated in a decision tree such as the sequence described with respect to FIG. 20 . Using the registration process, the user may identify one of the audio filters as a personal level and frequency dependent audio filter 402 for compensating for the user's hearing loss. Accordingly, at operation 2108, the personal level and frequency dependent audio filter 402 is selected from the number of level and frequency dependent audio filters 2110 for use at operation 1004 (FIG. 10).

Referring to FIGS. 22A-22B , a flowchart and diagram, respectively, of a method for determining an individual's hearing loss profile based on an individual's audiogram according to an aspect are shown. The personal audiogram 500 may be used to select a particular hearing loss curve and corresponding level and frequency dependent audio filters from a preset range stored and/or available to the audio signal device 102 . More specifically, the personal audiogram 500 may be used to determine a preset that most closely corresponds to a known audiogram.

In an aspect, at operation 2202, the media system 100 may receive the personal audiogram 500. At operation 2204 , the media system 100 may determine and/or select a personal hearing loss curve 2205 based on the personal audiogram 500 . For example, the individual hearing loss curve 2205 may be selected from several hearing loss curves stored or available to the media system 100 . Selection of the personal hearing loss curve 2205 may be driven by an algorithm for fitting the personal audiogram 500 to a known hearing loss curve. More specifically, media system 100 may select individual hearing loss curve 2205 having the same average hearing loss and hearing loss curve as individual audiogram 500 . When the closest match is found, the media system 100 may select the personal hearing loss curve 2205 and determine a level and frequency dependent audio filter corresponding to the personal hearing loss curve 2205 . More specifically, at operation 2206, the media system 100 may select or determine a personal level and frequency dependent audio filter 402 corresponding to the personal hearing loss curve 2205, which may be used to compensate for the user's hearing loss.

At operation 1004 (FIG. 10), a personal level and frequency dependent audio filter 402 selected using one of the selection processes described above is applied to the audio input signal 404. Applying a personal level and frequency dependent audio filter 402 to the audio input signal 404 may generate an audio output signal 406 . More specifically, the personal level and frequency dependent audio filter 402 may amplify the audio input signal 404 based on the input level 902 and the input frequency 904 of the audio input signal 404 . Amplification may enhance the audio input signal 404 in a manner that allows the user to normally perceive the audio input signal 404 .

At operation 1006 ( FIG. 10 ), an audio output signal 406 is output by one or more processors of the media system 100 . An audio output signal 406 may be output for playback by an output device. For example, audio signal device 102 may transmit audio output signal 406 to audio output device 104 via a wired or wireless connection. Audio output device 104 may receive audio output signal 406 and play audio content to a user. The reproduced audio may be audio from a phone call, music played by a personal media device, the voice of a virtual assistant, or any other audio content delivered by the audio signaling device 102 to the audio output device 104 .

23, a block diagram of a media system according to an aspect is shown. The audio signal device 102 may be any of several types of portable devices or apparatuses with circuitry suitable for a particular function. Accordingly, the illustrated circuits are provided by way of example and not limitation. The audio signal device 102 may include one or more device processors 2302 to execute instructions to perform the various functions and capabilities described above. Instructions executed by the device processor 2302 of the audio signal device 102 may be retrieved from device memory 2304, which may include non-transitory machine-readable media or non-transitory computer-readable media. The instructions may be in the form of an operating system program with a device driver and/or an accessibility engine for performing the registration process and tuning the audio input based on the personal level and frequency dependent audio filter 402 according to the methods described above Signal 404. The device processor 2302 may also retrieve audio data 2306 from the device memory 2304, including audiograms or audio signals associated with the phone and/or music playback functions controlled by phone or music applications running on top of the operating system. To perform such functions, device processor 2302 may directly or indirectly implement control loops and receive input signals from and/or provide output signals to other electronic components. For example, the audio signaling device 102 may receive input signals from a microphone, a menu button, or a physical switch. Audio signal device 102 may generate and output audio output signal 406 to a device speaker of audio signal device 102 (which may be internal audio output device 104 ) and/or to external audio output device 104 . For example, the audio output device 104 may be a wired or wireless handset to receive the audio output signal 406 via a wired or wireless communication link. More specifically, the processors of audio signal device 102 and audio output device 104 may be connected to respective RF circuits to receive and process audio signals. For example, the communication link may be established through a wireless connection using the Bluetooth standard, and the device processor 2302 may wirelessly transmit the audio output signal 406 to the audio output device 104 via the communication link. The wireless output device may receive and process the audio output signal 406 to play audio content as sound, such as phone calls, podcasts, music, and the like. More specifically, the audio output device 104 may receive and play back the audio output signal 406 to play sound from the earpiece speakers.

Audio output device 104 may include earpiece processor 2320 and earpiece memory 2322. Handset processor 2320 and handset memory 2322 may perform the functions performed by device processor 2302 and device memory 2304 described above. For example, the audio signal device 102 may transmit one or more of the audio input signal 404, the hearing loss curve, or level and frequency dependent audio filters to the earpiece processor 2320, and the audio output device 104 may be used during the registration process and/or Or use the input signal during audio reproduction to generate an audio output signal 406 using a personal level and frequency dependent audio filter 402 . More specifically, the earpiece processor 2320 may be configured to generate the audio output signal 406 and present the signal via the earpiece speaker for audio playback. The media system 100 may include several earpiece components, but only a single earpiece is shown in FIG. 23 . Thus, the first audio output device 104 may be configured to present left channel audio output and the second audio output device 104 may be configured to present right channel audio output.

As described above, one aspect of the present technology resides in the collection and use of data from various sources to perform personalized media enhancements. This disclosure contemplates that, in some instances, these collected data may include personal information data that uniquely identifies or may be used to contact or locate a particular person. Such personal information data may include demographic data, location-based data, phone numbers, email addresses, TWITTER IDs, home addresses, data or records related to the user's health or fitness level (eg, audiograms, vital signal measurements) , medication information, exercise information), date of birth, or any other identifying or personal information.

This disclosure recognizes that the use of such personal information data in the present technology can be used to benefit users. For example, personal information data can be used to perform personalized media enhancements. Accordingly, the use of such personal information data enables the user to have an improved audio listening experience. In addition, this disclosure also contemplates other uses of personal information data that benefit the user. For example, health and fitness data can be used to provide insights into a user's overall health, or can be used as positive feedback for individuals using technology to pursue health goals.

This disclosure contemplates that entities responsible for collecting, analyzing, disclosing, transmitting, storing, or otherwise using such personal information data will comply with established privacy policies and/or privacy practices. Specifically, such entities should implement and adhere to privacy policies and practices that are recognized as meeting or exceeding industry or governmental requirements for maintaining the privacy and security of personal information data. Such policies should be easily accessible to users and should be updated as data collection and/or usage changes. Personal information from users should be collected for the entity's lawful and reasonable uses and not shared or sold outside of those lawful uses. In addition, such collection/sharing should take place after the informed consent of the user has been received. In addition, such entities should consider taking any necessary steps to safeguard and secure access to such personal information data and ensure that others who have access to personal information data comply with their privacy policies and procedures. Additionally, such entities may subject themselves to third-party assessments to demonstrate compliance with generally accepted privacy policies and practices. In addition, policies and practices should be adjusted for the specific types of personal information data collected and/or accessed, and for applicable laws and standards including jurisdiction-specific considerations. For example, in the United States, the collection or acquisition of certain health data may be governed by federal and/or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while health data in other countries may be governed by other regulations and policies and should be dealt with accordingly. Therefore, different privacy practices should be maintained in each country for different types of personal data.

Regardless of the foregoing, the present disclosure also contemplates that users selectively block aspects of the use or access to personal information data. That is, the present disclosure contemplates that hardware elements and/or software elements may be provided to prevent or block access to such personal information data. For example, with respect to personalized media enhancements, the present techniques may be configured to allow a user to choose to "opt-in" or "opt-out" of participation in the collection of personal information data during registration for the service or at any time thereafter. In addition to providing "opt-in" and "opt-out" options, this disclosure contemplates providing notices related to access or use of personal information. For example, the user can be notified when the application is downloaded that their personal information data will be accessed, and then the user is reminded again just before the personal information data is accessed by the application.

Furthermore, the purpose of this disclosure is that personal information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use. Risk is minimized by limiting data collection and deleting data once it is no longer needed. Additionally, and when applicable, including in certain health-related applications, data de-identification may be used to protect the privacy of users. This can be done by removing specific identifiers (eg, date of birth, etc.), controlling the amount or specificity of data stored (eg, collecting location data at the city level instead of the address level), controlling how the data is stored (eg, , aggregate data among users), and/or other methods to facilitate de-identification.

Thus, while this disclosure broadly covers the use of personal information data to implement one or more of the various disclosed aspects, this disclosure also contemplates that various aspects may also be implemented without access to such personal information data. That is, various aspects of the present technology do not fail due to the lack of all or part of such personal information data. For example, the registration process may be determined based on non-personal information data or an absolute minimum amount of personal information, such as the user's approximate age, other non-personal information available to the device processor, or publicly available information.

To assist the Patent Office and any reader of any patents issued in this application in interpreting the appended claims, applicants wish to note that they do not intend any of the appended claims or claim elements to invoke 35 U.S.C. 112 (f), unless the words "means for" or "step for" are expressly used in a particular claim.

In the foregoing specification, the invention has been described with reference to specific exemplary aspects thereof. It will be apparent that various modifications may be made in the specific exemplary aspects without departing from the broader spirit and scope of the invention as set forth in the following claims. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.

Claims (41)

1. A method of enhancing an audio input signal to accommodate hearing loss, the method comprising:

selecting, by one or more processors of a media system, a personal level and frequency-dependent audio filter from a plurality of level and frequency-dependent audio filters corresponding to a plurality of hearing loss curves, wherein the plurality of level and frequency-dependent audio filters have respective average gain levels; and

generating, by the one or more processors, an audio output signal by applying the personal level and frequency dependent audio filter to an audio input signal, wherein the personal level and frequency dependent audio filter amplifies the audio input signal based on an input level and an input frequency of the audio input signal.

2. The method of claim 1, further comprising:

generating, by the one or more processors, an audio signal for playback by a speaker using a predetermined gain level, wherein the predetermined gain level is a scalar gain level that causes the audio signal to be played back by the speaker at a loudness; and

receiving, by the one or more processors in response to playback of the audio signal by the speaker, a selection indicating whether a loudness of the played back audio signal is audible to a user.

3. The method of claim 2, further comprising:

in response to a selection audible to a user indicating a loudness of the played back audio signal, determining that the predetermined gain level is a personal average gain level;

wherein the personal level and frequency dependent audio filter are selected based in part on the personal level and frequency dependent audio filter having a respective average gain level equal to the personal average gain level.

4. The method of claim 2, wherein the audio signal contains speech.

5. The method of claim 2, wherein the predetermined gain level is one of a plurality of predetermined gain levels, and wherein the audio signal is generated in an order of increasing gain using the one or more predetermined gain levels.

6. The method of claim 2, further comprising:

disabling, by the one or more processors, volume adjustment of the media system during output of the audio signal.

7. The method of claim 1, further comprising:

outputting, by the one or more processors, an audio signal using a set of the plurality of level and frequency dependent audio filters, wherein the level and frequency dependent audio filters in the set have different average gain levels; and

receiving, by the one or more processors, a selection of a personal average gain level in response to outputting the audio signal using the group;

wherein the personal level and frequency dependent audio filter are selected based in part on the personal level and frequency dependent audio filter having the personal average gain level.

8. The method of claim 7, wherein the audio signal represents speech.

9. The method of claim 8, wherein the audio signal comprises an audio signal representing the speech and a noise signal representing noise, and wherein a ratio of the speech signal to the noise signal is in a range of 10dB to 30 dB.

10. The method of claim 7, wherein the audio signals are output in order of increasing average gain level using the level and frequency dependent audio filters in the group.

11. The method of claim 7, further comprising:

disabling, by the one or more processors, volume adjustment of the media system during output of the audio signal.

12. The method of claim 1, further comprising:

receiving, by the one or more processors, a personal audiogram;

determining, by the one or more processors, the plurality of hearing loss curves based on the personal audiogram; and

determining, by the one or more processors, the plurality of level and frequency dependent audio filters corresponding to the hearing loss profile.

13. The method of claim 1, further comprising:

receiving, by the one or more processors, a personal audiogram; and

selecting a personal hearing loss profile from the plurality of hearing loss profiles based on the personal audiogram;

wherein the individual level and frequency dependent audio filter corresponds to the individual hearing loss curve.

14. The method of claim 1, further comprising:

transmitting the audio output signal to an audio output device for playback by the audio output device.

15. A media system, the media system comprising:

a memory configured to store a plurality of hearing loss profiles and a plurality of level and frequency dependent audio filters corresponding to the plurality of hearing loss profiles, wherein the plurality of level and frequency dependent audio filters have respective average gain levels; and

one or more processors configured to:

selecting a personal level and frequency dependent audio filter from the plurality of level and frequency dependent audio filters, an

Generating an audio output signal by applying the personal level and frequency dependent audio filter to an audio input signal, wherein the personal level and frequency dependent audio filter amplifies the audio input signal based on an input level and an input frequency of the audio input signal.

16. The media system of claim 15, wherein the one or more processors are further configured to:

generating an audio signal for playback by a speaker using a predetermined gain level, wherein the predetermined gain level is a scalar gain level that causes the audio signal to be played back by the speaker at a loudness; and

in response to playback of the audio signal by the speaker, receiving a selection indicating whether a loudness of the played back audio signal is audible to a user.

17. The media system of claim 16, wherein the one or more processors are further configured to:

in response to a selection audible to a user indicating a loudness of the played back audio signal, determining that the predetermined gain level is a personal average gain level;

wherein the personal level and frequency dependent audio filter are selected based in part on the personal level and frequency dependent audio filter having a respective average gain level equal to the personal average gain level.

18. A non-transitory computer-readable medium containing instructions that, when executed by one or more processors of a media system, cause the media system to perform a method, the method comprising:

selecting, by the one or more processors, a personal level and frequency dependent audio filter from a plurality of level and frequency dependent audio filters corresponding to a plurality of hearing loss curves, wherein the plurality of level and frequency dependent audio filters have respective average gain levels; and

generating, by the one or more processors, an audio output signal by applying the personal level and frequency dependent audio filter to an audio input signal, wherein the personal level and frequency dependent audio filter amplifies the audio input signal based on an input level and an input frequency of the audio input signal.

19. The non-transitory computer readable medium of claim 18, the method further comprising:

generating, by the one or more processors, an audio signal for playback by a speaker using a predetermined gain level, wherein the predetermined gain level is a scalar gain level that causes the audio signal to be played back by the speaker at a loudness; and

receiving, by the one or more processors in response to playback of the audio signal by the speaker, a selection indicating whether a loudness of the played back audio signal is audible to a user.

20. The non-transitory computer readable medium of claim 19, the method further comprising:

in response to a selection audible to a user indicating a loudness of the played back audio signal, determining that the predetermined gain level is a personal average gain level;

wherein the personal level and frequency dependent audio filter are selected based in part on the personal level and frequency dependent audio filter having a respective average gain level equal to the personal average gain level.

21. A method of enhancing an audio input signal, the method comprising:

receiving, by the one or more processors in response to playback of the one or more horizontal audio signals by the speaker, a selection of an audibility selection element indicating a personal gain level of the user;

receiving, by the one or more processors, a selection of a tuning element indicative of a personal gain profile of the user in response to playback of a plurality of shaped audio signals; and

determining, by the one or more processors, a personal audio filter of the user based in part on the personal audio filter having a personal gain level and a personal gain profile, wherein the personal audio filter is configured to amplify an audio input signal based on an input level and an input frequency of the audio input signal.

22. The method of claim 21, wherein the playback of the one or more horizontal audio signals comprises outputting the one or more horizontal audio signals using respective predetermined gain levels to cause the one or more horizontal audio signals to be played back by the speakers at respective loudness.

23. The method of claim 22, wherein the playback of the one or more horizontal audio signals comprises playback of a plurality of horizontal audio signals in increasing order of loudness.

24. The method of claim 21, wherein the one or more horizontal audio signals contain speech.

25. The method of claim 21, further comprising:

disabling, by the one or more processors, volume adjustment of the media system during playback of the one or more horizontal audio signals.

26. The method of claim 21, wherein playback of the plurality of shaped audio signals comprises outputting the plurality of shaped audio signals using respective predetermined gain profiles corresponding to particular hearing loss profiles.

27. The method of claim 26, wherein the particular hearing loss profile comprises two or more of a flat loss profile, a notched loss profile, or a sloped loss profile.

28. The method of claim 21, wherein the plurality of shaped audio signals represent music.

29. The method of claim 21, wherein the personal gain profile comprises gain variations over an audible frequency range.

30. The method of claim 21, wherein the one or more processors are further configured to:

enabling volume adjustment of the media system during playback of the plurality of shaped audio signals.

31. The method of claim 21, further comprising:

generating, by the one or more processors, an audio output signal by applying the personal audio filter to the audio input signal; and

transmitting the audio output signal to an audio output device for playback by the audio output device.

32. A media system, the media system comprising:

one or more processors configured to:

receiving a selection of an audibility selection element indicating a personal gain level of a user in response to playback of one or more horizontal audio signals by a speaker;

receiving a selection of a tuning element indicative of a personal gain profile of the user in response to playback of a plurality of shaped audio signals, an

Determining the personal audio filter of the user based in part on a personal audio filter having a personal gain level and a personal gain profile, wherein the personal audio filter is one of a plurality of level and frequency dependent audio filters and is configured to amplify an audio input signal based on an input level and an input frequency of the audio input signal.

33. The media system of claim 32, wherein the playback of the one or more horizontal audio signals comprises outputting the one or more horizontal audio signals using respective predetermined gain levels to cause the one or more horizontal audio signals to be played back by the speakers at respective loudness.

34. The media system of claim 33 wherein the playback of the one or more horizontal audio signals comprises playback of a plurality of horizontal audio signals in an increasing order of loudness.

35. The media system of claim 32, wherein playback of the plurality of shape audio signals comprises outputting the plurality of shape audio signals using respective predetermined gain profiles corresponding to a particular hearing loss profile.

36. The media system of claim 35, wherein the particular hearing loss profile comprises two or more of a flat loss profile, a notched loss profile, or a sloped loss profile.

37. A non-transitory computer-readable medium containing instructions that, when executed by one or more processors of a media system, cause the media system to perform a method, the method comprising:

receiving a selection of an audibility selection element indicating a personal gain level of a user in response to playback of one or more horizontal audio signals by a speaker;

receiving a selection of a tuning element indicative of a personal gain profile of the user in response to playback of a plurality of shaped audio signals; and

determining the personal audio filter of the user based in part on a personal audio filter having a personal gain level and a personal gain profile, wherein the personal audio filter is one of a plurality of level and frequency dependent audio filters and is configured to amplify an audio input signal based on an input level and an input frequency of the audio input signal.

38. The non-transitory computer-readable medium of claim 37, wherein the playback of the one or more horizontal audio signals includes outputting the one or more horizontal audio signals using respective predetermined gain levels to cause the one or more horizontal audio signals to be played back by the speakers at respective loudness.

39. The non-transitory computer-readable medium of claim 38, wherein the playback of the one or more horizontal audio signals comprises playback of a plurality of horizontal audio signals in an increasing order of loudness.

40. The non-transitory computer-readable medium of claim 39, wherein playback of the plurality of shape audio signals comprises outputting the plurality of shape audio signals using respective predetermined gain profiles that correspond to particular hearing loss profiles.

41. The non-transitory computer readable medium of claim 40, wherein the particular hearing loss profile includes two or more of a flat loss profile, a notched loss profile, or a sloped loss profile.

Images