JP7247751B2 - Information processing device, control method, and state maintenance system - Google Patents

Description

The present invention relates to an information processing device, control method, and state maintenance system.

Techniques for improving a user's inappropriate state by giving a stimulus to the user are conventionally known. For example, Patent Literature 1 discloses a technique of detecting drowsiness or lethargy of a user and vibrating the user in a specific pattern when such a state is detected, thereby awakening the user.

JP 2018-055527 A

However, in the conventional technology as described above, since the user is stimulated every time the user falls into an inappropriate state, there is a problem that the awakening effect of the stimulation gradually weakens. Further, continuous application of a simple stimulus such as a buzzer may make the user feel uncomfortable.

An aspect of the present invention is made in view of the above problems, and an object thereof is to realize an information processing apparatus and the like that can maintain an appropriate state.

In order to solve the above problems, an information processing apparatus according to an aspect of the present invention includes a biometric information acquisition unit that acquires biometric information of a user from a biosensor; and an index value calculation unit that calculates an index value indicating the strength of the tendency of the sound image to move to a predetermined position when the index value is equal to or greater than a first threshold value indicating that the user is in an inappropriate state. and an output control unit for outputting continuous sound from a speaker so as to be formed in the output control unit, wherein a first time has passed since the start of output of the sound, and the index value is If the value indicating that the user is in an inappropriate state is equal to or greater than a second threshold that is smaller than the first threshold, the output of the sound is controlled such that the sound image moves. It is characterized by

According to the above configuration, when the user falls into an inappropriate state, a sound is output from the speaker. Then, if the user is still in an inappropriate state even after a predetermined first time has elapsed from the start of the voice output, that is, if the user's inappropriate state cannot be sufficiently resolved only by the voice output, the sound image moves. to control the audio output. As a result, the user can be stimulated to move the sound image. Therefore, the user's inappropriate state can be improved more reliably. Therefore, the appropriate state of the user can be maintained.

The output control unit of the information processing device determines a position where the sound image differs from the predetermined position when a first time has passed since the start of outputting the sound and the index value is equal to or greater than the second threshold. You may control the output of the said audio|voice so that it may be formed in.

According to the above configuration, since the position of the sound image is changed, the user can be stimulated by a change in sound. As a result, it is possible to further reduce the tendency of the user to be in an inappropriate state.

The output control unit of the information processing device controls that a second time longer than the first time has elapsed since the start of outputting the sound, and the index value is equal to or greater than a third threshold, which is a value greater than the second threshold. In some cases, the audio output from the speaker may be stopped.

According to the above configuration, it is possible to give the user a stimulus to stop the audio output. As a result, it is possible to further reduce the tendency of the user to be in an inappropriate state.

In the information processing apparatus, the biometric information acquisition unit may successively acquire the biometric information of the user from the biosensor. Further, the index value calculation unit sequentially calculates the index value, and the output control unit outputs from the speaker when the index value is equal to or greater than the first threshold after stopping the output of the sound. output of said audio may be resumed.

According to the above configuration, it is possible to monitor the state of the user even after stopping the voice output, and resume the voice output when the user falls into an inappropriate state again. Thereby, the user's appropriate state can be maintained.

The output control unit of the information processing device outputs the sound from the speaker when a third time has elapsed after stopping the output of the sound and the index value is equal to or greater than the first threshold. Output may be resumed.

If the audio output is restarted immediately after the audio output is stopped, the stimulation that the user feels with the audio output may become weak. According to the above configuration, when the third period of time has elapsed after stopping the audio output and the user falls into an inappropriate state, the audio output can be resumed. Therefore, weakening of the stimulus as described above can be prevented.

In the information processing device, the index value calculation unit calculates an index value indicating the strength of the tendency of each state for a plurality of inappropriate states, and the first threshold and the second threshold are set to the inappropriate states. It may be different depending on the type of state.

According to the above configuration, it is possible to eliminate a plurality of inappropriate states. Therefore, the appropriate state of the user can be maintained for a longer period of time.

In the information processing apparatus, the biometric information acquisition unit may acquire the biometric information of the user staying in the predetermined space from the biosensor arranged in the predetermined space. Further, the index value calculation unit may calculate an index value indicating a strength of tendency of the inappropriate state, which is an inappropriate state for the user's purpose of activity in the predetermined space.

According to the above configuration, it is possible to keep the user in a proper state within the predetermined space.

In order to solve the above problems, a state maintenance system according to one aspect of the present invention includes the information processing device, the biosensor, and the speaker. According to the above configuration, the same effects as those of the information processing apparatus can be obtained.

In order to solve the above problems, a control method according to an aspect of the present invention includes a biometric information acquisition step of acquiring biometric information of a user from a biosensor; an index value calculation step of calculating an index value indicating the strength of the tendency; and when the index value is equal to or greater than a first threshold value indicating that the user is in an inappropriate state, the sound image is positioned at a predetermined position. and an output control step of outputting a continuous sound from a speaker so as to form the Controlling the output of the sound so that the sound image moves when the value indicates that the user is in an inappropriate state and is equal to or greater than a second threshold that is a value smaller than the first threshold. characterized by According to the above configuration, the same effects as those of the information processing apparatus can be obtained.

According to one aspect of the present invention, the aptitude state can be maintained.

1 is a diagram showing an overview of a state maintenance system according to Embodiment 1; FIG. It is a block diagram showing an example of the important part configuration of the state maintenance system. 4 is a flow chart showing an example of the flow of processing in an information processing device included in the state maintenance system; 4 is a flowchart showing the flow of sound image processing; 5 is a graph showing a specific example of output control by an output control unit of the information processing device; FIG. 11 is a block diagram showing an example of a main configuration of a state maintenance system according to Embodiment 3; It is a figure which shows an example of the data structure of a stimulus database. It is a figure which shows an example of the data structure of a stimulus database.

A state maintenance system according to each embodiment of the present invention is a system for keeping a user's state in an appropriate state. More specifically, when the user falls into an inappropriate state, the state maintenance system controls the output sound from the speaker to eliminate the inappropriate state, thereby restoring the user's state to the appropriate state. keep to

Here, the "appropriate state" is a state that is presumed to be appropriate in the environment in which the user is placed and for the action that the user is performing or plans to perform (that is, the purpose of the user's activity). indicates that In addition, "inappropriate state" indicates a state that is assumed to be inappropriate in the environment in which the user is placed and in relation to the action that the user is performing or is scheduled to perform.

For example, if the user is a driver of a passenger car, the appropriate state is a state of moderate excitement, and the unsuitable state is a state of feeling sleepy or feeling angry. Further, for example, if the user is lying on the bed, the appropriate state is a state of being relaxed or drowsy, and the unsuitable state is an excited state.

Unless otherwise specified, it is assumed below that the user is sitting on the seat of the moving body. Also, the appropriate state indicates a state in which the subject does not feel sleepy or the strength of sleepiness is below a predetermined level. On the other hand, the inappropriate state indicates a state of feeling sleepy. Further, in the following description, the state of feeling sleepy is also referred to as a "drowsiness state".

However, the environment and state in which the user is placed, and the proper state and improper state are not limited to the examples described below. For example, the present invention can be applied even when the user is in an outdoor environment, or when the user is lying on a bed. Also, the unsuitable state may be an excited state, a state of feeling angry, a state of feeling discomfort, or the like.

[Embodiment 1]
≪System Overview≫
FIG. 1 is a diagram showing an overview of a state maintenance system 100 according to this embodiment. State maintenance system 100 includes information processing device 1 , one or more biosensors 2 , and one or more speakers 3 . In the example of FIG. 1, state maintenance system 100 includes camera 21 and heart rate monitor 22 as examples of biosensor 2 . Also, in the example of FIG. 1 , the state maintenance system 100 includes three speakers 3 . In addition, in the example of FIG. 1 , the passenger sitting on the seat is the user to whom the state maintenance system 100 is applied.

The speaker 3 outputs sound under the control of the information processing device 1 . The output sound of the speaker 3 is continuous sound such as music or radio conversation sound. As shown in the figure, one or a plurality of speakers 3 work together to localize sound, that is, form a sound image. The speaker 3 is a speaker capable of adjusting the position where the sound image is formed.

The biosensor 2 sequentially measures or detects the user's biometric information. In the example of FIG. 1, state maintenance system 100 includes camera 21 and heart rate monitor 22 as biosensor 2 . The biosensor 2 transmits biometric information to the information processing device 1 .

Based on the biometric information received from the biosensor 2, the information processing device 1 specifies the strength of the user's drowsiness tendency, that is, the strength of drowsiness. The identification of the sleepiness intensity is performed sequentially.

The information processing device 1 controls the audio output of the speaker 3 according to the identified strength of drowsiness. For example, the information processing apparatus 1 causes the speaker 3 to output sound, stops the sound being reproduced by the speaker 3, or changes the position where the sound image of the output sound of the speaker 3 is formed. Details of the output control of the speaker 3 by the information processing apparatus 1 will be described later, but the output control is also performed sequentially.

In this way, the state maintenance system 100 gives stimulation to the user by starting or stopping the sound output from the speaker 3 or changing the sound image of the sound output from the speaker 3 . As a result, the state maintenance system 100 can reduce the drowsiness of the user, thereby eliminating the drowsiness state.

≪Main part composition≫
FIG. 2 is a block diagram showing an example of the main configuration of the state maintenance system 100. As shown in FIG. The information processing device 1 , the biosensor 2 , the speaker 3 , and the storage device 4 are devices installed in a predetermined space inside the moving body 9 . Also, the user is a person staying in the predetermined space. The moving body 9 is implemented by a vehicle such as a passenger car, bus, train, or airplane. Moreover, the mobile body 9 may be provided with a seat on which a passenger can sit.

(speaker 3)
The speaker 3 is an output device that outputs continuous sound according to instructions from an output control unit 13 (described later) of the information processing device 1 . The speaker 3 can adjust the sound output so that the sound image of the output sound is formed at a predetermined position. Note that the number and arrangement positions of the speakers 3 in the state maintenance system 100 are not particularly limited.

(Biological sensor 2)
The biosensor 2 is a device or group of devices that measure or detect a user's biometric information. The biosensor 2 sequentially measures or detects biometric information. The biosensor 2 includes a camera 21 and a heartbeat meter 22, for example.

The camera 21 captures a still image or moving image in which at least one of the user's facial expression and motion can be specified. The camera 21 transmits the captured still image or moving image to the biometric information acquisition unit 11 of the information processing device 1 as biometric information.

A heart rate monitor 22 measures the heart rate of the user. The heart rate meter 22 may be a detachable sensor worn directly on the user's body, or may be a sensor capable of measuring the heart rate value without touching the user.

The biosensor 2 may also include a sensor that measures vital data indicating the respiration, body temperature, blood pressure, consciousness, reflection, etc. of the human body. The measurement result of the sensor is also transmitted to the information processing apparatus 1 as biological information.

Moreover, the biosensor 2 may transmit the measurement data of the biosensor as it is to the information processing apparatus 1 as the biometric information, or may transmit the measurement data after appropriately processing it to the information processing apparatus 1 . When processing the measured data by the biosensor, it is desirable to process the data into a data format that is easy to use for the drowsiness level calculation process in the index value calculation unit 12, which will be described later. For example, the camera 21 may transmit the photographed image as it is to the information processing apparatus 1 , or may extract only the human face portion and transmit the image of the face to the information processing apparatus 1 .

A plurality of sensors of the same type or different types as the biosensors 2 may be arranged at different positions in the internal space of the moving body 9 . For example, when the moving body 9 is a passenger car, one or more cameras 21 and one or more heart rate meters 22 may be arranged for each seat of the passenger car. As a result, for example, when a user sits on each seat, it is possible to obtain a still image or moving image and a heartbeat value for each user.

(storage device 4)
The storage device 4 is a storage device that stores various data used for the operation of the information processing device 1 . For example, the storage device 4 stores audio data that the information processing device 1 causes the speaker 3 to reproduce. In this embodiment, as an example, the speaker 3 is caused to output music. In this case, the storage device 4 stores one or more pieces of music data 41 . The music data 41 is a kind of audio data reproduced by the speaker 3 . The type and contents of the music data 41 are not particularly limited, but it is desirable that the content be content that can attract the interest of the user, such as songs that the user likes.

(Information processing device 1)
The information processing device 1 is a device that controls the output of the speaker 3 based on the biometric information received from the biosensor 2 . The information processing device 1 includes a biometric information acquisition unit 11 , an index value calculation unit 12 and an output control unit 13 .

The biometric information acquisition unit 11 acquires the biometric information of the user from the biosensor 2 . In the example of FIG. 2, the biometric information acquiring unit 11 acquires the image captured by the camera 21 and the value of the heart rate measured by the heartbeat meter 22 as biometric information. The biometric information acquisition unit 11 outputs the acquired biometric information to the index value calculation unit 12 . The biometric information acquisition unit 11 sequentially receives biometric information from the biosensor 2 . It is desirable that the biometric information receiving period in the biometric information acquisition unit 11 is the same as the sleepiness level calculation period described later in the index value calculation unit 12 . Moreover, the output timing of the biometric information from the biometric information acquisition unit 11 to the index value calculation unit 12 may be determined according to the sleepiness level calculation cycle.

The index value calculation unit 12 calculates an index value indicating the strength of the user's inappropriate state tendency based on the biometric information. In this embodiment, as an example, a case will be described in which the index value calculation unit 12 calculates an index value that indicates the strength of the tendency to be drowsy. Hereinafter, the strength of the drowsiness tendency, that is, the index value indicating the strength of drowsiness will also be referred to as "drowsiness level". A method for calculating the sleepiness level is not particularly limited.

For example, the index value calculator 12 may calculate the sleepiness level based on the sleepiness evaluation method of NEDO (New Energy and Industrial Technology Development Organization). According to the sleepiness evaluation method of NEDO, the sleepiness level is calculated as a level from 1 to 5. Sleepiness level 1 is not sleepy at all, sleepiness level 2 is slightly sleepy, sleepiness level 3 is sleepy, sleepiness level 4 is very sleepy, sleepiness level 5 is very sleepy or just started to sleep. indicates that the

The index value calculation unit 12 calculates the drowsiness level each time biometric information is input from the biometric information acquisition unit 11 . Since the biosensor 2 sequentially acquires biometric information as described above, the biometric information acquisition unit 11 also acquires biometric information sequentially and outputs the biometric information to the index value calculation unit 12 . Therefore, the index value calculation unit 12 sequentially calculates the drowsiness level. Thereby, the information processing device 1 can monitor the sleepiness level of the user. The index value calculator 12 may temporarily store the calculated drowsiness level value. The index value calculator 12 outputs the sleepiness level value to the output controller 13 .

The output control unit 13 controls audio output of the speaker 3 . The output control unit 13 outputs the drowsiness level value input from the index value calculation unit 12, whether the held timer 131 is timing, and if the timer 131 is timing, based on the time counted by the timer 131. 3 control method is determined.

A timer 131 measures time. The timer 131 starts measuring time when the output control unit 13 causes the speaker 3 to start playing the music data 41 . Although the details will be described later, the timer 131 counts three types of time from the start to the end of music reproduction. The first is the elapsed time t1 from the start of music reproduction. The second is the elapsed time t2 from the start of music reproduction or the completion of sound image movement. The third is the elapsed time t3 from the stop of music reproduction.

For example, when the drowsiness level is equal to or higher than a first threshold value indicating that the user is in a drowsiness state, the output control unit 13 continuously outputs sound from the speaker 3 so that a sound image is formed at a predetermined position. Start audio output. Specifically, the output control unit 13 reads any music data 41 from the storage device 4 and causes the output control unit 13 to reproduce the music data 41 . When calculating the drowsiness level by the NEDO drowsiness evaluation method, the first threshold may be set to, for example, about 2.5.

Further, the output control unit 13 sets a value indicating that a predetermined first time has passed since the start of outputting the sound, and that the drowsiness level is a drowsiness state, and is a value smaller than the first threshold. When it is equal to or greater than the threshold, the audio output of the speaker 3 is controlled so that the sound image formed as described above moves.

The first time may be determined as appropriate. For example, the first time period may be a length that is assumed to make the user tired of the music if the music is simply continuously output from the speaker 3 . Specifically, the first time may be set to, for example, about 1.5 minutes. Further, when calculating the drowsiness level by the sleepiness evaluation method of NEDO, the second threshold value may be set to about 1.5, for example.

Note that the output control unit 13 determines that the sound image is formed at a position different from the above-described predetermined position when a predetermined first time has passed since the start of outputting the sound and the drowsiness level is equal to or higher than the second threshold. The audio output of the speaker 3 may be controlled as follows. In other words, the output control unit 13 may move the position of the sound image from a predetermined position to a position different from the predetermined position, instead of continuing to move the sound image of the output sound of the speaker 3.

In addition, the output control unit 13 determines that a second time, which is a predetermined time longer than the first time, has passed since the speaker 3 started outputting sound, and the drowsiness level is a value greater than the second threshold. Audio output from the speaker 3 may be stopped when the threshold is equal to or greater than the third threshold.

The second time may be determined as appropriate. For example, the second time period may be a length that is assumed to make the user tired of the music even when the music is changed by moving the sound image. Specifically, the second time may be set to, for example, about 3 minutes. Further, when calculating the drowsiness level by the NEDO drowsiness evaluation method, the third threshold value may be set to a value greater than 2.5, for example.

In addition, the output control unit 13 monitors the drowsiness level input from the index value calculation unit 12 even after the audio output of the speaker 3 is stopped. audio output may be restarted. In other words, the output control unit 13, after stopping the sound output of the speaker 3, when the third time that is the predetermined time has passed and the drowsiness level is equal to or higher than the first threshold, the speaker 3 You may resume audio output from

(Modified example of main part configuration)
Note that the storage device 4 may be an external device of the information processing device 1 as shown in FIG. Alternatively, a storage unit of a terminal device such as a smartphone or a music player connected to the information processing device 1 may be used as the storage device 4 . As a result, the user can cause the speaker 3 of the moving body 9 to reproduce the music data 41 stored in his/her smart phone, music player, or the like.

Further, the information processing device 1 may include at least one of a communication unit that performs Internet communication and a receiving antenna that receives broadcast waves of television, radio, and the like. Then, instead of reading the music data 41 from the storage device 4 and causing the speaker 3 to reproduce the music data 41, the output control unit 13 reads audio data downloaded via the Internet or audio data included in broadcast waves received by the receiving antenna. It may be reproduced by the speaker 3. Also in this case, the subsequent processing is the same as in the case of reproducing the music data 41 .

<<Process flow>>
FIG. 3 is a flowchart showing an example of the flow of processing in the information processing apparatus 1. As shown in FIG. Note that the drowsiness level is denoted as N in the examples of FIGS. 3 and 4 . Also, in the examples of FIGS. 3 and 4, it is assumed that the drowsiness level is calculated by the NEDO evaluation method. Also, in the examples of FIGS. 3 and 4, the first time is set to 3 minutes, the second time is set to 1.5 minutes, and the third time is set to 1 minute.

(Determination of music playback start)
The biometric information acquisition unit 11 of the information processing device 1 acquires biometric information from the biosensor 2 (S10). The biometric information acquisition unit 11 outputs the biometric information to the index value calculation unit 12 . The index value calculator 12 calculates the sleepiness level based on the input biological information (S12). The index value calculator 12 outputs the calculated drowsiness level value to the output controller 13 . It should be noted that the processes of S10 to S12 are performed sequentially even while the subsequent processes are being performed. Then, the drowsiness level calculated by the index value calculation unit 12 is sequentially input to the output control unit 13 .

When the output control unit 13 receives the drowsiness level value from the index value calculation unit 12, it checks whether the timer 131 is counting t1 and t2. As shown, the timer 131 is not counting when the drowsiness level is first entered. In this case, the output control unit 13 determines whether or not the input drowsiness level is equal to or higher than the first threshold (level 2.5) (S14). If the drowsiness level is less than the first threshold (NO in S14), the output control unit 13 does not perform subsequent processing, and waits until the drowsiness level is input from the index value calculation unit 12 next time.

On the other hand, if the drowsiness level is equal to or higher than the first threshold (YES in S14), the output control unit 13 causes the speaker 3 to start playing music indicated by the music data 41 (S16). At this time, the output control unit 13 starts counting t1 and t2 in the timer 131 (S18). After the speaker 3 starts playing music, the output control unit 13 determines whether or not the sound image needs to be moved, and executes processing related to the movement (S20). This processing is hereinafter also referred to as “sound image processing”.

(sound image processing)
FIG. 4 is a flowchart showing the flow of sound image processing. The output control unit 13 first determines whether or not t2 is equal to or longer than the second time (1.5 minutes in the example of FIG. 4) (S201). When t2 is equal to or longer than the second time (YES in S201), the output control unit 13 determines whether the drowsiness level most recently input from the index value calculating unit 12 is equal to or higher than the second threshold (level 1.5). (S202).

If the drowsiness level is less than the second threshold (NO in S202), the output control unit 13 repeats the determination processes of S201 and S202. As described above, the sleepiness level value is sequentially input to the output control unit 13 (that is, the sleepiness level is updated). If the drowsiness level is equal to or higher than the second threshold (YES in S202), the output control unit 13 controls the output of the speaker 3 so that the sound image moves (S203). Then, the output control unit 13 resets the count of t2 in the timer 131 (S204). After resetting the count of t2, the timer 131 starts counting from 0 again to t2.

On the other hand, when t2 is less than the second time in S201 (NO in S201), the output control unit 13 does not execute the processes of S202 to S204, and executes the next process in FIG.

(Judgment to stop or continue music)
When the sound image processing (S20) ends, the output control section 13 executes the determination of S22 in FIG. That is, the output control unit 13 determines whether or not the count of t1 of the timer 131 is equal to or longer than the first time (three minutes in the example of FIG. 3) (S22). When t1 is less than the first time (NO in S22), the output control unit 13 executes the sound image processing (S20) again. On the other hand, if t1 is equal to or longer than the first time (YES in S22), the output control unit 13 determines that the drowsiness level most recently input from the index value calculation unit 12 is the third threshold (level 2.0). 5) Determine whether or not it is equal to or greater than (S24). Although the third threshold and the first threshold are the same value in FIG. 3, they may be the same value or different values. If the drowsiness level is smaller than the third threshold (NO in S24), the output control unit 13 executes the process of S20.

On the other hand, if the drowsiness level is equal to or higher than the third threshold (YES in S24), the output control unit 13 stops the reproduction of music on the speaker 3 (S26). Then, the output control unit 13 resets the count of t1 and t2 in the timer 131, stops the count of t1 and t2 in the timer 131, and starts the count of t3 (S28). The order of the processing of S26 and the processing of S28 may be reversed, or may be performed in parallel.

The output control unit 13 monitors until the count of t3 of the timer 131 reaches the third time (NO in S30). When t3 reaches the third time (YES in S30), the output control unit 13 resets and stops counting t3 of the timer 131 (S32), and executes the processing from S14 again. That is, the output control unit 13 determines whether or not the input drowsiness level is equal to or higher than the first threshold (level 2.5) (S14). Subsequent processing is as described above.

According to the processing described above, the speaker 3 outputs sound when the user falls into an inappropriate state. Then, if the user is still in an inappropriate state even after a predetermined first time has elapsed from the start of the voice output, that is, if the user's inappropriate state cannot be sufficiently resolved only by the voice output, the sound image moves. to control the audio output. As a result, the user can be stimulated to move the sound image. Therefore, the user's inappropriate state can be improved more reliably. Therefore, the appropriate state of the user can be maintained.

Moreover, according to the above-described processing, the user can be stimulated by a change in sound, rather than using means such as warning sounds, vibrations, or the like, which may surprise or discomfort the user. Therefore, the inappropriate state of the user can be improved without making the user feel uncomfortable.

According to the processing described above, since the position of the sound image is changed, the user can be stimulated by a change in sound. As a result, it is possible to further reduce the tendency of the user to be in an inappropriate state.

Moreover, according to the above-described processing, it is possible to give the user a stimulus to stop the voice output. As a result, it is possible to further reduce the tendency of the user to be in an inappropriate state.

Further, according to the above processing, the user's condition can be monitored even after the audio output is stopped, and the audio output can be resumed when the user falls into an inappropriate state again. Thereby, the user's appropriate state can be maintained.

In addition, if the audio output is restarted immediately after the audio output is stopped, the stimulus that the user feels with the audio output may become weak. Therefore, according to the processing described above, when the third period of time has passed and the user has fallen into an inappropriate state after the audio output has been stopped, the audio output can be restarted. Therefore, weakening of the stimulus as described above can be prevented.

<<Specific example of output control>>
Note that the output control unit 13 may control the distance between the position where the sound image is formed by the output of the speaker 3 and the user. For example, the distance between the position where the sound image is formed and the user may be determined in consideration of the classification of a person's personal area. A personal area is an area in which a person feels uncomfortable when intruded by another person. It is known that a certain person's personal area varies depending on the depth of the human relationship between the person and others.

For example, in the classification of personal areas proposed by Edward T. Hall, it is known that a person's personal space has a radius of about 450 mm or less as a close distance, a radius of about 1200 mm or less as an individual distance, and a radius of about 3500 mm or less as a social distance. It is A close distance is a distance at which people other than very close people feel discomfort. From close distance to individual distance, from individual distance to social distance, every time the distance increases, the impression that a certain person has of another person at that distance changes. In addition, it is known that the personal area is divided into a plurality of areas in various proposed classifications of the personal area, and that people have different impressions depending on the distance from themselves to others.

Taking this into consideration, for example, the output control unit 13 may control the speaker 3 so that the distance between the user and the sound image forming position is 450 mm or more, or 500 mm or more. As mentioned above, the area within a radius of 450 mm from a person is the close distance for that person. In another definition of personal area, it is known that an area within a radius of 500 mm from a certain person is called an exclusive area, an area in which the person is presumed not to want other people to enter. . By arranging the sound image outside such a close area or outside an exclusive area, it is possible to prevent the user from having a negative impression such as surprise or discomfort while stimulating the user.

Further, for example, when moving the sound image in S203 of FIG. 4, the output control unit 13 may determine at least one of the movement distance and the destination position of the sound image at that time according to a specific rule or pattern.

For example, the output control unit 13 preferably moves the sound image so that the sound image formation position before the movement and the sound image formation position after the movement are different from each other. As a result, the user's impression of the sound changes when the sound image is moved. The change in impression can be a stimulus for the user. Therefore, by moving the sound image as described above, it is possible to effectively stimulate the user.

Also, the moving distance of the sound image is preferably 450 mm or more, and the distance from the user to the position where the sound image is formed is also preferably changed by about 450 mm. As a result, the sound image moves on the boundary line between the above-described segmented area with the various personal areas and the adjacent segmented area, that is, the movement is such that the user's perception of the sound image position does not change much. can be prevented.

FIG. 5 is a graph showing a specific example of output control by the output control unit 13. In FIG. The vertical axis of the graph indicates the value of the drowsiness level N calculated by the index value calculation unit 12, and the horizontal axis indicates the elapsed time since the state maintenance system 100 was activated. "PLAY" and "STOP" in the graph indicate the start and end of music reproduction, respectively. In addition, "short distance", "middle distance", and "long distance" in the graph indicate the distance between the sound image formation position and the user at each timing. The specific distance lengths of the short distance, medium distance, and long distance in the example of FIG. 5 are not particularly limited. For example, a short distance may be 450 mm or more and less than 750 mm from the user, a medium distance may be a distance of 750 mm or more and less than 1200 mm from the user, and a long distance may be a distance of 1200 mm or more.

In the example of FIG. 5, the output control unit 13 sets the position of the sound image to a random position that is different from the current position and that is in a different distance division from the current distance division. It is assumed that there is Further, specific values of the first to third thresholds and the first to third times in the example of FIG. 5 are the same as those of FIGS.

After the activation of the state maintenance system 100 is started, at timing m1, when the drowsiness level N exceeds the first threshold (level 2.5), the output control unit 13 starts playing music. At this time, the output control unit 13 controls the speaker 3 to reproduce music so that the sound image is positioned at a middle distance.

After that, although the drowsiness level decreases in the graph, at timing m2, the drowsiness level exceeds 1.5 when t2 is 1.5 minutes or more and t1 is less than 3 minutes (NO in S22 and YES in S201). (YES in S202). In this case, the output control unit 13 moves the sound image as described in S203.

From timing m2 to m3, the drowsiness level does not exceed 2.5 (NO at S24) and is not at least 1.5 (NO at S202), so the output control unit 13 does not move the sound image. Keep the speaker 3 playing music. Then, at timing m3, when the drowsiness level becomes 1.5 or higher (YES in S202), the output control unit 13 moves the sound image again.

Next, at timing m4, three minutes have passed since the start of music reproduction, and the drowsiness level exceeds 2.5 (YES in S24). In this case, the output control unit 13 causes the speaker 3 to stop outputting music.

Thereafter, the output control unit 13 waits with the music stopped until the drowsiness level becomes 2.5 or higher again. When the drowsiness level becomes 2.5 or higher at timing m5 (YES in S14), the output control unit 13 causes the speaker 3 to reproduce music. The music reproduced at this time may be the same as the music reproduced up to timing m4, or may be different. Also, at this time, the music that has been played up to the timing m4 may be played from the continuation.

After that, at timings m6 to m9, the output control unit 13 moves the sound image in the same manner as at timing m2. Then, at timing m10, the output control unit 13 causes the speaker 3 to stop outputting music, as at timing m4.

Note that the first to third threshold values, the first to third times, and the sound image formation position may be set according to user characteristics, the type of inappropriate state or appropriate state, and the type of sound to be output. Also, the first to third thresholds and the first to third times may be dynamically changed according to the user's characteristics, the type of inappropriate state or appropriate state, and the type of voice to be output. For example, the information processing device 1 can identify various user characteristics such as the user's sex and age based on the biometric information obtained from the biosensor 2 .

For example, when the age of the user is equal to or greater than a predetermined value, the information processing apparatus 1 may make at least one of the first to third times longer than when the user's age is less than the predetermined value. For example, when the user is female, the information processing apparatus 1 may form the sound image at a farther position than when the user is male. This is because women are generally said to have a wider personal space.

[Embodiment 2]
The index value calculation unit 12 may calculate an index value indicating the strength of the tendency of each state for a plurality of inappropriate states. The first threshold and the second threshold may differ according to the type of inappropriate state. Also, the third threshold may be different depending on the type of unsuitable state.

Other embodiments of the present invention are described below. For convenience of description, members having the same functions as those of the members described in the above embodiments are denoted by the same reference numerals, and description thereof will not be repeated. This also applies to subsequent embodiments.

In the present embodiment, the index value calculator 12 identifies each of the index values indicating the tendency of the strength of the inappropriate state based on the biometric information. The calculation method for each index value may be different. For example, the drowsiness level and the index value indicating the strength of the tendency to be angry may be calculated using different methods.

Further, which state of the user is determined to be the inappropriate state by the index value calculation unit 12 may be determined in advance or may be appropriately set by the user or the like. The setting of the state determined to be inappropriate may be stored in the storage device 4 or the like. In this embodiment, the output control unit 13 uses the first, second, and third thresholds for each inappropriate state to perform the processing described in FIGS. 3 and 4 of the first embodiment.

According to the above configuration, it is possible to eliminate a plurality of inappropriate states. Therefore, the appropriate state of the user can be maintained for a longer period of time.

[Embodiment 3]
The output control unit 13 may stimulate the user by a method other than moving the sound image of the output sound of the speaker 3 . FIG. 6 is a block diagram showing an example of the main configuration of the state maintenance system 200 according to this embodiment. State maintenance system 200 differs from state maintenance system 100 in that information processing device 5 and storage device 6 are included.

The storage device 6 has the same functions as the storage device 4 except that it has a stimulus database (DB) 61 . 7 and 8 are diagrams each showing an example of the data structure of the stimulus database (DB) 61. FIG. The stimulus DB 61 is data that defines the content of control processing performed by the output control unit 13 and the duration of the processing when the drowsiness level exceeds the threshold for the setting of the drowsiness level threshold. .

In the examples of FIGS. 7 and 8, the stimulus DB 61 is a DB in which the information in the "threshold" column is associated with the information in the "details of control" column and the information in the "duration" column. The "threshold" column stores information indicating the threshold of the drowsiness level. The "control content" column stores information indicating the content of the output control process executed by the output control unit 13. FIG.

For example, "ON/OFF switching" in FIG. Also, "movement of sound image" indicates processing for moving the sound image of the output sound, as described in the first embodiment. "Frequency change" indicates control processing for changing the frequency of the music data 41 to be played back.

Further, for example, "ON" in FIG. 8 indicates control processing for starting reproduction of music from the speaker 3. "Amplitude change" indicates control processing for changing the amplitude of the waveform during playback of the music data 41, that is, the volume. Also, "change in speed" indicates control processing for changing the speed of reproducing music on the speaker 3. FIG.

The "duration" column stores information indicating the duration of the control described in the "control details" column. Note that when the processing in the "control content" column is not continuous processing as in the first row of FIG. 8, the "duration" column may be blank.

The information processing device 5 differs from the information processing device 1 in that it includes an output control section 15 instead of the output control section 13 . When the drowsiness level is input from the index value calculation unit 12, the output control unit 15 refers to the stimulation DB 61 of the storage device 6 to determine whether the input drowsiness level is equal to or higher than any threshold indicated by the stimulation DB 61. determine whether or not

For example, the output control unit 15 reads out the control content and the duration corresponding to the threshold less than the input drowsiness level and closest to the input drowsiness level from the stimulus DB 61 . Then, the output control unit 15 controls the speaker 3 according to the content of control and the duration. Note that when the drowsiness level is less than all the threshold values shown in the stimulation DB 61, the output control unit 15 does not control the output of the speaker 3. FIG.

[Example of realization by software]
The control blocks of the information processing apparatuses 1 and 5 may be implemented by logic circuits (hardware) formed in integrated circuits (IC chips) or the like, or may be implemented by software.

In the latter case, the information processing apparatuses 1 and 5 are provided with computers that execute instructions of programs, which are software for realizing each function. This computer includes, for example, one or more processors, and a computer-readable recording medium storing the program. In the computer, the processor reads the program from the recording medium and executes it, thereby achieving the object of the present invention. As the processor, for example, a CPU (Central Processing Unit) can be used. As the recording medium, a "non-temporary tangible medium" such as a ROM (Read Only Memory), a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. Further, a RAM (Random Access Memory) for expanding the program may be further provided. Also, the program may be supplied to the computer via any transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. Note that one aspect of the present invention can also be implemented in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

The present invention is not limited to the above-described embodiments, but can be modified in various ways within the scope of the claims, and can be obtained by appropriately combining technical means disclosed in different embodiments. is also included in the technical scope of the present invention.

100, 200 state maintenance system 1, 5 information processing device 11 biometric information acquisition unit 12 index value calculation unit 13, 15 output control unit 131 timer 2 biosensor 21 camera 22 heart rate monitor 3 speaker 4, 6 storage device 41 music data 61 stimulus database
9 Mobile

Claims (7)

a biometric information acquisition unit that acquires biometric information of a user from a biosensor;
an index value calculation unit that calculates an index value indicating the strength of the user's inappropriate state tendency based on the biometric information;
Output control for outputting continuous sound from a speaker so that a sound image is formed at a predetermined position when the index value is equal to or greater than a first threshold, which is a value indicating that the user is in an inappropriate state. and
In the output control unit, a first time has passed since the start of outputting the voice, and the index value is a value indicating that the user is in an inappropriate state, and is smaller than the first threshold. is equal to or greater than a second threshold value, the output of the sound is controlled such that the sound image moves , a second time longer than the first time has passed since the start of the output of the sound, and the index If the value is equal to or greater than a third threshold that is greater than the second threshold, the output of the sound from the speaker is stopped.
An information processing device characterized by: The output control unit configures the sound image to be formed at a position different from the predetermined position when a first time has passed since the start of outputting the sound and the index value is equal to or greater than the second threshold. 2. The information processing apparatus according to claim 1, wherein the output of said voice is controlled at the same time. The biometric information acquisition unit sequentially acquires the biometric information of the user from the biosensor,
The index value calculation unit sequentially calculates the index value,
The output control unit restarts the output of the sound from the speaker when a third period of time has elapsed after stopping the output of the sound and the index value is equal to or greater than the first threshold. 3. The information processing apparatus according to claim 1 , characterized by: The index value calculation unit calculates, for each of the plurality of inappropriate states, an index value indicating the strength of the tendency of each state,
4. The information processing apparatus according to any one of claims 1 to 3 , wherein said first threshold and said second threshold differ according to the type of said inappropriate state. The biometric information acquisition unit acquires the biometric information of the user staying in the predetermined space from the biosensor placed in the predetermined space,
Claims 1 to 4 , characterized in that said index value calculation unit calculates an index value indicating a strength of a tendency of said inappropriate state, which is an inappropriate state for the user's purpose of activity in said predetermined space. The information processing device according to any one of . an information processing apparatus according to any one of claims 1 to 5 ;
the biosensor;
A state maintenance system, comprising: the speaker; A control method used in an information processing device,
The information processing device is
a biometric information acquisition step of acquiring biometric information of a user from a biosensor;
an index value calculation step of calculating, based on the biometric information, an index value indicating the strength of the tendency of the user to be in an inappropriate state;
Output control for outputting continuous sound from a speaker so that a sound image is formed at a predetermined position when the index value is equal to or greater than a first threshold, which is a value indicating that the user is in an inappropriate state. Run the steps and
In the output control step, a first time has passed since the start of outputting the voice, and the index value is a value indicating that the user is in an inappropriate state, and is smaller than the first threshold. is equal to or greater than a second threshold value, the output of the sound is controlled such that the sound image moves , a second time longer than the first time has passed since the start of the output of the sound, and the index A control method characterized by stopping the output of the sound from the speaker when the value is equal to or greater than a third threshold that is greater than the second threshold.

Images