JP2021106005A - Electronic apparatus, control method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic device, a control method and a program capable of achieving safe driving. Based on the image data transmitted from the first camera unit 11, the second camera unit 12, and the first camera unit 11, whether or not the user included in the image data is awake. The user is determined by the determination determination unit 13, the traveling state determination unit 14 that determines whether or not the vehicle is in the traveling state based on the image data transmitted from the second camera unit 12, the notification unit 15, and the determination unit 13. When it is determined that the camera is not awake and the traveling state determination unit 14 determines that the vehicle is in the traveling state, the control unit 16 controls the notification unit 15 so as to perform a predetermined notification. [Selection diagram] Fig. 1

Description

The present invention relates to electronic devices, control methods and programs that perform predetermined notifications.

A means for detecting the physical condition of the driver of a vehicle has been considered for the purpose of preventing drowsy driving. As a means for detecting the physical condition of the driver of this vehicle, there is a means based on the pulse rate of the driver and the electrocardiographic potential between both hands (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 7-228171

By the way, in order to detect the driver's heart rate, etc., it is necessary to have the driver wear the detection device, which may interfere with the driver or make the setting complicated, and may not be preferred by the driver. There is.
An object of the present invention is to provide an electronic device, a control method, and a program capable of detecting a driver's carelessness and achieving safe driving without disturbing the driver and making settings complicated. do.

The electronic device according to the present invention is included in the image data based on the image data transmitted from the first camera unit, the second camera unit, and the first camera unit in order to solve the above-mentioned problems. A determination unit that determines whether or not the user is awake, and a traveling state determination unit that determines whether or not the user is in a traveling state based on the image data transmitted from the second camera unit. When the notification unit and the determination unit determine that the user is not awake and the traveling state determination unit determines that the user is in the traveling state, control that controls the notification unit to perform a predetermined notification. It is a configuration including a part.

The electronic device may be provided with an acceleration sensor, and the traveling state determination unit may be configured to determine whether or not the vehicle is in a traveling state by taking into consideration the acceleration value acquired by the acceleration sensor.

In the electronic device, the determination unit determines whether or not the size of the user's face included in the image data is suitable for determining whether or not the user's face is awake, and determines that the size is not suitable. In some cases, the size of the user's face may be adjusted to an appropriate size.

In the electronic device, the determination unit determines whether or not the image data includes the user's face, and the control unit determines that the image data does not include the user's face. In this case, the notification unit may be controlled so as to perform a predetermined notification.

In the electronic device, the determination unit determines whether or not the user is in a preliminary state in which the user is not awake, and the control unit determines that the user is in the preliminary state by the determination unit. In this case, the notification unit may be controlled so as to perform a predetermined notification.

In the electronic device, the control unit may be configured to contact a preset contact when the determination unit determines that the user is not awake or the user is in the preliminary state. ..

In the electronic device, when the determination unit determines that the user is not awake or the user is in the preliminary state, the control unit searches for a predetermined location and guides the user to the predetermined location. It may be configured.

In the control method according to the present invention, in order to solve the above-mentioned problems, it is determined whether or not the user included in the image data is awake based on the image data transmitted from the first camera unit. The user is not awakened by the awakening state determination step, the running state determination step of determining whether or not the vehicle is in the traveling state based on the image data transmitted from the second camera unit, and the awakening state determination step. When it is determined that the vehicle is in a traveling state by the traveling state determination step, the configuration includes a control step of controlling the notification unit so as to perform a predetermined notification.

In the program according to the present invention, in order to solve the above-mentioned problems, whether or not the user included in the image data is awakened based on the image data transmitted from the first camera unit to the computer. The user is awakened by the awakening state determination step of determining the awakening state, the running state determination step of determining whether or not the vehicle is in the traveling state based on the image data transmitted from the second camera unit, and the awakening state determination step. When it is determined that the vehicle is not in the traveling state and the traveling state is determined to be in the traveling state, the control step of controlling the notification unit to perform a predetermined notification is executed.

According to the present invention, safe driving can be achieved.

It is a block diagram which shows the structure of an electronic device. It is a figure which shows the appearance of an electronic device.

In the present embodiment, the electronic device 1 will be described as, for example, a smartphone, but the present invention is not limited to this. Further, in the present embodiment, the electronic device 1 exerts a function of providing directions by an installed navigation application, but is not limited to this, and various functions (telephone communication) are exhibited by various installed applications. Function, map display function, etc.)

The electronic device 1 starts a navigation application in response to a predetermined operation by the user, and starts route guidance to the destination based on the set destination information or the like. Further, the electronic device 1 has a function of calling attention (hereinafter, referred to as an alarm function) according to the awakening state of the user.

The user attaches the electronic device 1 to a position (for example, on the dashboard) where the map information displayed on the display 18 can be easily seen when he / she gets in the car. The user drives to the destination while referring to the map information and the like displayed on the display 18.

Here, the electronic device 1 according to the present embodiment has a configuration for detecting the carelessness of the user and aiming for safe operation without disturbing the user and without complicating the setting. The configuration and operation of the electronic device 1 will be described in detail below.

As shown in FIG. 1, the electronic device 1 includes a first camera unit 11, a second camera unit 12, a determination unit 13, a traveling state determination unit 14, a notification unit 15, and a control unit 16.

The first camera unit 11 and the second camera unit 12 start shooting when the alarm function is turned on in response to a user operation.
The first camera unit 11 is, for example, an in-camera, and is arranged on one side of the electronic device 1 as shown in FIG. 2A. As shown in FIG. 2B, the second camera unit 12 is arranged on the other side of the electronic device 1. The one side of the electronic device 1 is the side on which the display 18 and various operation buttons 19 are arranged, and means the front side on which the user operates. The one side of the electronic device 1 is the side on which the battery or the like is mounted, and means the back side.

Further, as described above, the electronic device 1 is installed in the vehicle so that the display 18 faces the user side. Therefore, the image data taken by the first camera unit 11 arranged on the same surface as the display 18 includes the face of the driver (user).
Further, the image data taken by the second camera unit 12 arranged on the back surface side of the display 18 includes a landscape in the traveling direction of the vehicle.
The first camera unit 11 transmits the captured image data to the determination unit 13.
The second camera unit 12 transmits the captured image data to the traveling state determination unit 14.

The determination unit 13 determines whether or not the user included in the image data is awake based on the image data transmitted from the first camera unit 11. The determination unit 13 analyzes the image data, and the driver's characteristic operation for knowing the drowsy driving, such as the movement of the user's face or eyes, or whether the eyes are open or closed. It may be configured to capture and determine whether or not the user is awake based on the duration of this characteristic operation.

Based on the image data transmitted from the traveling state determination unit 14 and the second camera unit 12, it is determined whether or not the vehicle is in the traveling state. The traveling state determination unit 14 may be configured to analyze the image data, compare the image data of several frames, and determine that the traveling state is in the traveling state when there is a change, or the traveling state determination unit 14 may be included in the image data of several frames. It may be configured to determine that the vehicle is in a traveling state based on a change in an object indicating a road (for example, a center line, a traffic light, etc.).

The notification unit 15 is composed of a speaker, a vibrator, a light emitting element, and the like, and has a function of notifying the outside.
When the determination unit 13 determines that the user is not awake and the traveling state determination unit 14 determines that the user is in the traveling state, the control unit 16 controls the notification unit 15 so as to perform a predetermined notification. .. The predetermined notification is an alarm output, an audio data output or / or a vibrator output, or the like. The voice data is, for example, data having the content such as "It is dangerous. Please get up."

With this configuration, the electronic device 1 gives a predetermined notification when the user is riding in a car and is not awake (sleeping state), so that safe driving can be achieved. Can be done.
Further, since the electronic device 1 recognizes the face of the driver (user) based on the image data taken by the first camera unit 11, it can be determined that the electronic device 1 is looking away without looking straight ahead. can. The electronic device 1 may be configured to give a predetermined notification when it is determined that the electronic device 1 is looking away.

As shown in FIG. 1, the electronic device 1 may further include an acceleration sensor 17.
In the case of such a configuration, the traveling state determination unit 14 determines whether or not the vehicle is in the traveling state by taking into consideration the acceleration value acquired by the acceleration sensor 17.

For example, when the car is in a traffic jam, even if the image data taken by the second camera unit 12 is analyzed, there is little change and there is a possibility that it is erroneously determined that the vehicle is not in a running state.
Therefore, the electronic device 1 can correctly determine the traveling state by adding the acceleration value acquired by the acceleration sensor 17.

The running state determination unit 14 stores the pattern of the acceleration value indicating the running state in advance in a storage unit (not shown), and compares the pattern of the acceleration value acquired by the acceleration sensor 17 with the running state. It may be configured to determine whether or not.

Further, when the navigation application is activated and the alarm function is ON, the determination unit 13 makes the user's face included in the image data captured by the first camera unit 11 the optimum size. It may be configured to be adjusted. The adjustment may be a digital zoom or an optical zoom. When adjusting by the optical zoom, the determination unit 13 drives the lens of the first camera unit 11 to change the focal length. The lens of the first camera unit 11 may be driven by the control unit 16 instead of the determination unit 13.

According to such a configuration, since the electronic device 1 adjusts the user's face to the optimum size, it can be reliably determined whether or not the user is not awake (sleeping state), and safe driving can be achieved. ..

Further, the determination unit 13 may be configured to determine whether or not the image data includes the user's face. When the determination unit 13 determines that the image data does not include the user's face, the control unit 16 controls the notification unit 15 so as to perform a predetermined notification. The predetermined notification is different from the notification output in the non-awakening state, and is an alarm output, an audio data output and / or a vibrator output, and the like. The audio data is, for example, data having contents such as "Please adjust the position so that your face can be seen on the camera."

According to such a configuration, the electronic device 1 urges the user to adjust the orientation of the first camera unit 11 by a predetermined notification, so that it is possible to reliably determine whether or not the user is not awake (sleeping state). It can be judged and safe driving can be achieved.

Further, the determination unit 13 may be configured to determine whether or not it is in a preliminary state of falling asleep due to yawning or the like. When the determination unit 13 determines that the user is in a preliminary state of falling asleep and the running state determination unit 14 determines that the user is in a running state, the control unit 16 is notified so as to perform a predetermined notification. 15 is controlled. The predetermined notification may be the same as or different from the notification output in the unawakened state, such as alarm output, voice data output and / or vibrator output. The audio data is, for example, data having contents such as "It is dangerous. Please get up." Or "Why don't you take a rest?"
According to such a configuration, the electronic device 1 gives a predetermined notification in a preliminary state of not awakening (sleeping state), so that safer driving can be achieved.

Further, when the control unit 16 detects an unawakened state (sleeping state) or a preliminary state thereof, the control unit 16 uses a communication function to use a preset contact information (telephone number or e-mail). It may be configured to contact the address, etc.). The control unit 16 may be executed after confirmation by the user (for example, tapping the display, etc.) or automatically when contacting a preset contact.
According to such a configuration, the electronic device 1 contacts a preset contact in a preliminary state of not awakening (sleeping state). Therefore, for example, a call back from the contact is made. By receiving it, it is possible to get out of the dozing state and its preliminary state, and to drive safely.

Further, when the control unit 16 detects an unawakened state (sleeping state) or a preliminary state thereof, the control unit 16 obtains the current location from GPS information, and finds the current location, the nearest parking area, a rest spot, or the like). It may be configured to search for and guide to the predetermined place. The predetermined location may be preferentially searched for a location that the user is likely to like, based on the past behavior history of the user stored in the electronic device 1.
According to such a configuration, the electronic device 1 guides the user to the nearest parking area or the like in a preliminary state of not being awake (sleeping state). Therefore, by following the guidance, sufficient rest is provided. It is possible to take a safe driving.

Further, in this embodiment, the configuration and operation of the electronic device for safe driving have been mainly described, but the present invention is not limited to this, and each component is provided, and the method and program for safe driving are configured. You may.

Further, a program for realizing the function of the electronic device may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read by the computer system and executed.

The term "computer system" as used herein includes hardware such as an OS and peripheral devices. Further, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, or a storage device such as a hard disk built in a computer system.

Furthermore, a "computer-readable recording medium" is a communication line that transmits a program via a network such as the Internet or a communication line such as a telephone line, and dynamically holds the program for a short period of time. It may also include a program that holds a program for a certain period of time, such as a volatile memory inside a computer system that serves as a server or a client in that case. Further, the above-mentioned program may be a program for realizing a part of the above-mentioned functions, and may be a program for realizing the above-mentioned functions in combination with a program already recorded in the computer system. ..

1 Electronic device 11 1st camera unit 12 2nd camera unit 13 Judgment unit 14 Running state judgment unit 15 Notification unit 16 Control unit 17 Accelerometer

Claims (9)

1st camera part and
2nd camera part and
Based on the image data transmitted from the first camera unit, a determination unit that determines whether or not the user included in the image data is awake, and a determination unit.
Based on the image data transmitted from the second camera unit, the traveling state determination unit that determines whether or not the vehicle is in the traveling state, and the traveling state determination unit.
Notification unit and
When the determination unit determines that the user is not awake and the traveling state determination unit determines that the user is in a traveling state, the determination unit includes a control unit that controls the notification unit so as to perform a predetermined notification. Electronics. Equipped with an accelerometer
The electronic device according to claim 1, wherein the running state determination unit determines whether or not the running state is in consideration of the acceleration value acquired by the acceleration sensor. The determination unit determines whether or not the size of the user's face included in the image data is suitable for determining whether or not the user is awake, and when it is determined that the size is not suitable for the user, the user. The electronic device according to claim 1, wherein the size of the face is adjusted to an appropriate size. The determination unit determines whether or not the image data includes the user's face, and determines whether or not the image data includes the user's face.
The electronic device according to claim 1, wherein the control unit controls the notification unit so as to perform a predetermined notification when the determination unit determines that the image data does not include the user's face. The determination unit determines whether or not the user is in a preliminary state in which the user is not awake.
The electronic device according to claim 1, wherein the control unit controls the notification unit so as to perform a predetermined notification when the determination unit determines that the user is in the preliminary state. The control unit according to claim 1 or 5, wherein when the determination unit determines that the user is not awake or the user is in the preliminary state, the control unit contacts a preset contact. Electronics. The control unit searches for a predetermined place and guides the user to the predetermined place when the determination unit determines that the user is not awake or the user is in the preliminary state. The electronic device according to 5. A wakefulness determination step of determining whether or not the user included in the image data is awake based on the image data transmitted from the first camera unit.
Based on the image data transmitted from the second camera unit, a running state determination process for determining whether or not the vehicle is in a running state, and a running state determination process.
When it is determined by the awakening state determination step that the user is not awake and the running state determination step determines that the user is in the traveling state, a control step of controlling the notification unit to perform a predetermined notification is provided. Control method to prepare. On the computer
A wakefulness determination step of determining whether or not the user included in the image data is awake based on the image data transmitted from the first camera unit.
Based on the image data transmitted from the second camera unit, a running state determination process for determining whether or not the vehicle is in a running state, and a running state determination process.
When it is determined by the awakening state determination step that the user is not awake and the running state determination step determines that the user is in the running state, a control step of controlling the notification unit to perform a predetermined notification is provided. A program to run.

Images