CN105882521A - Control device and control method for activating corresponding zone of vehicle-mounted display screen according to watched zone of driver - Google Patents

Abstract

The invention relates to the field of automobile control, in particular to a control device and control method for activating a corresponding zone of a vehicle-mounted display screen according to a watched zone of a driver. The control device comprises an eye tracker, an analysis system, a control system and the vehicle-mounted display screen, wherein the eye tracker is used for capturing eye tracking information data of the driver and transmitting the data to the analysis system, the analysis system receives the data, then analyzes the zone, watched by the driver, of the vehicle-mounted display screen and transmits the information to the control system, the control system sends an instruction to the module of the vehicle-mounted display screen so as to activate the watched zone. The invention further provides a vehicle including the control device. By the adoption of the control device and the control method, the driving safety can be improved.

Description

Control device and control method for activating the corresponding area of the display screen in the vehicle according to the driver's gaze area

technical field

The invention relates to the field of automobile control, in particular to a control device and a control method for activating a corresponding area of an in-vehicle display screen according to a driver's gaze area, and a vehicle including the control device.

Background technique

Some mid-to-high-end cars are equipped with a steering wheel with a central control function, also known as a central control steering wheel. As shown in Figure 1, there are some operating buttons or operating knobs on the left and right sides of this type of steering wheel, such as multimedia control. Buttons or knobs, Bluetooth control buttons or knobs, cruise control buttons or knobs, etc. The operation methods of the central control steering wheel include button type, knob type, wheel type and dial type.

With the development of touch screen technology, some high-end cars are equipped with touch screens on the left and right sides of the central control steering wheel to replace the original operation buttons or operation knobs on the left and right sides of the steering wheel, as shown in Figure 2. The driver can control the in-car multimedia, Bluetooth or cruise functions by clicking different areas of the touch screen. Usually, the touch screen on the left side of the central control steering wheel is called instrument cluster 1 (Instrument Cluster, IC for short), and the touch screen on the right side of the central control steering wheel is called central control screen 2 (Head Unit, HU for short). When the driver wants to operate the instrument panel 1 or the central control screen 2, he must move away from the current gaze point and operate on the touch screen through some gestures (such as sliding, pressing or tapping the touch screen) to activate the instrument panel 1 Or on the central control screen 2, in this case, the driver's attention is more distracted, and there are hidden dangers to driving safety.

The invention patent application with the publication number CN101236702A discloses a driver's gaze object recognition system based on virtual reality, which includes an eye tracker and a car driving simulation system. The invention can track the driver's gaze point during driving in a virtual reality environment, and recognize the type of gaze object, such as a vehicle, sign, sign or billboard.

The invention patent application with the publication number US2013/0145304A1 discloses a tool for confirming the user's input intention by catching eyeballs, which uses eyeball catching technology to detect the user's potential, unconscious input.

Contents of the invention

The purpose of the present invention is to provide a control device and a control method for activating the corresponding area of the display screen in the vehicle according to the driver's gaze area, thereby improving driving safety.

In view of this, the present invention provides a control device for activating the corresponding area of the display screen in the car according to the driver's gaze area, the control device includes an eye tracker, an analysis system, a control system and a display screen in the car, Wherein the eye tracker is used to capture the driver's eye movement information data, and transmit these data to the analysis system; after the analysis system receives the above data, it analyzes which of the display screen in the car the driver is looking at. area, and the result of the analysis is transmitted to the control system; the control system sends an instruction to the module controlling the in-vehicle display to activate the gaze area.

Preferably, the eye tracker can also be a pair of smart glasses with an eye movement capture device.

According to an embodiment of the present invention, the eye tracker can be installed on the frame around the instrument panel on the steering wheel and on the frame around the central control screen on the steering wheel.

According to yet another embodiment of the present invention, the eye movement information data output by the eye tracker is transmitted to the analysis system in real time through wireless communication or Bluetooth.

The present invention also provides a vehicle, which includes the above-mentioned control device for activating the corresponding area of the display screen in the vehicle according to the gaze area of the driver.

The present invention also provides a control method for activating the corresponding area of the display screen in the vehicle according to the driver's gaze area. The control method includes: providing an eye tracker for capturing the driver's eye movement information data; providing an analysis system , transmit the collected eye movement information data to the analysis system to analyze which area of the display screen the driver is looking at in the car; provide a control system to receive the above analysis results, and provide information to control the vehicle The module of the inner display sends commands to activate the gaze area.

According to an embodiment of the present invention, the eye movement information data is transmitted to the analysis system in real time through wireless communication or Bluetooth.

According to yet another embodiment of the present invention, the method includes further, after activating the gaze area, manually touching or sliding a submodule area of the gaze area.

It can be seen from the above scheme that since the present invention provides a control device and a control method for activating the corresponding area of the display screen in the car according to the driver's gaze area, the driver no longer needs to use his hands to activate the instrument panel 1 of the central control steering wheel. Or the central control screen 2, which improves driving safety.

Description of drawings

Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings, so that those skilled in the art will be more aware of the above-mentioned and other features and advantages of the present invention. In the accompanying drawings:

Fig. 1 is a schematic diagram of a central control steering wheel equipped in some mid-to-high-end cars.

Fig. 2 is a schematic diagram of a central control steering wheel equipped with a touch screen.

Figure 3 is a schematic diagram of TOBII's smart glasses (New Tobbi Glasses2).

Fig. 4 is a schematic diagram of a participant's correction process in a common eye movement experiment.

Fig. 5 is a schematic diagram of the process of activating the in-vehicle display screen and its sub-function modules according to the driver's gaze area according to the present invention.

reference sign

1 - Dashboard;

2- Central control screen;

A, B, C, D - functional modules of instrument panel or central control panel;

A ₁ , A ₂ ...An-each sub-function module of function module A;

B ₁ , B ₂ . . . Bn-each sub-function module of the function module B.

detailed description

In order to make the purpose, technical solution and advantages of the present invention clearer, the following examples are given to further describe the present invention in detail.

The invention provides a control device for activating the corresponding area of a display screen in a car according to the gaze area of a driver, and the control device includes an eye tracker, an analysis system, a control system and a display screen in a car.

The eye tracker is used to capture the driver's eye movement information data and transmit these data to the analysis system. The eye tracker of the present invention can be a conventional eye tracker, and can be installed on the frame around the instrument panel 1 and the frame around the central control screen 2 on the steering wheel as shown in FIG. 2 . The eye tracker of the present invention can also be smart glasses with built-in eye movement capture equipment, such as TOBII smart glasses (New Tobbi Glasses2, as shown in Figure 3) or ERGONEERS Dikablis Glasses, but the smart glasses with built-in eye movement capture equipment The data accuracy of the glasses should be higher.

In addition, it is necessary to make some adjustments for different users, but this is mainly in terms of software, as shown in Figure 4, which is a schematic diagram of the process of calibrating participants in a common eye movement experiment. Theoretically speaking, each user only needs to calibrate once when using the eye tracker on the car for the first time, and then the eye tracker can continuously learn and adapt to the user's eye movement characteristics. Of course, with the development of technology, the extraction of eye movement trajectories with angles will become more and more mature, and the slight head swing caused by the change of the driver's sitting posture is acceptable.

The principle of the eye tracker is to extract the center coordinates, focal length, fixation time, fixation order, etc. of the human eye pupil through the camera. Since the amount of eye movement data is not small, it is not suitable for transmission through CAN. Here we use WiFi and Bluetooth to Data is transmitted in real time.

The analysis system of the present invention can be provided by the supplier who provides the eye tracker. If New Tobbi Glasses2 is used as the eye tracker, then TOBBI will provide the eye tracker data analysis system. Because different types of eye trackers use different data models and software systems to analyze eye movement information data, so as to determine which functional module the driver is looking at. At present, there is no public software platform that can accurately analyze the eye movement information data collected by most or even all eye trackers. After receiving the above-mentioned eye movement information data, the analysis system analyzes whether the driver is looking at the instrument panel 1 or the central control panel 2, and transmits the analysis result to the control system.

The control system can be integrated in the vehicle system or connected with the vehicle system, and after receiving the above analysis result, send an instruction to the module controlling the display screen in the vehicle to activate the gaze area.

The following takes FIG. 5 as an example to specifically describe the control device and control method for activating the corresponding area of the display screen in the vehicle according to the driver's gaze area according to the present invention.

Fig. 5 is a schematic diagram of the process of activating the in-vehicle display screen and its sub-function modules according to the driver's gaze area according to the present invention. For example, when the driver looks at the area A of the instrument panel IC, the eye tracker installed on the frame around the IC collects the driver's eye movement information data, such as the center coordinates of the pupil, focal length, gaze time, gaze order, etc., eye movement The instrument transmits these eye movement information data to the analysis system through bluetooth or wireless communication (wifi). The analysis system analyzes that the driver is looking at area A, and transmits the result to the control system integrated in the vehicle system. The functional modules in the area A of the instrument panel IC send instructions to activate the gaze area A, and then the driver only needs to touch or slide the sub-function modules A ₁ , A ₂ ...An in the area A with his hand. When the driver looks at the area B of the central control screen, the eye tracker installed on the frame around the HU collects the driver's eye movement information data, and transmits the eye movement information data to the analysis system through Bluetooth or wifi, and the analysis system It is analyzed that the driver is looking at area B, and the result is sent to the control system integrated in the vehicle system. The control system sends an instruction to the functional module of area B in the control panel HU to activate the area B, and then the driver It is only necessary to touch or slide the sub-function modules B ₁ , B ₂ . . . Bn in the area B with hands.

The in-vehicle display shown in FIG. 5 is an instrument panel or a central control panel on the steering wheel. The in-vehicle display referred to in the present invention may also be other in-vehicle display screens, such as the display screen of an in-vehicle system.

In short, if the driver wants to change the selection of some functional areas in the car, he must first glance at this area. When the control device of the present invention detects that the driver's eyes are watching a certain module area, the area will It is automatically activated without the driver's manual operation, thereby reducing the driver's distraction and improving driving safety.

The present invention also provides a vehicle, which includes the above-mentioned control device for activating the corresponding area of the display screen in the vehicle according to the gaze area of the driver.

The present invention also provides a control method for activating the corresponding area of the display screen in the vehicle according to the driver's gaze area. The control method includes:

providing an eye tracker for capturing eye movement information data of the driver;

An analysis system is provided, and the collected eye movement information data is transmitted to the analysis system to analyze which area of the display screen the driver is looking at; wherein the eye movement information is transmitted through wireless communication or bluetooth Data is transmitted to the analysis system in real time.

A control system is provided to receive the above analysis results and send instructions to the module controlling the in-vehicle display screen to activate the gaze area.

The method includes further, after activating the gaze area, manually touching or sliding a submodule area of the gaze area.

The invention relates to the field of automobile control, in particular to a control device and a control method for activating a corresponding area of an in-vehicle display screen according to a driver's gaze area. The control device includes an eye tracker, an analysis system, a control system and an in-vehicle display screen, wherein the eye tracker is used to capture the driver's eye movement information data and transmit these data to the analysis system After the analysis system receives the above-mentioned data, it analyzes which area the driver is watching the display screen in the car, and sends this information to the control system; the control system sends the module to control the display screen in the car Send a command to activate the fixation area. The present invention also provides a vehicle including the above control device. By adopting the control device and the control method of the present invention, driving safety can be improved.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included in the scope of the present invention. within the scope of protection.

Claims (8)

1. one kind is activated the control device of display screen corresponding region in car according to driver's watching area, it is characterised in that Described control device includes an eye tracker, an analysis system, display screen in a control system and a car, wherein

Described eye tracker moves information data for the eye catching driver, and these data send to described analysis system；

Described analysis system receives after above-mentioned data, analyzes driver and watches which region of display screen in described car attentively, and Send this analysis result to described control system；

Described control system module of display screen in controlling described car sends instruction, to activate this watching area.

Device the most according to claim 1, it is characterised in that described eye tracker can also is that one catches with eye is dynamic The intelligent glasses of equipment.

Device the most according to claim 1, it is characterised in that described eye tracker may be mounted at and is positioned on steering wheel Instrumental panel (1) surrounding frame on and be positioned on steering wheel middle control screen (2) surrounding frame on.

Device the most according to claim 1, it is characterised in that the eye of described eye tracker output moves information data to be passed through Radio communication or bluetooth carry out real-time Transmission to described analysis system.

5. a vehicle, it is characterised in that described vehicle includes the root as described in claim any in claim 1-4 The control device of display screen corresponding region in car is activated according to driver's watching area.

6. one kind is activated the control method of display screen corresponding region in car according to driver's watching area, it is characterised in that described Control method includes:

One eye tracker moving information data for catching the eye of driver is provided；

One analysis system is provided, the described eye collected is moved information data and sends described analysis system to, to analyze driver Watch which region of display screen in described car attentively；

There is provided a control system to receive above-mentioned analysis result, and send instruction to controlling the module of display screen in described car, to swash Watching area that it serves somebody right.

Method the most according to claim 6, it is characterised in that described eye is moved Information Number by radio communication or bluetooth Described analysis system it is transferred to time factually.

Method the most according to claim 6, it is characterised in that described method includes further,

After activating this watching area, the submodule region of manual touch-control or this watching area of sliding.