DE102022102504B9 - Method for operating an interface device in a vehicle, and interface device and vehicle - Google Patents

Abstract

Method for operating an interface device (3) in a vehicle (1), wherein - an operating action (10) by a vehicle occupant (2, 7, 8, 9) on the interface device is detected by means of a first sensor device (11), having: - detecting at least one item of status information relating to the vehicle occupant (2, 7, 8, 9) who performs the operating action (10), with a second sensor device (12) that is different from the first sensor device (11), - determining a type and /or a scope of a function (13) of the interface device (3) depending on the detected operating action (10) of the vehicle occupant (2, 7, 8, 9) and the detected at least one item of status information from the vehicle occupant (2, 7, 8, 9), and providing the specific function (13) of the interface device (3) for use by the vehicle occupant (2, 7, 8, 9) in the specific type and/or the specific scope. characterized in that- the operator action of the vehicle occupant (2, 7, 8, 9) is performed on a display unit (19) of the interface device (3), with the vehicle occupant (2, 7, 8, 9) touching the display unit (19) being recognized as an operator action (10) by the first sensor device (11), and- a modulated identification signal (24) is generated with a signal generation unit (21, 22, 23), the generated identification signal (24) when the vehicle occupant (2, 7, 8, 9) touches the display unit (19) from a steering wheel (16) of the vehicle (1) gripped by the vehicle occupant (2, 7, 8, 9) is transmitted via the vehicle occupant (2, 7, 8, 9) to the display unit (19) in order to determine the type and/or scope of the function (13) of the interface device (3).

Description

The invention relates to a method for operating an interface device in a vehicle, wherein an operator action by a vehicle occupant on the interface device is detected by means of a first sensor device.

Furthermore, the invention relates to an interface device for a vehicle with a first sensor device for detecting an operator action by a vehicle occupant on the interface device.

The invention also relates to a vehicle with an interface device.

Vehicles, in particular highly automated vehicles, have an infotainment system in the passenger compartment. Such an infotainment system can have a “center information display (CID)”, for example. Vehicle occupants, such as the vehicle driver and other passengers, can interact with the infotainment system with this "center information display". Thus, the "Center Information Display" can serve as the main means of interaction for the infotainment system. In particular, this can be shared or used jointly by the driver and front passenger in current cockpit architectures.

A disadvantage of such infotainment systems is the risk of driver distraction or driver inattention. This is to be avoided. For this purpose, offers of infotainment content, such as apps, are already restricted while driving. For example, moving images, such as a video, may be blocked while driving and thus not made available to occupants. Furthermore, screens or images with long texts and complex information can also be blocked for occupants. Complex actions, such as entering a destination with the keyboard, can also be blocked while driving.

Furthermore, while driving, the theoretically optimized content for the driving task can be dynamically hidden and blocked for a few seconds as an educational measure in certain situations.

If, for example, it is determined, for example via a touch controller, that the driver uses the center information display too often or for too long, appropriate action can be taken. This can also be done if it is determined, for example via a vehicle monitoring camera, that the user is looking at the center information display for too long. If it is again determined, for example also via the driving surveillance camera, that the driver has not looked at the road for longer than three seconds, for example, the driver is warned. Capacitive sensors can be used to determine that the driver has not had his hands on the steering wheel for too long. This can also lead to a warning. If the driver has a so-called microsleep, a warning can also be issued. The system can determine that the current driving situation is cognitively demanding and thus some warnings or dialogues with the user can be delayed until a better time.

These previous measures are extremely restrictive and also restrict the content offered to the front passenger, especially if the driver and front passenger only have one display to operate the content.

For example, from the DE 10 2009 018 681 A1 a control device for a motor vehicle with a control panel that is arranged within reach of the driver and front passenger is known. In this case, the driver's operating options are only available if the driver's access to the control panel is clear.

Furthermore, from the DE 10 2016 001 314 A1 a control device for a motor vehicle is known. This has a touch-sensitive display device. The aim is to ensure that a driver does not use the on-screen keyboard while driving. A distinction can be made between touching the display device on the driver's side and on the passenger's side.

Furthermore, the DE 103 40 249 A1 a method and an arrangement for operating devices in a motor vehicle, in which an input by means of a control element that can be reached by people in different places in the motor vehicle leads to the display of menus that are dependent on the person operating the at least one control element. Sensors are used to automatically identify the respective person.

From the DE 103 37 852 A1 a vehicle system for operation in a motor vehicle with an operating device for operating the vehicle system is known. It can be recognized whether operator access to the control device by the The driver or another occupant of the vehicle takes place.

Furthermore, the DE 103 37 852 A1 a vehicle system for operation in a motor vehicle with an operating device for operating the vehicle system. Operation of the vehicle system can be influenced with a controller.

One object of the present invention is to be able to provide a vehicle occupant who is interacting with an infotainment system in a vehicle with an individualized and situation-specific information offer.

This object is solved by a method, an interface device and a vehicle according to the independent patent claims. Useful further developments result from the dependent patent claims.

• - eine Bedienhandlung eines Fahrzeuginsassen an der Schnittstellenvorrichtung mittels einer ersten Sensoreinrichtung erkannt wird, aufweisend:
• - Erfassen zumindest einer Zustandsinformation betreffend den Fahrzeuginsassen, welcher die Bedienhandlung ausübt, mit einer zur ersten Sensoreinrichtung verschiedenen zweiten Sensoreinrichtung,
• - Bestimmen einer Art und/oder eines Umfangs einer Funktion der Schnittstellenvorrichtung in Abhängigkeit von der erkannten Bedienhandlung des Fahrzeuginsassen und der erfassten zumindest einen Zustandsinformation des Fahrzeuginsassen, und
• - Bereitstellen der bestimmten Funktion der Schnittstellenvorrichtung zur Nutzung für den Fahrzeuginsassen in der bestimmten Art und/oder dem bestimmten Umfang.

One aspect of the invention relates to a method for operating an interface device in a vehicle, wherein

• - an operator action by a vehicle occupant on the interface device is detected by means of a first sensor device, comprising:
• - detecting at least one item of status information relating to the vehicle occupant who performs the operator control action with a second sensor device that is different from the first sensor device,
• - determining a type and/or scope of a function of the interface device as a function of the detected operator action by the vehicle occupant and the recorded at least one item of status information from the vehicle occupant, and
• - Providing the specific function of the interface device for use by the vehicle occupant in the specific type and/or to the specific extent.

The proposed method can be used to make an individually adapted function and/or an individually adapted information content available to the vehicle occupant who carries out an operating action on the interface device. Thus, depending on which vehicle occupant would like to operate or use the interface device, an adapted use can be provided or made possible.

In particular, when determining the type and/or scope of the function of the interface device, attention is paid to whether the vehicle occupant who performs or desires the operator action is a vehicle driver or driver or a passenger or other passenger in the vehicle. As a result, on the one hand it can be ensured that the driver of the vehicle in particular is not distracted by information overload and/or by extensive functionality of the interface device. Likewise, the passenger of the vehicle, who does not have to perform any driving tasks, can be provided with more information content and/or a larger functional scope of the interface device.

With the help of the proposed method, the safety when using the interface device by the driver of the vehicle can be increased on the one hand, since care is taken that the driver of the vehicle is not distracted too much. Otherwise, the passenger in particular can be provided with attractive content and/or functions of the interface device.

For this purpose, on the one hand, the operating action of the vehicle occupant on the interface device is recognized or detected or recorded by means of the first sensor device and at least one piece of status information of the vehicle occupant is additionally recorded by means of a second sensor device. As a result, different, in particular independent, pieces of information can be taken into account when determining the type and/or scope of the function of the interface device. As a result, the robustness or the efficiency of the determination of the type and/or scope of the function can be increased or improved. The function of the interface device can thus be individually adapted to the respective vehicle occupants. This is done by determining the respective type and/or the respective extent of the function of the interface device. As a result, an individualized function can be made available to the respective vehicle occupant who wants to use the interface device.

For example, the interface device can be controlled by an operator action by a vehicle occupant of the vehicle on the interface device.

For example, the interface device can be referred to as an operating device. In particular, the interface device is an infotainment system of the vehicle.

For example, the interface device can be arranged in a cockpit area of the vehicle. For example, the interface device can be used to interact with the vehicle occupants. For this purpose, the interface device can have a display unit and/or an output unit with which acoustic, optical and/or haptic information content and/or interactions can be output or made available to the vehicle occupants.

For example, the vehicle occupants can control the interface device by means of a respective operating action on the interface device.

The vehicle occupants can in particular be passengers and/or occupants of the vehicle. The vehicle can be a passenger car, for example, which has a passenger cell.

For example, the first sensor device can be at least one proximity sensor and/or at least one camera and/or a driver observation camera and/or an interior radar and/or an interior camera and/or a 3D camera and/or a Trade ToF camera. In particular, the first sensor device can have a plurality of partial sensors. For this purpose, the first sensor device can in particular detect a passenger compartment or the passenger cell of the vehicle by sensors.

With the aid of the first sensor device, either an imminent operator action by the vehicle occupant can be detected. Consequently, an approach of the vehicle occupant to the interface device is detected. Likewise, the first sensor device can be used to detect an actual control action currently being performed by the vehicle occupant. For example, using the first sensor device, an operator action can already be recognized in advance by recognizing that the vehicle occupant is approaching the interface device. Likewise, an operating action that has actually been carried out or exercised by the vehicle occupant can already be recorded.

In particular, an operator action by a vehicle occupant can be recognized by a finger movement, pointing movement, arm movement. It is also conceivable for the operator action to be performed or exercised by the vehicle occupant by means of an operator control element. For example, an operating element can be an operating pen and/or an operating rod.

For example, the second sensor device can be a number of sensors or sub-units. In particular, the second sensor device is, for example, a driver observation camera or capacitive sensors. In particular, a respective state and/or several states of the vehicle occupant can be detected or determined using the second sensor device.

For example, the type and/or scope of the function can be determined with an electronic evaluation unit of the interface device. The type of function can be, for example, a driver mode or a non-driver mode. For example, the type can be used to distinguish between a driver-side function or a passenger-side function of the interface device. With the scope or the measure of the function, for example, information content or a period of time and/or a functional scope of the function can be provided. In particular, it can be determined, for example, whether the vehicle occupant is allowed to use only read access or write access and/or read and write access with regard to the function of the interface device.

In particular, with the aid of the type and/or scope of an interface device designed as an infotainment system, it can be determined which infotainment content or infotainment applications are offered or released to the vehicle occupant for use.

For example, the interface device can have a release unit with which the provided function is released for use by the vehicle occupant. Likewise, in certain driving situations and/or situations that occur, the scope and/or the type can be blocked or restricted again accordingly.

In particular, the proposed method is a computer-implemented method.

In one exemplary embodiment of the invention, it is provided that a determination is made as to whether the vehicle occupant is a vehicle driver of the vehicle or an occupant of the vehicle who is different from the vehicle driver delt, and this determination is taken into account when determining the type and/or extent of the function of the interface device. In particular, this determination is made by means of an electronic evaluation unit or the computing unit of the interface device. The information that was recorded or determined by the first sensor device and the second sensor device can be used for the determination. An improved and, in particular, more robust differentiation between the vehicle occupants can thus be made through the most diverse information from the various sensor devices. In particular, a distinction can be made here between the driver of the vehicle and the passenger of the vehicle. Depending on whether the vehicle occupant is the driver or the passenger, the type and/or scope of the function is adjusted. Consequently, it can be determined or checked whether the operator action is being performed by the driver or vehicle operator or by the passenger. For example, it can be clearly identified in this way whether the operator action or operator control or operator intention was performed by a driver or a passenger. This determination allows the interface device to be controlled and, in particular, operated individually. By determining whether it is the driver of the vehicle or an occupant who is different from him, the function and/or the contents of the interface device can be made available or offered in a targeted manner for use by the vehicle occupant.

In particular, the differentiation between the vehicle driver and a different occupant is of importance if, for example, the vehicle is an at least partially autonomously operated vehicle.

For example, the vehicle can be a vehicle with an autonomy level of 2, 3 or 4. In particular, with an autonomy level 3, care must be taken to ensure that, due to the need for distraction and/or attention, the function offered to the vehicle driver is not the same as the content or the range of functions or the type of function offered to the passenger. Thus, a distinction or lesson of the type of function and/or the scope of functions can be made.

In a further exemplary embodiment, it is provided that a number of vehicle occupants and/or a respective position of one of the vehicle occupants within the vehicle is detected using a third sensor device that is different from the first and second sensor device, with this being done when determining whether the vehicle occupant is the driver of the vehicle or an occupant other than the driver is taken into account. The detected number of vehicle occupants and/or the respective position of the vehicle occupants can be used to determine more efficiently, in particular more precisely, whether the vehicle occupant is the vehicle driver or the passenger, for example. It can thereby be achieved that the type of function and/or the range of functions can be adapted individually, in particular specifically, to the vehicle occupant.

For example, the third sensor device can have a plurality of sensors, which are optionally distributed in the passenger compartment of the vehicle. For example, the third sensor device can be sensors in the vehicle seats or vehicle benches of the vehicle. It is also conceivable for the third sensor device to be seat occupancy sensors or seat occupancy mats. For example, the third sensor device can be designed as a capacitive sensor system. Furthermore, the third sensor device can be seat belt buckle sensors. Consequently, the third sensor device can be used to determine or check which vehicle seats or vehicle seats are occupied and which are not. Thus, the respective positions and in particular the number can be determined. This is particularly advantageous because seat occupancy detection can be used to determine whether the vehicle occupant is the driver or the front passenger.

It is particularly advantageous if several different sensor systems or sensor methods are used to determine whether the vehicle occupant is the driver or the passenger. For example, the first, second and third sensor devices can be used together in order to be able to make an efficient or effective determination. In particular, the information from the sensor devices can be merged in order to be able to reliably determine the vehicle occupant and consequently the range of functions and/or the type of function. In particular, in addition to the three sensor devices mentioned, further sensor devices or sensors can be used in the vehicle.

In a further embodiment of the invention it is provided that with the second Sen sensor device a hand movement and/or a finger movement and/or an arm movement and/or a line of sight and/or a state of alertness and/or a posture of the vehicle occupant are detected as the at least one piece of status information. These options, which are mentioned by way of example and which can all be status information, can be used to make a detailed and efficient assessment of the vehicle occupant in order to be able to determine a type of function and/or a range of functions that is adapted to the vehicle occupant. In particular, the examples of status information just mentioned are not intended to be construed as conclusive, but are merely intended to provide a small insight into the possibilities.

For example, the second sensor device can be used to detect the viewing angle and/or viewing direction with which the vehicle occupant directs the interface device before and/or during the operator control action. From this it can be concluded, for example, whether it is the driver or the passenger. If, for example, it is determined that the vehicle occupant is looking outside of the passenger compartment, it can be assumed that he is currently inattentive and therefore only a limited function is available. Furthermore, this information can also be used to inform the vehicle occupants of their current status by means of an acoustic and/or visual and/or haptic warning.

Furthermore, the hand movement and/or the finger movement and/or the arm movement of the vehicle occupant, with which the action or operation is initiated or executed, can be detected which angle the hand and/or the fingers and/or the arm with respect to the interface device having. This can also be an indicator to determine whether the vehicle occupant is the driver and/or the passenger. Furthermore, the vehicle occupant's posture can be analyzed or assessed in order to determine, for example, whether the driver is alert or a passenger who is resting. All of this possible information can be used to determine a functional type and/or functional scope adapted to the respective vehicle occupant and in particular the respective situation.

In a further exemplary embodiment, it is provided that the specific type and/or the specific scope of the function of the interface device and/or the specific function of the interface device and/or the detected operator action by the vehicle occupant and/or the detected at least one item of status information from the vehicle occupant is transmitted to a machine learning unit of the Interface device is provided or transmitted, whereby the interface device is automatically trained by means of the machine learning unit, in particular automatically, to determine the type and / or the scope of a function of the interface device. As a result, the interface device can be operated even better, since the interface device can learn independently using specific situations. A future determination of a type and/or scope of a function can thus be carried out more efficiently and, in particular, better.

In addition, the interface device or the interface system can be gradually machine-trained using machine learning, so that over time the application situations or the operator action situations can be recognized even faster and more reliably. This is particularly advantageous when one or more sensor devices have failed or are only functional to a limited extent. Thus, the type or scope of the function can still be determined by machine learning. In particular, using one of the machine learning units, which uses a machine learning algorithm, the interface device can learn how the driver or the front passenger interacts with the interface device for each interaction or operator action. As a result, the interface device can gradually recognize the intentions of the users or vehicle occupants with regard to the operation of the interface device in a more reliable and reactive manner.

In particular, the learning of the interface device takes place automatically and in particular continuously with the aid of the machine learning unit.

In particular, a wide variety of information and/or input variables can be used for machine learning. For this purpose, the exemplary embodiments already described above and the information and/or input variables contained therein for the machine learning unit can be used. In particular, all information provided and/or generated from this invention can be used for the machine learning of the interface device in this context.

Provision is made for the vehicle occupant's operator action to be performed on a display unit of the interface device, with the vehicle occupant touching the display unit is recognized as an operator action by the first sensor device. For example, the interface device can have a user interface. The interface device can thus have a man-machine interface, so that the vehicle occupants are given the opportunity to carry out a corresponding operating action. For this purpose, the display unit can be designed as a touch-sensitive display, for example. In particular, the display unit is a touch-sensitive screen, so that information or functions displayed thereon can be actuated or selected by the vehicle occupant by means of the operating action. For example, the display unit is a touch display of an infotainment system of the vehicle. The vehicle occupant can therefore touch the display unit with his fingers, arms or hands, for example, in order to be able to carry out or exercise the operator control action. This contact can be detected or recognized, for example, using the first sensor device or a capacitive sensor device of the interface device. By touching the display unit, it can be determined, for example by means of capacitive sensors in the display unit, whether it is the vehicle driver or the passenger.

For example, when the vehicle occupant touches the display unit, a value specific to the touch (for example a pressure value) can be recorded. This can be assigned to the respective operation, for example. A respective impedance and/or capacitance can also be determined when touching, so that this can be assigned to the operator action and then, in a future operator action, a corresponding range of functions and/or a function type can be selected on the basis of these special or characteristic values. For this purpose, typical impedance values and/or typical capacitance values when the display unit is touched can be recorded in a database, for example, and taken into account in future operator actions.

For example, these values can also be used for the machine learning unit.

For example, when the display unit is touched, a deviation from these specific values compared to reference values can be determined or viewed in order to thus already provide a predefined function.

It is provided that a modulated identification signal is generated with a signal generation unit, with the generated identification signal being transmitted to the display unit when the vehicle occupant touches the display unit from a steering wheel of the vehicle gripped by the vehicle occupant, via the vehicle occupant, in order to indicate the type and/or determine the scope of the function of the interface device. In other words, a specially modulated electrical and/or digital signal is transmitted or transmitted via the body of the vehicle occupant to a receiving unit of the display unit, so that this identification signal, which is received in turn, can be used to determine whether it is the vehicle occupant who performed the operator control action whether or not the vehicle driver is concerned. A simple possibility can thus be provided by the signal generation and signal transmission in order to be able to distinguish between the passenger and the driver.

For example, the signal generation unit can be integrated in the interface device or at least partially integrated in the steering wheel. A corresponding signal can thus be generated and transmitted via the vehicle occupant's body to the touched display unit via the steering wheel gripped by the vehicle occupant. If the receiving unit now receives exactly the modulated identification signal that was previously generated, it can be clearly determined whether the vehicle occupant is the vehicle driver. In this way, the functions permitted or usable by the vehicle driver can be made available more quickly in their respective type and/or in their respective scope and issued to the vehicle occupant for use. For example, the steering wheel can have a steering wheel heater, via which the identification signal can be transmitted to the vehicle occupants.

In particular, a special signal, in particular the identification signal, can be modulated in frequency and/or form via the steering wheel and sent out, for example, via elements of a steering wheel heater or a steering wheel hand grip system. The signal can be generated or generated, for example, as an electric current with a low voltage and intensity. The identification signal can be routed via the driver's body or the body of the vehicle occupant and received by special sensors and/or receiving units in the display unit and thus assigned to the driver. A driver operation can then be provided as a function for use.

In one exemplary embodiment, it is provided that a modulated identification signal is generated with a signal generation unit, with the generated identification signal being transmitted to the display unit via the vehicle occupant when the vehicle occupant touches the display unit from a vehicle seat on which the vehicle occupant is sitting, in order to determine the type and/or to determine the scope of the function of the interface device.

By emitting or conducting the identification signal from a vehicle seat, for example, if a driver and a passenger are present, these two can be distinguished at the same time and it can thus be determined which of these two performed the operator action in order to then determine the type and/or scope of the function can. Signal modulation can be used for this purpose, for example in order not to generate an individual identification signal for each vehicle seat in the vehicle. Consequently, a recognition or an identification can then take place as to which vehicle occupant has carried out or carried out the operator control action. For example, a seat heater in the vehicle seats and/or a seat occupancy detection unit in the vehicle seats can be used for this purpose in order to be able to transmit the identification signal to the vehicle occupants, in order to be able to receive or detect this in turn, for example with the receiving unit of the display unit. The type and/or scope of the function can be determined on the basis of the respective assignment, whether it is the driver or the passenger. In particular, the identification signal can be modulated differently for each vehicle seat in order to be able to carry out a clear identification of the vehicle occupant. For example, depending on which modulated identification signal was detected, driver operation and/or passenger operation can be made available as a function for the vehicle occupant to use.

In a further exemplary embodiment, it is provided that vehicle information and/or a current driving situation and/or a current operating mode of the vehicle and/or a current traffic situation in the vicinity of the vehicle are taken into account when determining the type and/or scope of the function of the interface device becomes. This can also be used by the machine learning unit. This is important, for example, when a complex or dangerous traffic situation in the vicinity of the vehicle has been detected and the operator control is performed by the driver. In this case, to increase safety, the function can be kept to a minimum in terms of its type and/or scope, so as not to unnecessarily distract the driver from the road traffic.

Furthermore, the respective operating mode of the vehicle is important when determining the type and/or scope of the function. An operating mode can be, for example, an autonomy level of the vehicle. Depending on the level of autonomy, the type and/or the scope of the function can be restricted, in particular, in order not to distract the driver as a vehicle occupant too much from his or her driving task or readiness to drive.

In one exemplary embodiment, it is further provided that a hand movement and/or a finger movement and/or an arm movement of the vehicle occupant is detected as an operator action with the first sensor device and/or the second sensor device and/or the third sensor device. For example, this can be done by touching the display unit of the interface device, or these movements can be detected in the immediate vicinity of the display unit or the interface device.

A further exemplary embodiment provides that a vehicle driver mode or a non-vehicle driver mode is set or released or activated for the interface device depending on the information recorded by the various sensor devices of the interface device. Thus, depending on whether it is the driver or the passenger, for example, a special mode of the interface device can be enabled or not enabled.

• - einer erste Sensoreinrichtung zum Erkennen einer Bedienhandlung eines Fahrzeuginsassen an der Schnittstellenvorrichtung, aufweisend:
• - eine zur ersten Sensoreinrichtung verschiedene zweite Sensoreinrichtung zum Erfassen zumindest einer Zustandsinformation betreffend den Fahrzeuginsassen, welcher die Bedienhandlung ausübt, und
• - eine Auswerteeinheit zur Bestimmung einer Art und/oder eines Umfangs einer Funktion der Schnittstellenvorrichtung in Abhängigkeit von der erkannten Bedienhandlung des Fahrzeuginsassen und der erfassten zumindest einen Zustandsinformation des Fahrzeuginsassen, sowie
• - eine Benutzerschnittstelleneinheit zum Bereitstellen der bestimmten Funktion der Schnittstellenvorrichtung zur Nutzung für den Fahrzeuginsassen in der bestimmten Art und/oder dem bestimmten Umfang

Another aspect of the invention relates to an interface device for a vehicle, with

• - A first sensor device for detecting an operator action by a vehicle occupant on the interface device, having:
• - a second sensor device, different from the first sensor device, for detecting at least one item of status information relating to the vehicle occupant who is performing the operator control action, and
• - an evaluation unit for determining a type and/or an extent of a function of the interface device depending on the detected operating action of the vehicle occupant and the recorded at least one status information of the vehicle occupant, and
• - a user interface unit for providing the specific function of the interface device for use by the vehicle occupant in the specific manner and/or to the specific extent

The interface device can in particular be an electronic system for a vehicle. For example, the interface device can be an infotainment system of the vehicle.

In particular, the interface device has at least one electronic evaluation unit. Furthermore, the interface device can have a machine learning unit.

The user interface unit can be, for example, a graphical user interface or a touch display or an acoustic output and/or input unit. In particular, an interaction between the interface device and the vehicle occupant of the vehicle can take place with the aid of the user interface unit, which is in particular a machine-human interface.

A further aspect of the invention relates to a vehicle with an interface device according to the preceding aspect.

For example, the vehicle can be a passenger car or a truck. For example, the interface device can be arranged in a cockpit area of the vehicle. For example, a wide variety of functions, components and/or elements in the vehicle can be operated or controlled using the interface device.

In particular, the vehicle can be a highly automated vehicle.

In particular, the method described above can be carried out with the aid of the interface device.

In particular, individual exemplary embodiments of one aspect can be viewed as advantageous exemplary embodiments of the other aspects and vice versa.

The invention also includes the interface device for the vehicle. The interface device can have a data processing device or a processor device that is set up to carry out an embodiment of the method according to the invention. For this purpose, the processor device can have at least one microprocessor and/or at least one microcontroller and/or at least one FPGA (Field Programmable Gate Array) and/or at least one DSP (Digital Signal Processor). Furthermore, the processor device can have program code which is set up to carry out the embodiment of the method according to the invention when executed by the processor device. The program code can be stored in a data memory of the processor device.

The invention also includes developments of the interface device according to the invention and of the vehicle according to the invention, which have features as have already been described in connection with the developments of the method according to the invention. For this reason, the corresponding developments of the interface device according to the invention and the vehicle according to the invention are not described again here.

The vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.

The invention also includes the combinations of features of the described embodiments. The invention also includes implementations that each have a combination of the features of several of the described embodiments, provided that the embodiments were not described as mutually exclusive.

• 1 eine schematische Darstellung eines Fahrzeugs mit einer Schnittstellenvorrichtung;
• 2 eine schematische Darstellung eines Fahrgastinnenraums des Fahrzeugs mit einer Schnittstellenvorrichtung aus 1;
• 3 ein Ausführungsbeispiel der Schnittstellenvorrichtung aus 1 ;
• 4 ein weiteres Ausführungsbeispiel der Schnittstellenvorrichtung aus 1; und
• 5 ein schematisches Ablaufdiagramm einer Betriebsstrategie der Schnittstellenvorrichtung aus 1.

Exemplary embodiments of the invention are described below. For this shows:

• 1 a schematic representation of a vehicle with an interface device;
• 2 Figure 12 shows a schematic representation of a passenger compartment of the vehicle with an interface device 1 ;
• 3 an embodiment of the interface device 1 ;
• 4 another embodiment of the interface device 1 ; and
• 5 a schematic flowchart of an operating strategy of the interface device 1 .

The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the described components of the embodiments each represent individual features that are to be considered independently of one another Invention is, which each develop the invention independently. Therefore, the disclosure is also intended to encompass combinations of the features of the embodiments other than those illustrated. Furthermore, the described embodiments can also be supplemented by further features of the invention that have already been described.

In the figures, the same reference symbols designate elements with the same function.

In the 1 a schematic view of a vehicle 1 is shown. The vehicle 1 is, for example, a passenger car or another type of motor vehicle. For example, the vehicle 1 can be an at least partially autonomously operated vehicle. For this purpose, the vehicle 1 can have an autonomy level 3 or 4, for example.

Vehicle 1 has an interface device 3 or an interface system so that vehicle occupants 2 or passengers of vehicle 1 can output and/or display information in vehicle 1 . The interface device 3 can be an infotainment system or an operating system in the vehicle 1, for example. With the aid of the interface device 3, for example, infotainment content and/or application programs (apps) can be made available or offered to the vehicle occupant 2 . This can include, for example, images, videos, audio files, setting options, air conditioning control, telephone calls, setting a vehicle mode, calling up a website, retrieving information, weather information, or other information and/or usage options or operating options. These examples are not to be understood as exhaustive, but are only intended to provide a brief insight into the options that the vehicle occupants 2 can be offered with the aid of the interface device 3 .

For example, the, in particular electronic, interface device 3 can have at least one, in particular electronic, evaluation unit 4 . In particular, the evaluation unit 4 can be a computing unit or a computing system. Furthermore, the interface device 3 can have a user interface unit 5 . The vehicle occupants can use this to interact with the interface device 3, for example. For example, the user interface unit 5 can be a graphical user interface. In particular, the user interface unit 5 is a machine-human interface, so that on the one hand the vehicle occupants 2 can carry out operating actions on the interface device 3 at the same time. And in turn, information and/or information content can be made available to the vehicle occupant 2 by the interface device 3 via the user interface unit 5 . In particular, the vehicle occupants 2 can transmit control instructions and/or operating actions to the interface device 2 by means of the user interface unit 5 .

For example, the interface device 3 can be arranged in the cockpit of the vehicle 1 . For example, the interface device 3 can be arranged in the area of the center console in a passenger compartment 6 of the vehicle 1 . In particular, the interface device 3 is arranged in such a way that it can be used by all vehicle occupants 2 .

Since the interface device 3 can be used both by a vehicle driver 7 and by the passenger 8 or by another occupant, in particular while the vehicle 1 is moving, a distinction between the respective functions offered by the interface device 3 is relevant here. This is particularly important since the vehicle driver 7 or the driver must be alert or not distracted in order to be able to carry out driving tasks. In particular, the driver must be able to react to special situations and/or traffic events at all times. Therefore, for example, the front passenger 8 can be offered a greater range of functions by means of the interface device 3 than the vehicle driver 7. In order to be able to take these aspects into account, the interface device 3 is designed to communicate between the vehicle driver 7 and the front passenger 8 or another occupant 9 to be able to differentiate and to adapt the information content and/or information offer individually to the respective person.

In order to perform an operator action 10 (cf 3 ), the interface device 3 has at least one first sensor device 11 . With the aid of the first sensor device 11 the operating action 10 of a vehicle occupant 2 on the interface device 3 can be recognized or detected or recorded. In particular, the passenger compartment 6 of the vehicle 1 can be detected by means of the first sensor device 5 . A distinction can be made here between an immediately imminent or approaching operator action 10 or an operator action 10 that has actually already been carried out. For example, can a hand movement and/or a finger movement and/or an arm movement and/or a pointing movement of a vehicle occupant 2 can be detected as an operator action 10 with the aid of the first sensor device 11 .

For example, the first sensor device 11 can be a driver observation camera, an interior radar, an interior camera, a passenger monitoring system or an image acquisition system.

So that the vehicle occupants 2 can be differentiated in more detail and more effectively, the interface device 3 can have a different or different second sensor device 12 than the first sensor device 11 . For example, the second sensor device 12 can have one of the sensor types already listed for the first sensor device 11 . In particular, the second sensor device 12 is designed to detect or determine at least one item of status information or a status of the vehicle occupant 2 that triggered the operator control action 10 . Thus, with the two different sensor devices 11, 12, two different items of information in connection with the operator action 10 can be detected. These two items of information can be combined or corrected, for example, in order to be able to distinguish between the vehicle occupants 2, for example. In particular, the interface device 3 can merge the different sensor devices 11, 12 or other sensor devices, so that an added value of information is available.

A type and/or scope of a function 13 of the interface device 3 can be determined or generated with the aid of the information recorded by the sensor devices 11, 12, which has been correlated, for example. For example, the function 13 can mean a setting option for a vehicle function and/or an infotainment offering and/or an application and/or a video and/or various images and/or an audio file and/or a music playlist and/or a web browser login. In particular, the vehicle occupants 2 can be offered an interaction option and/or a use option in the vehicle 1 with the function 13 .

The type and scope of the function 13 can be determined independently of which vehicle occupant 2 is involved. The type and/or scope of the function 13 differs for the vehicle driver 7 from that of the passenger 8. In particular, the passenger 8 or the occupant 9 can be offered several types and/or a greater range of functions compared to the vehicle driver 7, since the Vehicle driver 7 should not be distracted so much compared to the other people. With the help of the user interface unit 5, the specific function of the interface device 3 can be provided or made available for use by the vehicle occupant 2 in the specific type and to the specific extent. The vehicle occupant 2 who has carried out the operating action 10 can thus use the respective function 13 . In particular, for example, the specific function 13 can be released for use by the respective vehicle occupant 2 . Otherwise, depending on the situation, the type and/or scope of function 13 can be restricted.

In order to better determine whether the vehicle occupant 2 is a vehicle driver 7 or an occupant 9 or a passenger 8, the interface device 3 can have a third sensor device 14 that is different from the first and second sensor devices 11, 12 or can communicate with them or be electrically networked.

The third sensor device 14 can be, for example, sensors in the vehicle seats 15 (cf. 2 ), capacitive sensors, seat occupancy sensors, seat occupancy mats, or seat belt sensors. Consequently, with the aid of the third sensor device 14, for example the number of vehicle occupants 2 in the vehicle 1 and/or a respective person of one of the vehicle occupants 2 can be determined or detected. This information can in turn be used to be able to determine more effectively which vehicle occupant 2 is actually performing or has performed the operator control action 10 . In particular, the interface device 3 can use the sensor devices 11 , 12 , 14 mentioned by way of example or several other different sensor devices in order to be able to determine a wide variety of information in connection with the operator control action 10 . For this purpose, the most diverse sensor types and/or sensor models can be merged in order to obtain a greater information content. For this purpose, the interface device 3 can be communicatively networked with the sensor devices 11, 12, 14 with one another.

For example, using the first or second sensor device 11, 12, a hand movement and a finger movement and/or an arm movement and/or a viewing direction and/or a viewing angle and/or a state of alertness and/or a posture of the vehicle occupant 2 can be recorded as the at least one piece of status information become. This can, for example, be the evaluation unit 4 of the interface device 3 are made available, which in turn can be taken into account when determining the type and/or scope of the function 13 .

Additional useful information can be, for example, vehicle information from vehicle 1 and/or a current driver situation and/or current traffic events and/or a current operating state of vehicle 1 . These can be made available to the interface device 3, for example, by information sources and/or external sensors and/or information sources.

In particular, it is advantageous, for example in a dangerous traffic situation, that the type and/or scope of the function 13 for the vehicle driver 7 is restricted so that he is not distracted too much from his driving tasks. Furthermore, for example, with the help of this information, appropriate warnings and/or warnings can be output acoustically and/or optically and/or haptically in the vehicle 1 by the interface device 3 .

In the 2 an exemplary representation of the passenger compartment 6 is shown. In particular, an area 17 on the driver's side and an area 18 on the passenger's side are shown here. In this exemplary embodiment, the interface device 3 can have a display unit 19 . The display unit 19 can be, for example, a touch display or a center information display of the vehicle 1 . Thus, in this case, the operating action 10 can be carried out by a vehicle occupant 2 touching an area of the display unit 19 . For example, it is conceivable that the display unit 19 is divided into two. In this case, for example, the part which is directed towards the area 17 on the driver's side can be used for the “driver input on the display”. The area or side facing the area 18 on the passenger side can in turn be used as a “passenger input on the display”. In this case, for example, the display unit 19 can have capacitive sensors in order to be able to detect the respective input of the driver 7 or the front passenger 8 . For example, signal receivers can be used for this purpose.

• - Fahrer hat nur eine Hand am Lenkrad und keine Bedienhandlung wird ausgeübt
• - Fahrer hat beide Hände am Lenkrad und es wird ebenfalls keine Bedienhandlung ausgeübt
• - Fahrer hat beispielsweise nur linke Hand am Lenkrad und keine Bedienhandlung wird ausgeübt
• - Fahrer hat linke Hand am Lenkrad und mit der rechten Hand wird eine Bedienhandlung an der Anzeigeeinheit ausgeführt
• - Beispielsweise hat der Fahrer keine Hand am Lenkrad und wird eventuell eine Bedienhandlung ausüben
• - Beispielsweise wird von dem Beifahrer eine Bedienhandlung ausgeführt und der Fahrer hat nur eine Hand am Lenkrad
• - Fahrer hat linke Hand am Lenkrad und der Beifahrer übt mit seiner linken Hand eine Bedienhandlung aus
• - Fahrer hat linke Hand am Lenkrad und will mit der rechten Hand eine Bedienhandlung ausüben und gleichzeitig übt der Beifahrer ebenfalls eine Bedienhandlung mit seiner linken Hand aus
• - Fahrer hat beide Hände am Lenkrad und der Beifahrer übt eine Bedienhandlung aus
• - Fahrer hat keine Hand am Lenkrad und der Beifahrer übt eine Bedienhandlung aus.

Possible examples of the application situations with regard to an operator action on the interface device 3 can be, for example, the following:

• - The driver only has one hand on the steering wheel and no operator action is performed
• - The driver has both hands on the steering wheel and no operator action is performed either
• - For example, the driver only has his left hand on the steering wheel and no operator action is performed
• - The driver has his left hand on the steering wheel and an operating action on the display unit is carried out with his right hand
• - For example, the driver has no hand on the steering wheel and may perform an operator action
• - For example, an operator action is performed by the passenger and the driver only has one hand on the steering wheel
• - The driver has his left hand on the steering wheel and the front passenger carries out an operating action with his left hand
• - The driver has his left hand on the steering wheel and wants to carry out an operating action with his right hand and at the same time the front passenger also carries out an operating action with his left hand
• - The driver has both hands on the steering wheel and the front passenger carries out an operating action
• - The driver does not have a hand on the steering wheel and the front passenger carries out an operating action.

The exemplary application situations just mentioned can be detected using the sensor devices 11, 12, 14 or other sensor devices in the vehicle 1, so that the interface device 3 can then be operated or controlled.

For example, the interface device 3 can be a machine learning unit 20 (cf 1 ) exhibit. With this, the interface device 3 can be mechanically trained in order to be able to determine or generate future functional types and/or functional scopes of a function 13 of the interface device 3 more efficiently. For this purpose, the most diverse input variables, which have already been described in particular in connection with the interface device 3, can be used. For this purpose, for example, the application situations just mentioned can be made available to the machine learning unit 20, so that a function 13 can be provided more efficiently in future other application situations.

• - Mit welchem Blickwinkel schaut der Fahrer auf die Anzeigeeinheit vor einer Bedienhandlung
• - welchen Winkel hat das Armgelenk beziehungsweise das Handgelenk, um zur Anzeigeeinheit zu greifen
• - wie schnell ist die durchschnittliche Arm-, Hand- oder Fingerbewegung bei der Bedienhandlung
• - welche typische Druckabweichung oder Impedanzabweichung oder Kapazitätsabweichung wird vor oder während einer Bedienhandlung an der Anzeigeeinheit festgestellt
• - welche typische Impedanz oder Kapazität wird beispielsweise am Lenkrad oder an der Anzeigeeinheit während einer Bedienhandlung festgestellt.

Furthermore, various aspects can be taken into account, for example for machine training, which are listed below, for example:

• - From what angle does the driver look at the display unit before an operator action
• - What is the angle of the arm joint or wrist to reach for the display unit
• - how fast is the average arm, hand or finger movement during the operator action
• - which typical pressure deviation or impedance deviation or capacitance deviation is detected before or during an operator action on the display unit
• - which typical impedance or capacitance is determined, for example, on the steering wheel or on the display unit during an operator action.

These are just a few examples and should give you a little insight into the possibilities for machine training.

In the 3 is shown in another way how the type and / or the scope of the function 13 of the interface device 3 can be determined and in particular the distinction between driver 7 and passenger 8 can be made. For this purpose, a modulated, in particular electrical or digital, identification signal 24 can be generated or generated with a signal generation unit 21 . This signal 24 has, for example, a low current with a low voltage intensity. In this case, the identification signal 24 can be modulated in frequency and/or form, so that it can be unambiguously assigned, for example.

So if the operating action 10 is now carried out by a vehicle occupant 2, the driver 7 has his left hand 25 on the steering wheel 16 and his right hand 26 is touching the display unit 19, for example. A current flow is therefore via the steering wheel 16, which is gripped by the vehicle occupant 2 , via the body of the vehicle occupant 2 to the display unit 19. A signal transmission is thus carried out here, which can be received, for example, by a transceiver unit or a signal receiver of the display unit 19 and should the modulated identification signal 24 have been recognized, the driver 7 be inferred. For example, special electrical elements of a steering wheel heating of the steering wheel 16 can be used for the signal transmission or the signal line.

Another possibility for this is in the 4 shown. A modulated identification signal 27, 28 for each vehicle seat 15 can in turn be modulated. These two exemplary identification signals 27, 28 differ from one another, so that when they are received on the display unit 19 they can be distinguished or selected. A respective signal generation unit 22, 23 can in turn be used for this purpose. This signal generation unit 22, 23 can be part of a vehicle seat or a seat occupancy unit, for example. Thus, a signal path or a current path can be generated here via the signal generation units or vehicle seats 15 via the respective body of the vehicle occupant 2 to the display unit 19 and then evaluated. The vehicle occupant 2, who can be referred to here as the passenger 8, can in turn touch the display unit 19 with his left hand 29, just like the driver 7. This distinction can in turn be made by the identification signals 27, 28 modulated in their frequency and/or form.

Another way of distinguishing between the driver 7 and the front passenger 8 is to determine a respective impedance and/or a respective resistance value of the driver 7 and the front passenger 8. This can be done, for example, with capacitive sensors or, for example, with the third sensor device 14. These measured Electrical values can be coordinated with the measured information from the other sensors 11, 12, 14 in order to be able to identify the typical capacitance and/or impedance values or variations during operation of the interface device 3.

In the 4 an exemplary operating strategy of the method according to the invention is explained.

First, for example, in a first step S1 it can be checked which operating mode or autonomy level is present or set in the vehicle 1 . If, for example, an autonomy level 3 or 4 is activated, the passenger 8 can, for example, be provided or offered the full range of the function 13 of the interface device 3 .

If none of these autonomy modes are activated, then in a subsequent, exemplary, second step S2, a check is made as to whether the vehicle occupants 2 in particular direct their gaze towards the interface device 3 or whether they are turned away from it. This can be done, for example, with a driver observation camera as the first or second sensor device 11, 12. For example, in the case of an unidentified situation, the driver 7 can be warned by means of a corresponding warning.

In this case, for example, the driver observation camera can be used to distinguish whether only the driver 7 or the front passenger is looking at the road, for example. If only the driver 7 is present, which in turn can be detected with a seat occupancy sensor or a belt buckle sensor, it can again be checked to what extent the driver 7 can safely handle driving tasks. For this purpose, for example, capacitive sensors built into a steering wheel 16 can be used to determine whether the driver has no hand on the steering wheel 16 , for example. In this case, a warning would again be issued. If the driver 7 has at least one hand on the steering wheel 16, a low-distraction function 13 could be provided to the driver 7, for example.

However, if it is determined in step S2 that the driver is performing the operator control action, it can again be checked in an optional third step S3 whether the driver, who inevitably also performs function 3 at least partially, is holding a hand on steering wheel 16 . In this case, in an optional fourth step S4, the driver 7 can again be provided with a low-distraction function 13 and the front passenger 8 could be provided with a function 13 that is comprehensive in scope and type.

If, in turn, the driver performs the operating action 10 and the driver 7 has both hands on the steering wheel 16 and is alert, the passenger 8 or other occupants 9 can be provided with the full range of the function 13 in an optional fifth step S5.

Overall, the examples show how a driver or passenger distinction can be made available when operating the touch display.

Claims (8)

Method for operating an interface device (3) in a vehicle (1), wherein - an operator action (10) by a vehicle occupant (2, 7, 8, 9) on the interface device is recognized by means of a first sensor device (11), having: - detecting at least one piece of status information relating to the vehicle occupant (2, 7, 8, 9) who performs the operator action (10), with a second sensor device (12) that is different from the first sensor device (11), - determining a type and/or scope of a function (13) the interface device (3) depending on the detected operator action (10) of the vehicle occupant (2, 7, 8, 9) and the detected at least one status information of the vehicle occupant (2, 7, 8, 9), and - providing the specific function (13) of the interface device (3) for use by the vehicle occupant (2, 7, 8, 9) in the specific type and/or to the specific extent. characterized in that - the operator action of the vehicle occupant (2, 7, 8, 9) is performed on a display unit (19) of the interface device (3), the vehicle occupant (2, 7, 8, 9) touching the display unit ( 19) is recognized as an operator action (10) by the first sensor device (11), and - a modulated identification signal (24) is generated with a signal generation unit (21, 22, 23), the identification signal (24) generated when the display unit is touched (19) by the vehicle occupant (2, 7, 8, 9) from a steering wheel (16) of the vehicle (1) gripped by the vehicle occupant (2, 7, 8, 9) over the vehicle occupant (2, 7, 8, 9 ) is transmitted to the display unit (19) in order to determine the type and/or scope of the function (13) of the interface device (3). procedure after claim 1 , characterized in that a determination is made as to whether the vehicle occupant (2, 7, 8, 9) is a vehicle driver (7) of the vehicle (1) or an occupant (2, 8, 9) of the vehicle (1), and this determination is taken into account when determining the type and/or scope of the function (13) of the interface device (3). procedure after claim 2 , characterized in that a number of vehicle occupants (2, 7, 8, 9) and/or a respective position of one of the vehicle occupants (2, 7, 8, 9) inside the vehicle (1), this being detected when determining whether the vehicle occupant (2, 7, 8, 9) is the vehicle driver (7) of the vehicle (1) or one of the vehicle driver (7) different occupants (2, 8, 9) is taken into account. Method according to one of the preceding claims, characterized in that with the second sensor device (12) a hand movement and/or a finger movement and/or an arm movement and/or a viewing direction and/or a state of alertness and/or a posture of the vehicle occupant (2, 7, 8, 9) is recorded as the at least one item of status information. Method according to one of the preceding claims, characterized in that the specific type and/or the specific scope of the function (13) of the interface device (3) and/or the specific function (13) is the cut point device (3) and/or the detected operator action (10) of the vehicle occupant (2, 7, 8, 9) and/or the recorded at least one piece of status information of the vehicle occupant (2, 7, 8, 9) of a machine learning unit (20) of the interface device (3) are provided whereby the interface device (3) is machine-trained by means of the machine learning unit (20) to determine the type and/or the extent of a function (13) of the interface device (3). Method according to one of the preceding claims, characterized in that a modulated identification signal (27, 28) is generated with a signal generation unit (21, 22, 23), the generated identification signal (27, 28) being transmitted when the display unit (19) is touched the vehicle occupant (2, 7, 8, 9) from a vehicle seat (15) on which the vehicle occupant (2, 7, 8, 9) sits, via the vehicle occupant (2, 7, 8, 9) to the display unit (19 ) is transmitted in order to determine the type and/or scope of the function (13) of the interface device (3). Interface device (3) for a vehicle (1), with - A first sensor device (11) for detecting an operator action (10) of a vehicle occupant (2, 7, 8, 9) on the interface device (3), characterized by - a second sensor device (12), different from the first sensor device (11), for detecting at least one piece of status information relating to the vehicle occupant (2, 7, 8, 9) who performs the operator control action (10), and - An evaluation unit (4) for determining a type and/or scope of a function (13) of the interface device (3) depending on the detected operator action (10) of the vehicle occupant (2, 7, 8, 9) and the detected at least one Status information of the vehicle occupant (2, 7, 8, 9), and - A user interface unit (5) for providing the specific function (13) of the interface device (3) for use by the vehicle occupant (2, 7, 8, 9) in the specific type and/or the specific scope, characterized by - The first sensor device (11) with which the vehicle occupant (2, 7, 8, 9) touches the display unit (19) on which the operator action (10) of the vehicle occupant (2, 7, 8, 9) is exercised , as an operator action (10) is recognizable, and - A signal generation unit (21, 22, 23) for generating a modulated identification signal (24), the identification signal (24) generated when the vehicle occupant (2, 7, 8, 9) touches the display unit (19) from one of the Vehicle occupants (2, 7, 8, 9) gripped steering wheel (16) of the vehicle (1) is transmitted via the vehicle occupants (2, 7, 8, 9) to the display unit (19) to show the type and / or extent of the To determine function (13) of the interface device (3). Vehicle (1) with an interface device (3). claim 7 .

Images