DE102025131072A1 - Method and system for presenting a digitally acquired object - Google Patents

Abstract

The invention relates to a method for presenting a digitally acquired object, wherein the digitally acquired object is a star, wherein a cloud (2) obtains data about the star, in particular its name, its coordinates, its constellation, a star type, a distance from Earth and/or a catalog number, from an external data source (1) or application and wirelessly provides this data to at least one vehicle (3), where the star and/or its data are presented via at least one output unit (4). The star is presented visually, acoustically and/or haptically via the at least one output unit (4) of the vehicle (3) depending on an ADAS level of the vehicle (3), a consent of a user of the vehicle (3) determined by query or input and further conditions. Further conditions, a distance of the vehicle (3) from obstacles, a speed of the vehicle (3), eye movements of the user, ambient brightness and/or an adaptation of the user's eyes to the ambient brightness are determined and taken into account during the presentation.

Description

The invention relates to a method for presenting a digitally acquired object according to the preamble of claim 1 and a system for presenting a digitally acquired object according to the preamble of claim 10.

CN 111563954 A describes a method and apparatus for projecting a starry sky image for a vehicle. The method for projecting a starry sky image comprises the steps of: determining the current orientation and the current time of a vehicle, wherein the current orientation includes a current position of the vehicle and a current direction of travel of the vehicle; acquiring astronomical position data of a plurality of stars corresponding to the current time and the current position of the vehicle; drawing a starry sky image according to the astronomical position data of the plurality of stars, wherein the starry sky image includes a plurality of individual stars and constellations each consisting of the plurality of stars; determining the azimuth relationship of the starry sky image relative to the vehicle according to the current direction of travel of the vehicle and the astronomical position data of each star; and projecting the starry sky image into the vehicle according to the azimuth relationship. Even if the direction is continuously changed while the vehicle is driving, the position of the starry sky image can be adjusted according to the directional relationship between the starry sky image and the vehicle, so that the position of the starry sky image projected onto the vehicle changes along with the change of the vehicle direction, and the authenticity of the simulated starry sky is improved.

The invention is based on the object of providing a novel method and a novel system for presenting a digitally acquired object.

The object is achieved according to the invention by a method for presenting a digitally acquired object having the features of claim 1 and a system for presenting a digitally acquired object having the features of claim 10.

Advantageous embodiments of the invention are the subject of the subclaims.

A method is proposed for presenting a digitally acquired object, wherein the digitally acquired object is a star, wherein a cloud obtains data about the star, in particular its name, its coordinates, its constellation, a star type, a distance from Earth, and/or a catalog number, from an external data source or application and wirelessly provides this data to at least one vehicle, where the star and/or its data are presented via at least one output unit. According to the invention, the star is presented visually, acoustically, and/or haptically via the at least one output unit of the vehicle depending on an ADAS level of the vehicle, consent from a user of the vehicle determined by query or input, and further conditions. Further conditions that are determined and taken into account during presentation are a distance of the vehicle from obstacles, a speed of the vehicle, eye movements of the user, ambient brightness, and/or an adaptation of the user's eyes to the ambient brightness.

The present invention describes a method and a system which automatically displays digitally acquired objects, for example on a central display unit (head unit) of a vehicle or on another display unit in the vehicle, for example also by projection, and interacts with other systems (for example ambient light, exterior lighting, indicator lights, audio outputs, haptic outputs)) of the vehicle depending on the user (eye movement, eye adjustment) and vehicle conditions (distance to obstacles, ambient brightness, speed and ADAS level (Advanced Driver Assistance Systems)).

The representation, for example the projection, of the objects digitally acquired by the user is brought into the center of interest or attention by the present invention.

This improves the user experience in semi-automatic or fully automated vehicles by providing an immersive, seamless and intuitive process to grant the user access to their acquired digital objects on the vehicle's display units or via augmented reality to increase convenience and satisfaction.

The system can be updated to support new types of digital content and other third-party applications.

• - Verbessern des sozialen und gemeinschaftlichen Erlebnisses, das mit den Erwerbungen digitaler Objekte durch den Kunden assoziiert wird.
• - Generieren eines sozialen Wettbewerbs durch Teilen mit sozialen Netzwerken, auch im Verhältnis mit Fahrzeugsystemen zu anderen, insbesondere zu Fahrer anderer Fahrzeuge,

Furthermore, a social presence can be created through:

• - Improving the social and collaborative experience associated with customers' acquisitions of digital objects.
• - Generating social competition through sharing with social networks, also in relation to vehicle systems with others, especially with drivers of other vehicles,

The present invention represents an advance in creating a more immersive and tailored driving and in-vehicle user experience in ADAS vehicles, meeting the customer's desire for a unique and individually customizable vehicle.

This integration makes it possible to enhance the user experience immersively.

Embodiments of the invention are explained in more detail below with reference to a drawing.

• 1 eine schematische Ansicht eines Systems zur Präsentation digital erworbener Objekte

It shows:

• 1 a schematic view of a system for presenting digitally acquired objects

1 is a schematic view of a system for presenting digitally acquired objects.

The system comprises an external data source 1 and a cloud 2 (e.g., an intelligent cloud 2). The cloud 2 obtains data from the external data source 1, e.g., an application, about a digitally acquired object, e.g., a star, in particular its name, coordinates, constellation, star type, distance from Earth, and/or catalog number, and wirelessly provides this data to at least one vehicle 3.

Depending on an ADAS level of the vehicle 3, the consent of a user, for example a driver or another occupant of the vehicle 3 and possibly further conditions, the digitally acquired object, for example the star, is presented on at least one output unit 4 of the vehicle 3, for example visually, acoustically and/or haptically.

For example, data source 1 can be an application. The following demonstrates how digitally acquired objects are presented and/or projected inside and/or outside vehicle 3. The application could, for example, be based on data from https://starregister.org/. Depending on the conditions of vehicle 3, different functions of the application are activated.

1. a) abhängig vom Nutzer (insbesondere dessen Augenbewegung und/oder seiner Augenanpassung an die Umgebungshelligkeit) und
2. b) abhängig von Bedingungen des Fahrzeugs 3 (Entfernung zu Hindernissen, Helligkeit der Umgebung, Geschwindigkeit und ADAS-Level (Advanced Driver Assistence Systems)).

The digitally acquired objects interact with output units 4 of the vehicle 3, for example with a central display unit (head unit) and/or another display unit in the vehicle 3 and/or a projection unit and/or an ambient light and/or an exterior lighting,

1. a) depending on the user (in particular his eye movement and/or his eye adaptation to the ambient brightness) and
2. b) depending on vehicle conditions 3 (distance to obstacles, ambient brightness, speed and ADAS (Advanced Driver Assistance Systems) level).

• In einem ersten Beispiel ist das Fahrzeug 3 in Bewegung. Es wird das Einverständnis des Nutzers abgefragt, Funktionen der Anwendung zu aktivieren. Wenn das Fahrzeug 3 einen ADAS-Level von weniger als 3 aufweist erfolgt keine Visualisierung des digital erworbenen Objekts innerhalb und außerhalb des Fahrzeugs 3. Wenn das Fahrzeug 3 den ADAS-Level 3 aufweist, dann werden die Funktionen der Anwendung unterbrochen oder reduziert, wenn die Aufmerksamkeit des Fahrers erforderlich ist. Wenn das Fahrzeug 3 den ADAS-Level 4 aufweist, dann werden die Funktionen der Anwendung ausgeschöpft. Es wird der Status der Augenbewegungen des Nutzers ermittelt, beispielsweise mittels mindestens einer Kamera. Ferner wird eine Umgebungshelligkeit ermittelt. Weiter wird der Status einer Augenadaption des Nutzers an die vorliegenden Umgebungslichtbedingungen ermittelt. Weiter wird der Status der vom Nutzer gewählten Farb- und Helligkeitseinstellungen einer Innenbeleuchtung des Fahrzeugs 3 ermittelt.

An example design is described below:

• In a first example, vehicle 3 is moving. The user's consent to activate application functions is requested. If vehicle 3 has an ADAS level of less than 3, the digitally acquired object is not visualized inside or outside vehicle 3. If vehicle 3 has ADAS level 3, the application functions are interrupted or reduced when the driver's attention is required. If vehicle 3 has ADAS level 4, the application functions are fully utilized. The status of the user's eye movements is determined, for example using at least one camera. Furthermore, ambient brightness is determined. Furthermore, the status of the user's eye adaptation to the existing ambient light conditions is determined. Furthermore, the status of the color and brightness settings of an interior lighting of vehicle 3 selected by the user is determined.

In another example, vehicle 3 is stationary. The user's consent to activate application functions is requested. It is checked whether vehicle 3 is stationary. It is checked whether the environment allows the activation of customized exterior lighting, for example in a parking bay, on private property, in a hotel parking lot, in a shopping center parking lot, in a parking garage or underground car park, etc. The available distance in front of vehicle 3 for visualizing the digitally acquired object, for example the star, using exterior lighting is checked, for example using parking sensors and/or a radar sensor. Furthermore, it is checked whether it is legal to activate the application functions at the current location. The status of the user's eye movements is determined, for example using min at least one camera. Furthermore, the ambient brightness is determined. Furthermore, the status of the user's eye adaptation to the ambient light conditions is determined.

Depending on the conditions determined, application functions are activated, provided the user has given their consent. The digitally acquired object, for example, the star, and associated parameters and user parameters can be used in the subsequent presentation using interior and/or exterior lighting and/or in an augmented reality presentation.

Interior lighting and dashboard lighting: The star representation interacts with the interior lighting depending on the user settings and is visualized accordingly. For example, the star can be displayed in the same color as a preset color of the interior lighting. Furthermore, the position of the visualized star in vehicle 3 can be calculated based on the coordinates of the star and vehicle 3.

The proposed solution involves adjusting the interior lighting based on the star data, the user's eye movements, the ambient brightness, and the user's eye adaptation to the ambient brightness. Lighting strips and/or other light sources inside the vehicle 3 can be fine-tuned for brightness and position in the direction of the star's coordinates, taking into account the relative position and/or orientation of the vehicle 3 to the star. This enhances the user experience associated with digitally acquiring the user's star and its data and provides a great presentation in the vehicle 3. This solution can be used regardless of whether the vehicle 3 is moving or not. The star's parameters are visualized in the vehicle 3 without distracting the user.

Exterior lighting: As with interior lighting, the star data digitally acquired by the user can also be used for exterior lighting. The headlights of vehicle 3 can generally be adjusted depending on the star's coordinates, the user's eye movements, the ambient brightness, and the user's eye adjustment to the ambient brightness. Furthermore, the door lights of vehicle 3 can be used to support the presentation of the star.

The star data is used for the exterior lighting in a similar way to that described above for the interior lighting, whereby the user experience associated with the digital acquisition of the user's star is enhanced by the exterior lighting by providing a great presentation outside the vehicle 3. In this case, the presentation is experienced by the user, for example, the owner of the vehicle 3, and by other persons outside the vehicle 3, for example, drivers of other vehicles 3.

In particular, the headlights can be adjusted depending on the star data, taking into account the relative position and/or orientation of the vehicle 3 to the star; for example, the headlights can flash and/or their brightness can be varied, for example, reduced. This can be done in particular when the vehicle 3 is not moving, for example when parked or charging at a charging station.

Central display unit (head unit): Once the star and/or its data are integrated into the Cloud 2, the Cloud 2 can make them available to various applications. The data displayed in the central display unit can visualize the digitally acquired star and/or its data, the data of other stars, constellations, names, and/or zodiac signs based on the user parameters and the required conditions, as described above for indoor and/or outdoor lighting.

Augmented Reality (AR): The visualization of the star can occur in AR applications and/or AR environments in the vehicle 3, as in the central display unit. The star can be visualized in an augmented reality space by vehicle systems, for example, by the central display unit, a head-up display on a windshield, other parts of the glazing of the vehicle 3, or on any other instrument of the vehicle 3 that supports an augmented reality presentation, according to the conditions described above for the interior lighting and/or the exterior lighting.

The augmented reality presentation may include interior lighting and/or exterior lighting.

Additionally, the immersive experience can be enhanced by generating spatial sounds and/or seat vibrations based on the star's data. The user's eye movement can also be tracked. Visualizing the star in augmented reality and/or on the central display unit can be dependent on the user's eye movements.

According to one embodiment of the present invention, the spatial sounds can be used in the vehicle 3 when it is moving or stationary. The coordinates of the star can be used to synchronize special 3D sound effects, binaural recordings and/or playbacks, Ambisonics, wave field synthesis, HRTF (Head-Related Transfer Function), surround sound systems, and/or Dolby Atmos. This enables more precise and dynamic placement of the sound according to the current position of the star. After receiving the data from the star, three-dimensional audio data, which can be part of the data provided for the star or synthesized depending on the data from the star, can be synchronized with the dashboard lighting, the augmented reality room, the interior lighting, and/or the exterior lighting. The spatial sound is synchronized depending on changes in the state and orientation of the vehicle 3 and the coordinates of the star.

The immersive experience can be enhanced by creating spatial sounds and visual effects synchronized with the star data provided by the application.

Haptic feedback in the vehicle 3, such as seat vibrations, can alternatively or additionally provide the user with similar feedback to the synchronized audio outputs.

Tracking eye movements in the vehicle 3 can improve the visualization in the central display unit and in the augmented reality space from the user's perspective. Eye movement tracking automatically detects the eye movements of the user, especially the driver. It can be provided that when the driver looks at the central display unit or the augmented reality space, the star is displayed more centrally.

The room lighting can be made brighter in the direction of the star or the color of the room lighting can be changed in that direction.

Haptic feedback, such as seat vibration, can occur whenever the star appears or disappears.

List of reference symbols

1

Data source

2

Cloud

3

vehicle

4

Output unit

QUOTES CONTAINED IN THE DESCRIPTION

This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• CN 111563954 A [0002]

Claims (10)

A method for presenting a digitally acquired object, wherein the digitally acquired object is a star, wherein a cloud (2) obtains data about the star, in particular its name, its coordinates, its constellation, a star type, a distance from the Earth and/or a catalog number, from an external data source (1) or application and wirelessly provides this data to at least one vehicle (3), where the star and/or its data are presented via at least one output unit (4), characterized in that the star is presented visually, acoustically and/or haptically via the at least one output unit (4) of the vehicle (3) depending on an ADAS level of the vehicle (3), a consent of a user of the vehicle (3) determined by query or input and further conditions, wherein a distance of the vehicle (3) from obstacles, a speed of the vehicle (3), eye movements of the user, an ambient brightness and/or an adaptation of the user's eyes to the ambient brightness are determined as further conditions and taken into account during the presentation. Procedure according to Claim 1 , characterized in that the star is visualized via a central display unit and/or at least one other display unit in the vehicle (3) and/or a projection unit and/or via a room light in the vehicle (3) and/or via external lighting. Procedure according to Claim 1 or 2 , characterized in that if the vehicle (3) has an ADAS level of less than 3, there is no visualization of the star inside and outside the vehicle (3), wherein if the vehicle (3) has ADAS level 3, the presentation is interrupted or restricted when the driver's attention is required during the journey, wherein if the vehicle has ADAS level 4, the presentation is unrestricted. Method according to one of the preceding claims, characterized in that the star is visualized with the exterior lighting when the vehicle (3) is stationary, when the vehicle (3) is in a parking bay, on private property, in a hotel parking lot, in a shopping center parking lot, in a parking garage or an underground car park, when an available distance in front of the vehicle (3) determined by parking sensors and/or a radar sensor is sufficient for visualizing the star by means of the exterior lighting and when this visualization is legally compliant at the current location. Procedure according to Claim 4 , characterized in that headlights of the vehicle (3) and/or door lights of the vehicle (3) are used for visualization via the exterior lighting. Procedure according to Claim 5 , characterized in that for visualization purposes, flashing and/or its brightness is varied, for example reduced. Method according to one of the preceding claims, characterized in that when the star is visualized with the interior lighting, it is displayed in the same color or in a different color than a preset color of the interior lighting or wherein the star is visualized with a different brightness than a preset brightness of the interior lighting, wherein a position of the visualized star in the vehicle (3) is calculated depending on the coordinates of the star and the vehicle (3). Method according to one of the preceding claims, characterized in that the star is visualized in an augmented reality space, in particular by the central display unit, a head-up display on a windshield, other parts of a glazing of the vehicle (3) and/or on another instrument of the vehicle (3) that supports a presentation in augmented reality. Method according to one of the preceding claims, characterized in that spatial sounds and/or seat vibrations are generated depending on the data of the star. System for presenting a digitally acquired object by a vehicle (3), wherein the digitally acquired object is a star, the system comprising: - the vehicle (3) with at least one output unit (4) for presenting the star, characterized by - an external data source (1) or application configured to provide the star and associated data, - a cloud (2) configured to obtain the star and associated data from the external data source (1) or application and to provide it to the vehicle (3), wherein the vehicle (3) is configured to carry out the method according to one of the preceding claims.