CN113386785B - Method and device for displaying augmented reality warning information - Google Patents

Abstract

Embodiments of the present disclosure disclose methods and devices for displaying augmented reality warning information. A specific implementation of the method includes: acquiring vehicle operation data; determining whether the trigger condition of the active safety measure corresponding to the vehicle operation data is satisfied according to the vehicle operation data; in response to determining that the trigger condition is satisfied, generating a prompt to trigger the active safety The AR alert for the action; finally, display the above AR alert. This embodiment implements a clearer notification of the active safety measures to the user, which helps to reduce operations that conflict with the active safety measures, thereby reducing driving risks.

Description

Method and apparatus for displaying augmented reality warning information

This application is a divisional application of a Chinese patent application with an application date of July 3, 2019, an application number of 201910594002.0, and an invention title of "Method and Device for Displaying Augmented Reality Warning Information".

technical field

Embodiments of the present disclosure relate to the field of computer technology, and in particular to a method and device for displaying augmented reality (Augmented Reality, AR) warning information.

Background technique

With the rapid development of computer technology, in order to ensure driving safety, active safety measures in advanced driving assistance systems (ADAS, advanced driving assistance system) based on automatic driving have also been more and more widely used. When active security measures are implemented, users often need to be clearly informed.

There are usually two related methods: one is to combine the image of people and vehicles on the dashboard of the car with the warning sound in the car; the other is to use HUD (Head Up Display, head-up display) to project warnings on the front windshield Red dot and flashing.

Contents of the invention

Embodiments of the present disclosure propose methods and devices for displaying augmented reality warning information.

In a first aspect, an embodiment of the present disclosure provides a method for displaying augmented reality warning information, the method including: acquiring vehicle operating data; A triggering condition for the security measure; in response to determining that the triggering condition is satisfied, generating an augmented reality alert message prompting the triggering of the proactive security measure; displaying the augmented reality alert message.

In some embodiments, the above-mentioned operation data includes distance monitoring data; the above-mentioned distance monitoring data is used to indicate the distance between the target object in the target area and the monitoring equipment; The triggering condition of the active safety measure corresponding to the data includes: in response to determining that the distance between the target indicated by the distance monitoring data and the monitoring device is less than a preset distance threshold, determining that the active safety measure corresponding to the distance monitoring data of the vehicle is satisfied Triggering conditions.

In some embodiments, in response to determining that the trigger condition is satisfied, generating the augmented reality warning information prompting to trigger the active security measure includes: acquiring a video of the area where the target object corresponding to the satisfied trigger condition is captured; based on the video and the satisfied Trigger conditions to generate augmented reality alerts.

In some embodiments, the above-mentioned generation of augmented reality warning information based on the video and the satisfied trigger conditions includes: determining the position of the target object displayed in the video corresponding to the satisfied trigger conditions; generating target object position information according to the position; The display position of the active safety measure description information representing the satisfied trigger condition is associated with the target object position information to generate the augmented reality warning information.

In some embodiments, the above displaying the augmented reality warning information includes: associating and displaying the active safety measure description information and the target object corresponding to the satisfied trigger condition.

In a second aspect, an embodiment of the present disclosure provides an apparatus for displaying augmented reality warning information, the apparatus comprising: an acquisition unit configured to acquire vehicle operation data; a determination unit configured to , determining whether the triggering condition of the active safety measure corresponding to the operating data of the vehicle is satisfied; the generation unit is configured to generate an augmented reality warning message prompting to trigger the active safety measure in response to determining that the triggering condition is met; the display unit is configured to display Augmented reality warning message.

In some embodiments, the above-mentioned operating data includes distance monitoring data; the above-mentioned distance monitoring data is used to indicate the distance between the target object in the target area and the monitoring device; and the above-mentioned determining unit is further configured to: respond to determining the distance monitoring data If the distance between the indicated target object and the monitoring device is less than a preset distance threshold, it is determined that the triggering condition of the active safety measure corresponding to the distance monitoring data of the vehicle is satisfied.

In some embodiments, the generating unit includes: an acquisition module configured to acquire a video of the area where the target body is located corresponding to the trigger condition that is satisfied by shooting; a generation module is configured to generate an enhanced Realistic warning message.

In some embodiments, the above generation module includes: a position determination submodule configured to determine the position of the target object displayed in the video corresponding to the trigger condition met; a position generation submodule configured to generate the target object according to the position Location information; the information generation sub-module is configured to associate the display location of the active safety measure description information representing the satisfied trigger condition with the target object location information to generate augmented reality warning information.

In some embodiments, the above-mentioned display unit is further configured to: correlate and display the active safety measure description information and the target corresponding to the satisfied trigger condition.

In a third aspect, an embodiment of the present disclosure provides a terminal, which includes: one or more processors; a storage device, on which one or more programs are stored; a display screen configured to display warning information; when One or more programs are executed by one or more processors, so that the one or more processors implement the method described in any implementation manner of the first aspect.

In a fourth aspect, embodiments of the present disclosure provide a computer-readable medium on which a computer program is stored, and when the program is executed by a processor, the method described in any implementation manner in the first aspect is implemented.

The method and device for displaying the augmented reality warning information provided by the embodiments of the present disclosure first acquires the operating data of the vehicle; then, according to the operating data of the vehicle, determines whether the triggering condition of the active safety measure corresponding to the operating data of the vehicle is satisfied ; Next, in response to determining that the triggering condition is satisfied, generating augmented reality warning information prompting to trigger the active security measure; finally, displaying the aforementioned augmented reality warning information. In this way, the user can be more clearly informed of the active safety measures, which helps to reduce operations that conflict with the active safety measures, thereby reducing driving risks.

Description of drawings

Other characteristics, objects and advantages of the present disclosure will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:

FIG. 1 is an exemplary system architecture diagram to which an embodiment of the present disclosure can be applied;

FIG. 2 is a flowchart of one embodiment of a method for displaying augmented reality alerts according to the present disclosure;

Fig. 3 is a schematic diagram of information flow in an application scenario of a method for displaying augmented reality warning information according to an embodiment of the present disclosure;

FIG. 4 is a flowchart of yet another embodiment of a method for displaying augmented reality warning information according to the present disclosure;

Fig. 5 is a schematic structural diagram of an embodiment of a device for displaying augmented reality warning information according to the present disclosure;

FIG. 6 is a schematic structural diagram of an electronic device suitable for implementing an embodiment of the present disclosure.

Detailed ways

The present disclosure will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain related inventions, rather than to limit the invention. It should also be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

It should be noted that, in the case of no conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other. The present disclosure will be described in detail below with reference to the accompanying drawings and embodiments.

FIG. 1 shows an exemplary architecture 100 to which the method for displaying augmented reality warning information or the device for displaying augmented reality warning information of the present disclosure can be applied.

As shown in FIG. 1 , a system architecture 100 may include terminal devices 101 , 102 , 103 , a network 104 and a server 105 . The network 104 is used as a medium for providing communication links between the terminal devices 101 , 102 , 103 and the server 105 . Network 104 may include various connection types, such as wires, wireless communication links, or fiber optic cables, among others.

The terminal devices 101, 102, 103 interact with the server 105 via the network 104 to receive or send messages and the like. Various communication client applications may be installed on the terminal devices 101, 102, 103, such as search applications, instant messaging tools, map applications, and the like.

The terminal devices 101, 102, and 103 may be hardware or software. When the terminal devices 101, 102, 103 are hardware, they can be various electronic devices with display screens and support communication connections, including but not limited to smart phones, tablet computers, laptop portable computers and vehicle safety control systems (which can be integrated on the vehicle), etc. Among them, the above-mentioned smartphones, tablet computers, laptop computers, etc. in this embodiment are usually used in vehicles. When the terminal devices 101, 102, 103 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (such as software or software modules for providing distributed services), or as a single software or software module. No specific limitation is made here.

The server 105 may be a server that provides various services, for example, a background server that provides support for the augmented reality warning information displayed on the terminal devices 101 , 102 , 103 . The background server can pre-generate various augmented reality warning information according to the triggering condition of the active security measure, and send the generated augmented reality warning information to the terminal device.

It should be noted that the above augmented reality warning information may also be directly generated by the terminal device, and the network 104 and the server 105 may not exist at this time.

It should be noted that the server may be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster composed of multiple servers, or as a single server. When the server is software, it can be implemented as multiple software or software modules (such as software or software modules for providing distributed services), or as a single software or software module. No specific limitation is made here.

It should be noted that the methods for displaying AR warning information provided by the embodiments of the present disclosure are generally executed by terminal devices 101, 102, and 103, and correspondingly, the device for displaying AR warning information is generally set on the terminal device 101, 102, 103 in.

It should be understood that the numbers of terminal devices, networks and servers in Fig. 1 are only illustrative. According to the implementation needs, there can be any number of terminal devices, networks and servers.

Continuing to refer to FIG. 2 , a flow 200 of an embodiment of a method for displaying augmented reality warning information according to the present disclosure is shown. The method for displaying an augmented reality warning message includes the following steps:

Step 201, acquiring the running data of the vehicle.

In this embodiment, the executing subject of the method for displaying the augmented reality warning information (the terminal devices 101, 102, 103 shown in FIG. 1) can obtain the running data of the vehicle through a wired connection or a wireless connection. Wherein, the above-mentioned operating data of the vehicle may include various data related to the driving of the vehicle. It may include but not limited to at least one of the following: driving speed, lane deviation, distance from surrounding obstacles. As an example, the above-mentioned driving speed can be obtained from a vehicle speed sensor; the above-mentioned lane offset can be obtained according to the matching between the vehicle navigation and the high-precision map, or can be obtained from a processor connected by communication for lane line recognition; the above-mentioned The distance to surrounding obstacles can be obtained from ultrasonic radar.

In some optional implementation manners of this embodiment, the above operating data may include distance monitoring data. The above distance monitoring data can be used to indicate the distance between the target object in the target area and the monitoring device. Wherein, the aforementioned target area may be an area that can be detected by a distance monitoring device installed on the vehicle. The detection equipment mentioned above can be various automotive radars. Such as laser radar, ultrasonic radar, microwave radar, etc. The aforementioned target objects may include stationary or moving people or objects. For example, the aforementioned target objects may include but not limited to at least one of the following: pedestrians, vehicles, trees, railings, and road shoulders.

Step 202, according to the running data of the vehicle, determine whether the triggering condition of the active safety measure corresponding to the running data of the vehicle is satisfied.

In this embodiment, according to the running data of the vehicle acquired in step 201, the execution subject may determine whether the triggering condition of the active safety measure corresponding to the running data of the vehicle is satisfied in various ways.

As an example, the triggering conditions of different active security measures may be pre-stored in the execution subject. For example, triggering conditions for active safety measures such as reducing accelerator or braking may include vehicle speed exceeding a preset speed or distance. For another example, the triggering conditions for the active safety measure of direction fine-tuning may include that the lane deviation is greater than a preset threshold and it is not detected that the turn signal is turned on. The execution subject may compare the acquired vehicle operation data with the stored trigger conditions of the active safety measures, and determine whether the trigger conditions of the active safety measures corresponding to the vehicle operation data are satisfied.

As yet another example, the execution subject may pre-store execution information of active safety measures corresponding to different types of operating data. For example, the driving speed corresponds to information representing the execution of active safety measures such as reducing the accelerator pedal or braking. In response to detecting the execution information representing the active safety measure of reducing the accelerator or braking, the execution subject may determine that the triggering condition of the active safety measure corresponding to the driving speed is satisfied.

In some optional implementations of this embodiment, based on the distance monitoring data in the operating data, in response to determining that the distance between the target indicated by the distance monitoring data and the monitoring device is less than a preset distance threshold, the above-mentioned executive body may It is determined that a trigger condition of an active safety measure corresponding to the distance monitoring data of the vehicle is satisfied.

Step 203 , in response to determining that the trigger condition is met, generating augmented reality warning information prompting to trigger the active security measure.

In this embodiment, in response to determining that the trigger condition is satisfied, the execution subject may generate augmented reality warning information prompting to trigger the active safety measure. Wherein, the above-mentioned augmented reality warning information may be formed by superimposing real-time images and warning information. The above-mentioned real-time image may be a video captured by a camera installed on the vehicle. The above warning information may be in various forms, such as image, text, and voice. For example, the above-mentioned warning information may be the text of "Active security measures have been triggered". The above text can be superimposed and displayed on the display screen together with the real-time image. Optionally, the above warning information may also include a triggering condition of the triggered active security measure. Optionally, the above-mentioned warning information may also be a voice prompt of "You have been driving over the speed limit and have automatically slowed down".

In some optional implementations of this embodiment, the execution subject may follow the steps below to generate augmented reality warning information prompting to trigger active security measures:

The first step is to obtain the video of the area where the target body is located corresponding to the trigger condition that is satisfied by shooting.

In these implementation manners, the execution subject may capture video of the area where the target object corresponding to the satisfied trigger condition is captured through a communication-connected camera. Wherein, the target object corresponding to the trigger condition satisfied above may be determined according to the trigger condition, for example, a person or object whose distance from the monitoring device is less than a preset threshold.

In the second step, based on the video and the trigger conditions met, an augmented reality warning message is generated.

In these implementations, the executive body may superimpose text or image information prompting to trigger active security measures on the video to generate augmented reality warning information.

Step 204, displaying the augmented reality warning information.

In this embodiment, the execution subject may display the augmented reality warning information generated in step 203 . As an example, the above execution subject may display the augmented reality warning information in the form of text or image on the display screen. As yet another example, the execution subject may also broadcast the warning information in the form of voice, and at the same time display text or images corresponding to the broadcast warning information.

Continuing to refer to FIG. 3 , FIG. 3 is a schematic diagram of information flow in an application scenario of a method for displaying augmented reality warning information according to an embodiment of the present disclosure. In the application scenario of FIG. 3 , a warning system 3011 , a speed sensor 3012 , a vehicle navigation system 3013 and a vehicle display 3014 may be installed on the vehicle 301 . The warning system 3011 can acquire the traveling speed “75km/h” 3015 of the vehicle 301 from the speed sensor 3012 . Afterwards, the warning system 3011 can also acquire the speed limit information of this road section as "not exceeding 70km/h" 3016 through the vehicle navigation system 3013 . Next, the warning system 3011 can determine that the triggering condition of the deceleration measure corresponding to the driving speed of the vehicle is satisfied according to the acquired driving speed 3015 exceeding the speed indicated by the speed limit information 3016 . Then, in response to determining that the above trigger condition is met, the warning system 3011 may generate an augmented reality warning message 3017 composed of a warning message in text form of "You have exceeded the speed and automatic deceleration has been activated" and a real-time image superimposed. Finally, the warning system 3011 may send the generated augmented reality warning information 3017 to the vehicle display 3014, so that the vehicle display 3014 displays the above augmented reality warning information 3017.

At present, one of the existing technologies usually uses the combination of the instrument panel image and the warning sound in the car to inform the driver of active safety measures, which often only reflects the reminder of driving risks and does not monitor the triggering conditions of active safety measures. illustrate. As a result, users (such as drivers) turn off active safety measures or take operations that conflict with active safety measures due to distrust or inconvenient use, causing driving risks. However, the method provided by the above-mentioned embodiments of the present disclosure can more clearly inform the user of the situation of the active security measures by generating the augmented reality warning information prompting the triggering of the active security measures, which helps to reduce operations that conflict with the active security measures. Thereby reducing driving risk.

Further referring to FIG. 4 , it shows a process 400 of still another embodiment of a method for displaying augmented reality warning information. The flow 400 of the method for displaying augmented reality warning information includes the following steps:

Step 401, acquiring the running data of the vehicle.

In this embodiment, the above operating data may include distance monitoring data. The above distance monitoring data can be used to indicate the distance between the target object in the target area and the monitoring device.

Step 402 , in response to determining that the distance between the target indicated by the distance monitoring data and the monitoring device is less than a preset distance threshold, determine that a trigger condition of an active safety measure corresponding to the distance monitoring data of the vehicle is satisfied.

Step 403, acquire the video of the area where the target object is located corresponding to the trigger condition that is satisfied by shooting.

The above step 401, step 402, and step 403 are respectively consistent with the descriptions of the corresponding parts in step 201, step 202, and step 203 in the previous embodiment, and the above descriptions for the corresponding parts in step 201, step 202, and step 203 are also applicable to Step 401, step 402 and step 403 will not be repeated here.

Step 404, determining the position of the object displayed in the video corresponding to the trigger condition that is met.

In this embodiment, the executing subject of the method for displaying the augmented reality warning information (for example, the terminal devices 101, 102, and 103 shown in FIG. 1 ) can determine the target object display corresponding to the above-mentioned satisfied trigger conditions through image recognition technology. position in the video. Wherein, the target object corresponding to the trigger condition satisfied above may be a person or object whose distance from the monitoring device is less than a preset distance threshold. Usually, the above-mentioned target can be roughly positioned by the above-mentioned monitoring equipment (such as various vehicle-mounted radars). Afterwards, the execution subject may determine the position of the target object displayed in the video through various target positioning and target detection technologies.

Step 405, generating target object location information according to the location.

In this embodiment, according to the position determined in step 404, the execution subject may generate target object position information to indicate the position of the target object in the video frame of the video. Generally, the above target object position information may include coordinates. For example, it may be represented by the coordinates of the center of a bounding box and the length and width of the bounding box determined by the target positioning technology.

Step 406 , associating the display position of the active security measure description information representing the satisfied trigger condition with the target object position information to generate augmented reality warning information.

In this embodiment, the execution subject may determine the display position of the active security measure description information representing the satisfied trigger condition to be near the position indicated by the target object position information generated in step 405, thereby generating the augmented reality warning information . Among them, the above-mentioned active safety measure description information may include but not limited to at least one of the following: active safety measure trigger conditions (such as "distance is less than 2 meters"), active safety measure implementation status (such as "automatic braking"), trigger object indication Icons (such as arrows pointing to the nearest pedestrian).

Step 407, displaying the augmented reality warning information.

The above-mentioned step 407 is consistent with the step 204 in the foregoing embodiments, and the above description for the step 204 is also applicable to the step 407, which will not be repeated here.

In some optional implementation manners of this embodiment, the execution subject may correlate and display the active security measure description information with the target object corresponding to the above-mentioned satisfied trigger condition. That is, the security measure explanatory information may be displayed near the target object.

It can be seen from FIG. 4 that the process 400 of the method for displaying augmented reality warning information in this embodiment embodies the generation of augmented reality warning information that is associated with the active security measure description information representing the trigger condition that is satisfied and the target object position. and associate the steps shown. Therefore, the solution described in this embodiment can describe risky objects that trigger active security measures in combination with real-scene video images, without pre-establishing image libraries of various objects, thereby saving storage space and making object display more accurate. Furthermore, by associating and displaying the explanatory information of the active safety measures with the target object, it is more clear and intuitive to prompt the driving risk and explain the active safety measures. This in turn helps reduce driving risk.

Further referring to FIG. 5 , as an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a device for displaying augmented reality warning information. This device embodiment corresponds to the method embodiment shown in FIG. 2 , The device can be specifically applied to various electronic devices.

As shown in FIG. 5 , an apparatus 500 for displaying augmented reality warning information provided in this embodiment includes an acquisition unit 501 , a determination unit 502 , a generation unit 503 and a display unit 504 . Among them, the acquiring unit 501 is configured to acquire the running data of the vehicle; the determining unit 502 is configured to determine whether the triggering condition of the active safety measure corresponding to the running data of the vehicle is satisfied according to the running data of the vehicle; the generating unit 503 is configured to It is configured to, in response to determining that the trigger condition is satisfied, generate augmented reality warning information prompting to trigger the active safety measure; the display unit 504 is configured to display the augmented reality warning information.

In this embodiment, in the apparatus 500 for displaying augmented reality warning information: the specific processing of the acquisition unit 501, the determination unit 502, the generation unit 503, and the display unit 504 and the technical effects brought about by them can refer to FIG. 2 respectively. Relevant descriptions of step 201, step 202, step 203 and step 204 in the embodiment will not be repeated here.

In some optional implementation manners of this embodiment, the above operating data may include distance monitoring data. The above distance monitoring data can be used to indicate the distance between the target object in the target area and the monitoring device. The above determination unit 502 may be further configured to: in response to determining that the distance between the target indicated by the distance monitoring data and the monitoring device is less than a preset distance threshold, determine that the triggering condition of the active safety measure corresponding to the distance monitoring data of the vehicle is satisfied .

In some optional implementation manners of this embodiment, the generating unit 503 may include: an acquiring module (not shown in the figure), and a generating module (not shown in the figure). Wherein, the above acquisition module may be configured to acquire the video of the area where the target object is located corresponding to the trigger condition met by shooting. The above generating module may be configured to generate augmented reality warning information based on the video and the satisfied trigger condition.

In some optional implementations of this embodiment, the above generation module may include: a location determination submodule (not shown in the figure), a location generation submodule (not shown in the figure), an information generation submodule (not shown in the figure) not shown). Wherein, the above-mentioned position determination sub-module may be configured to determine the position of the object displayed in the video corresponding to the satisfied trigger condition. The above position generation sub-module may be configured to generate target object position information according to the position. The above information generation sub-module may be configured to associate the display position of the active security measure description information representing the satisfied trigger condition with the target object position information to generate the augmented reality warning information.

In some optional implementation manners of this embodiment, the display unit 504 may be further configured to: correlate and display the active security measure description information with the target corresponding to the satisfied trigger condition.

The device provided by the above-mentioned embodiments of the present disclosure acquires the running data of the vehicle through the acquiring unit 501; then, according to the running data of the vehicle, the determining unit 502 determines whether the triggering condition of the active safety measure corresponding to the running data of the vehicle is met; after that, In response to determining that the trigger condition is met, the generating unit 503 generates AR warning information prompting that the active safety measure is triggered; finally, the display unit 504 displays the AR warning information. In this way, the user can be more clearly informed of the active safety measures, which helps to reduce operations that conflict with the active safety measures, thereby reducing driving risks.

Referring now to FIG. 6 , it shows a schematic structural diagram of an electronic device (such as the terminal device in FIG. 1 ) 600 suitable for implementing an embodiment of the present disclosure. Terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, PADs (tablet computers), vehicle-mounted terminals (eg, vehicle-mounted navigation terminals), and the like. The terminal device shown in FIG. 6 is only an example, and should not limit the functions and application scope of the embodiments of the present disclosure.

As shown in FIG. 6, an electronic device 600 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 601, which may be randomly accessed according to a program stored in a read-only memory (ROM) 602 or loaded from a storage device 608. Various appropriate actions and processes are executed by programs in the memory (RAM) 603 . In the RAM 603, various programs and data necessary for the operation of the electronic device 600 are also stored. The processing device 601 , ROM 602 and RAM 603 are connected to each other through a bus 604 . An input/output (I/O) interface 605 is also connected to the bus 604 .

Generally, the following devices can be connected to the I/O interface 605: an input device 606 including, for example, a touch screen, a touchpad, a camera, an accelerometer, a gyroscope, etc.; including, for example, a liquid crystal display (LCD, Liquid Crystal Display), a speaker, a vibrator, etc. an output device 607; a storage device 608 including, for example, a flash memory (Flash Card); and a communication device 609. The communication means 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. While FIG. 6 shows electronic device 600 having various means, it should be understood that implementing or having all of the means shown is not a requirement. More or fewer means may alternatively be implemented or provided. Each block shown in FIG. 6 may represent one device, or may represent multiple devices as required.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, where the computer program includes program codes for executing the methods shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via communication means 609 , or from storage means 608 , or from ROM 602 . When the computer program is executed by the processing device 601, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are executed.

It should be noted that the computer-readable medium described in the embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. A computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the embodiments of the present disclosure, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device . The program code contained on the computer readable medium can be transmitted by any appropriate medium, including but not limited to: electric wire, optical cable, RF (Radio Frequency, radio frequency), etc., or any suitable combination of the above.

The above-mentioned computer-readable medium may be included in the above-mentioned terminal device, or may exist independently without being assembled into the terminal device. The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the terminal device, the terminal device: acquires the operating data of the vehicle; A triggering condition of the active safety measure corresponding to the operation data; in response to determining that the triggering condition is satisfied, generating an augmented reality warning message prompting to trigger the active safety measure; and displaying the augmented reality warning message.

Computer program code for carrying out operations of embodiments of the present disclosure may be written in one or more programming languages, or combinations thereof, including object-oriented programming languages—such as Java, Smalltalk, C++, Also included are conventional procedural programming languages - such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In cases involving a remote computer, the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through an Internet service provider). Internet connection).

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or portion of code that contains one or more logical functions for implementing specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.

The units involved in the embodiments described in the present disclosure may be implemented by software or by hardware. The described units may also be set in a processor, for example, may be described as: a processor, including an acquisition unit, a determination unit, a generation unit, and a display unit. Wherein, the names of these units do not constitute a limitation to the unit itself under certain circumstances, for example, the acquisition unit may also be described as a “unit for acquiring vehicle operation data”.

The above description is only a preferred embodiment of the present disclosure and an illustration of the applied technical principles. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solution formed by the specific combination of the above-mentioned technical features, but also covers the above-mentioned invention without departing from the above-mentioned inventive concept. Other technical solutions formed by any combination of technical features or equivalent features. For example, a technical solution formed by replacing the above-mentioned features with technical features having similar functions disclosed in (but not limited to) the embodiments of the present disclosure.

Claims (12)

1. A method for displaying an augmented reality warning message, comprising: Acquiring operating data of the vehicle, wherein the operating data includes distance monitoring data, and the distance monitoring data is used to indicate the distance between the target object in the target area and the monitoring device; In response to determining that the distance between the target indicated by the distance monitoring data and the monitoring device is less than a preset distance threshold, determining that a trigger condition of an active safety measure corresponding to the distance monitoring data of the vehicle is met; In response to determining that the trigger condition is satisfied, generating augmented reality warning information prompting to trigger the active safety measure, wherein the augmented reality warning information includes active safety measure description information representing the satisfied trigger condition, and the active safety measure The explanatory information includes the triggering conditions of active security measures and the indicator icon of the triggering object; The augmented reality alert message is displayed. 2. The method according to claim 1, wherein, in response to determining that the trigger condition is met, generating an augmented reality warning message prompting to trigger the active safety measure comprises: Obtain the video of the area where the target body is located corresponding to the trigger condition that is satisfied by shooting; The augmented reality warning information is generated based on the video and the satisfied trigger condition. 3. The method according to claim 2, wherein the generating the augmented reality warning information based on the video and the satisfied trigger condition comprises: determining the position of the target object corresponding to the satisfied trigger condition displayed in the video; Generating target body position information according to the position; The display position of the active safety measure description information is associated with the target object position information to generate the augmented reality warning information. 4. The method according to claim 1, wherein said displaying said augmented reality warning information comprises: The active security measure description information is displayed in association with the target object corresponding to the satisfied trigger condition. 5. The method according to any one of claims 1-4, wherein the operating data further comprises a lane offset; and Before generating an augmented reality warning message prompting to trigger the active security measure in response to determining that the trigger condition is met, the method further includes: In response to determining that the lane offset is greater than a preset threshold and no turning on is detected, it is determined that a trigger condition of an active safety measure corresponding to the lane offset of the vehicle is satisfied. 6. A device for displaying an augmented reality warning message, comprising: An acquisition unit configured to acquire operating data of the vehicle, wherein the operating data includes distance monitoring data, and the distance monitoring data is used to indicate the distance between the target object in the target area and the monitoring device; a determining unit configured to, in response to determining that the distance between the target indicated by the distance monitoring data and the monitoring device is less than a preset distance threshold, determine that the active safety measure corresponding to the distance monitoring data of the vehicle is satisfied Triggering conditions; A generating unit configured to, in response to determining that the trigger condition is met, generate augmented reality warning information prompting to trigger the active safety measure, wherein the augmented reality warning information includes active safety measure explanatory information representing the satisfied trigger condition , the active safety measure description information includes active safety measure trigger conditions and trigger object indicator icons; A display unit configured to display the augmented reality warning information. 7. The apparatus according to claim 6, wherein the generating unit comprises: The acquisition module is configured to acquire the video of the area where the target body is located corresponding to the trigger condition satisfied by shooting; A generating module configured to generate the augmented reality warning information based on the video and the satisfied trigger condition. 8. The apparatus according to claim 7, wherein the generating module comprises: A position determination submodule configured to determine the position of the target object displayed in the video corresponding to the satisfied trigger condition; The position generating submodule is configured to generate target object position information according to the position; The information generation sub-module is configured to associate the display position of the active security measure description information with the target object position information, and generate the augmented reality warning information. 9. The apparatus of claim 6, wherein the display unit is further configured to: The active security measure description information is displayed in association with the target object corresponding to the satisfied trigger condition. 10. The device according to any one of claims 6-9, wherein the operating data further includes a lane offset; and The device also includes: The second determining unit is configured to, in response to determining that the lane offset is greater than a preset threshold and no turn signal is detected, determine that a trigger condition of an active safety measure corresponding to the lane offset of the vehicle is met. 11. A terminal, comprising: one or more processors; a storage device having one or more programs stored thereon; a display screen configured to display an alert message; When the one or more programs are executed by the one or more processors, the one or more processors are made to implement the method according to any one of claims 1-5. 12. A computer-readable medium, on which a computer program is stored, wherein, when the program is executed by a processor, the method according to any one of claims 1-5 is realized.

Images