CN107229906A - A kind of automobile overtaking's method for early warning based on units of variance model algorithm - Google Patents

A kind of automobile overtaking's method for early warning based on units of variance model algorithm Download PDF

Info

Publication number
CN107229906A
CN107229906A CN201710318142.6A CN201710318142A CN107229906A CN 107229906 A CN107229906 A CN 107229906A CN 201710318142 A CN201710318142 A CN 201710318142A CN 107229906 A CN107229906 A CN 107229906A
Authority
CN
China
Prior art keywords
vehicle
overtaking
msub
early warning
component model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710318142.6A
Other languages
Chinese (zh)
Inventor
刘绪
张伟伟
吴训成
王慧敏
王鑫琛
张世平
刘东旭
戚文强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai University of Engineering Science
Original Assignee
Shanghai University of Engineering Science
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai University of Engineering Science filed Critical Shanghai University of Engineering Science
Priority to CN201710318142.6A priority Critical patent/CN107229906A/en
Publication of CN107229906A publication Critical patent/CN107229906A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/584Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/213Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
    • G06F18/2135Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on approximation criteria, e.g. principal component analysis
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2411Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/48Extraction of image or video features by mapping characteristic values of the pattern into a parameter space, e.g. Hough transformation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/50Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
    • G06V10/507Summing image-intensity values; Histogram projection analysis
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143Alarm means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/08Detecting or categorising vehicles

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Automation & Control Theory (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Human Computer Interaction (AREA)
  • Traffic Control Systems (AREA)

Abstract

本发明涉及一种基于可变部件模型算法的汽车超车预警方法,包括下列步骤:后方车辆超车预警步骤,汽车通过后视摄像头结合可变部件模型算法对后方车辆进行识别,通过识别后方车辆与本车以及车道线之间的位置关系,判断后方车辆是否进行超车并向驾驶员发出预警;前方车辆超车预警步骤,汽车通过前视摄像头结合可变部件模型算法对前方车辆进行识别,通过识别前方车辆与本车以及车道线之间的位置关系,判断本车是否需要进行超车并在超车有危险时向驾驶员发出预警。与现有技术相比,本发明具有预警准确、预警速度快以及实现方便等优点。

The invention relates to a vehicle overtaking early warning method based on a variable component model algorithm, comprising the following steps: the rear vehicle overtaking early warning step, the vehicle uses a rear view camera combined with a variable component model algorithm to identify the rear vehicle, and through identifying the rear vehicle and its own The positional relationship between the car and the lane line determines whether the vehicle behind is overtaking and issues an early warning to the driver; in the overtaking warning step of the vehicle in front, the car recognizes the vehicle in front through the front-view camera combined with the variable component model algorithm, and recognizes the vehicle in front Based on the positional relationship with the vehicle and the lane line, it is judged whether the vehicle needs to overtake and an early warning is given to the driver when overtaking is dangerous. Compared with the prior art, the present invention has the advantages of accurate early warning, high early warning speed, convenient realization and the like.

Description

一种基于可变部件模型算法的汽车超车预警方法A Vehicle Overtaking Early Warning Method Based on Variable Component Model Algorithm

技术领域technical field

本发明涉及超车预警领域,尤其是涉及一种基于可变部件模型算法的汽车超车预警方法。The invention relates to the field of overtaking early warning, in particular to an automobile overtaking early warning method based on a variable component model algorithm.

背景技术Background technique

超车是驾驶员最为常见的驾驶行为之一。据统计,在高速公路上驾驶员以90km/h行驶100km的距离,途中将进行大约50次超车行为。近年来,我国因超车不当引发的交通事故呈明显上升趋势,尤其是在高速公路上,60%以上的交通事故都与超车有关。实施超车时,驾驶员必须根据当前的车速、车辆间距、车流状态以及道路交通设施等周边环境信息,实时调整驾驶策略实现超车行为。避免超车过程引发的车辆碰撞,可通过控制车辆间的相对速度和增加车辆纵向间距来实现。Overtaking is one of the most common driving behaviors for drivers. According to statistics, when a driver travels a distance of 100km at 90km/h on the expressway, he will perform about 50 overtaking behaviors on the way. In recent years, traffic accidents caused by improper overtaking in our country have shown an obvious upward trend, especially on expressways, where more than 60% of traffic accidents are related to overtaking. When implementing overtaking, the driver must adjust the driving strategy in real time to achieve overtaking behavior according to the current vehicle speed, vehicle distance, traffic flow status, and road traffic facilities and other surrounding environmental information. Avoiding vehicle collisions caused by overtaking can be achieved by controlling the relative speed between vehicles and increasing the longitudinal distance between vehicles.

公开号为CN105216797A的专利文献公开了名称为超车方法及系统的技术方案,该方案包括检测模块、处理模块,通过摄像机和前置雷达获得障碍物的行驶速度及位置信息来判断目标车辆能否执行超车动作;公开号为CN101326511的专利文献公开了名称为用于检测或预测车辆超车的方法的技术方案,在该方案的实施例中,使用无线通信来读取其他车辆的导航系统,以确定另一车辆是否会超车。The patent document with the publication number CN105216797A discloses a technical solution called the overtaking method and system, which includes a detection module and a processing module, and obtains the speed and position information of the obstacle through the camera and the front radar to determine whether the target vehicle can perform Overtaking action; the patent document whose publication number is CN101326511 discloses a technical solution titled as a method for detecting or predicting vehicle overtaking, in an embodiment of the solution, wireless communication is used to read the navigation systems of other vehicles to determine the 1. Whether the vehicle will overtake.

目前,在国内与超车及变道的相关技术中,多数采用雷达或者短距离信息通讯系统来防止超车时交通事故的发生,这种方案因为采用多种传感器成本巨大,并且在实时场景中并不能快速有效的识别车辆及车道线信息,或者仅仅是预测障碍物与车辆之间的距离信息。At present, in domestic technologies related to overtaking and lane changing, most of them use radar or short-distance information communication systems to prevent traffic accidents during overtaking. This solution is costly due to the use of multiple sensors and cannot be implemented in real-time scenarios. Quickly and effectively identify vehicles and lane line information, or just predict the distance information between obstacles and vehicles.

发明内容Contents of the invention

本发明的目的是针对上述问题提供一种基于可变部件模型算法的汽车超车预警方法。The object of the present invention is to provide a kind of vehicle overtaking early warning method based on variable component model algorithm for above-mentioned problem.

本发明的目的可以通过以下技术方案来实现:The purpose of the present invention can be achieved through the following technical solutions:

一种基于可变部件模型算法的汽车超车预警方法,所述方法包括下列步骤:A vehicle overtaking warning method based on a variable component model algorithm, said method comprising the following steps:

后方车辆超车预警步骤,汽车通过后视摄像头结合可变部件模型算法对后方车辆进行识别,通过识别后方车辆与本车以及车道线之间的位置关系,判断后方车辆是否进行超车并向驾驶员发出预警;In the overtaking warning step of the rear vehicle, the car recognizes the rear vehicle through the rear view camera combined with the variable component model algorithm, and by identifying the positional relationship between the rear vehicle, the vehicle and the lane line, judges whether the rear vehicle is overtaking and sends a signal to the driver. early warning;

前方车辆超车预警步骤,汽车通过前视摄像头结合可变部件模型算法对前方车辆进行识别,通过识别前方车辆与本车以及车道线之间的位置关系,判断本车是否需要进行超车并在超车有危险时向驾驶员发出预警。In the overtaking warning step of the vehicle in front, the car recognizes the vehicle in front through the front-view camera combined with the variable component model algorithm. By identifying the positional relationship between the vehicle in front, the vehicle and the lane line, it is judged whether the vehicle needs to overtake and whether the overtaking is necessary. Alerts the driver in case of danger.

所述后方车辆超车预警步骤具体为:The steps of the vehicle overtaking warning in the rear are specifically:

A1)汽车根据可变部件模型算法,检测后视摄像头的拍摄图像内是否出现其他车辆,若是则进入步骤A2),若否则继续检测;A1) The car detects whether other vehicles appear in the image captured by the rear-view camera according to the variable component model algorithm, and if so, enters step A2), otherwise continues to detect;

A2)汽车判断检测到的车辆与本车之间的距离是否减小,若是则进入步骤A3),若否则返回步骤A1);A2) The car judges whether the distance between the detected vehicle and the vehicle decreases, if so, enter step A3), otherwise return to step A1);

A3)汽车对车道线进行识别,并判断本车与检测到的车辆是否位于同一车道线内,若是则向驾驶员发出预警,若否则进行步骤A4);A3) The car recognizes the lane line, and judges whether the car and the detected vehicle are located in the same lane line, and if so, sends an early warning to the driver, otherwise proceeds to step A4);

A4)汽车在检测到的车辆从后视摄像头内消失后进入前方车辆超车预警步骤。A4) After the detected vehicle disappears from the rear view camera, the car enters the overtaking warning step of the vehicle in front.

所述前方车辆超车预警步骤具体为:The overtaking warning steps of the vehicle in front are specifically as follows:

B1)汽车根据可变部件模型算法,检测前视摄像头的拍摄图像内是否出现其他车辆,若是则进入步骤B2),若否则继续检测;B1) The car detects whether other vehicles appear in the image taken by the front-view camera according to the variable component model algorithm, if so, enters step B2), otherwise continues to detect;

B2)汽车判断检测到的车辆与本车之间的距离是否减小,若是则进入步骤B3),若否则返回步骤B1);B2) the car judges whether the distance between the detected vehicle and the vehicle decreases, if so, enter step B3), otherwise return to step B1);

B3)汽车对车道线进行识别,并判断本车与检测到的车辆是否位于同一车道线内,若是则向驾驶员发出预警,若否则进行步骤B4);B3) The car recognizes the lane line, and judges whether the car and the detected vehicle are located in the same lane line, and if so, sends an early warning to the driver, otherwise proceeds to step B4);

B4)汽车在检测到的车辆从前视摄像头内消失后进入后方车辆超车预警步骤。B4) The car enters the rear vehicle overtaking warning step after the detected vehicle disappears from the front view camera.

所述可变部件模型算法具体为:The algorithm of the variable component model is specifically:

A11)根据后视摄像头的拍摄图像,构建尺度金字塔;A11) Build a scale pyramid according to the photographed images of the rear-view camera;

A12)在尺度金字塔内的每个尺度层内,通过滑动窗口检测方法将图像与通过可变部件模型算法训练后的模型进行匹配,并计算匹配分数;A12) In each scale layer in the scale pyramid, the image is matched with the model trained by the variable component model algorithm by the sliding window detection method, and the matching score is calculated;

A13)选取最高匹配分数对应的尺度层,若该匹配分数超过阈值则表明检测到车辆且车辆出现在与该尺度层内匹配分数最高所对应的位置。A13) Select the scale layer corresponding to the highest matching score. If the matching score exceeds the threshold, it indicates that the vehicle is detected and the vehicle appears at the position corresponding to the highest matching score in the scale layer.

所述匹配分数具体为:The matching score is specifically:

其中,score为匹配分数,(x0,y0)为锚点,l0为尺度层数,为根模型的检测分数,为第i个部件模型的响应,vi为第i个部件模型相对于锚点的偏移量,b为偏移系数。Among them, score is the matching score, (x 0 ,y 0 ) is the anchor point, l 0 is the number of scale layers, is the detection score of the root model, is the response of the i-th component model, v i is the offset of the i-th component model relative to the anchor point, and b is the offset coefficient.

所述通过可变部件模型算法训练后的模型具体为:通过采用PCA方法对训练图片的HOG特征降维处理后进行特征提取,再通过隐变量支持向量机分类器进行模型训练,得到通过可变部件模型算法训练后的模型。The model trained by the variable part model algorithm is specifically: by adopting the PCA method to perform feature extraction after the HOG feature dimension reduction processing of the training picture, and then carry out model training through the hidden variable support vector machine classifier, and obtain the variable The model trained by the component model algorithm.

所述汽车判断检测到的车辆与本车之间的距离具体为:通过安装于汽车上的激光雷达进行测距,得到检测到的车辆与本车之间的距离。The car judging the distance between the detected vehicle and the own car is specifically: measuring the distance through the laser radar installed on the car to obtain the distance between the detected vehicle and the own car.

所述汽车对车道线进行识别具体为:汽车通过Hough变换,扫描图像中的共线点,实现对车道线的识别。The recognition of the lane lines by the car specifically includes: the car scans the collinear points in the image through Hough transform to realize the recognition of the lane lines.

所述预警包括通过LED预警面板闪烁实现预警和通过蜂鸣器鸣响实现预警。The early warning includes the flashing of the LED early warning panel and the sounding of the buzzer.

所述LED预警面板上设有至少分布在前后左右四个方向的LED预警灯。The LED early warning panel is provided with LED early warning lights distributed in at least four directions, front, back, left, and right.

与现有技术相比,本发明具有以下有益效果:Compared with the prior art, the present invention has the following beneficial effects:

(1)通过可变部件模型算法,对前视摄像头和后视摄像头拍摄到的图像进行车辆识别,继而再通过判断车辆与本车之间的距离关系和车辆与车道线之间的位置关系确定车辆与本车是否在超车过程中出现危险以及本车是否在超车过程中出现危险,这种方法与现有的通过雷达或短距离通信来进行识别的方法相比,识别速度快的同时识别的准确性也比较高,而且通过摄像头来进行识别的方法与雷达等相比价格成本较低。(1) Through the variable component model algorithm, the vehicle is recognized on the images captured by the front-view camera and the rear-view camera, and then determined by judging the distance relationship between the vehicle and the vehicle and the position relationship between the vehicle and the lane line Whether the vehicle and the own vehicle are in danger during the overtaking process and whether the own vehicle is in danger during the overtaking process, compared with the existing identification methods through radar or short-distance communication, this method has a faster identification speed and at the same time The accuracy is also relatively high, and the method of identifying through the camera is lower in price and cost than radar and the like.

(2)车辆通过后方车辆超车预警步骤和前方车辆超车预警步骤两个步骤相结合,对靠近本车安全范围内的车辆均实现全过程跟踪,即在本车后方的车辆在超车后再通过前方车辆超车预警步骤来进行监控,本车在超车后继续对超过的车辆通过后方车辆超车预警步骤来进行监控,保证了预警的完整性。(2) The vehicle passes through the two steps of the overtaking warning step of the rear vehicle and the overtaking warning step of the front vehicle, and realizes the whole process tracking of the vehicles close to the safe range of the vehicle, that is, the vehicle behind the vehicle passes the front after overtaking The vehicle overtaking warning step is used for monitoring. After overtaking, the vehicle continues to monitor the overtaking vehicle through the rear vehicle overtaking warning step to ensure the integrity of the warning.

(3)在通过可变部件模型算法对车辆进行识别检测时,通过构建尺度金字塔保证对各尺度下的拍摄图片均进行识别,并选取检测得分最高的图片作为车辆的识别位置,保证了检测的完整性,从而提高预警的精确程度。(3) When the vehicle is identified and detected by the variable component model algorithm, the scale pyramid is constructed to ensure that the photographed pictures at each scale are recognized, and the picture with the highest detection score is selected as the vehicle recognition position, which ensures the accuracy of the detection. Integrity, thereby improving the accuracy of early warning.

(4)通过可变部件模型算法对训练图片进行特征提取并训练得到模型,这种方法训练的模型精确程度较高,从而提高了最终预警的准确程度。(4) Extract the features of the training pictures and train the model through the variable part model algorithm. The model trained by this method has a higher degree of accuracy, thereby improving the accuracy of the final early warning.

(5)汽车通过Hough变换识别车道线,继而可以判断本车与预警车辆是否处于同一车道线内,从而在二者在同一车道线且距离缩小时及时对驾驶员发出预警,及时避免事故的发生。(5) The car recognizes the lane line through Hough transformation, and then can judge whether the car and the warning vehicle are in the same lane line, so that when the two are in the same lane line and the distance is reduced, the driver is warned in time to avoid accidents in time .

(6)通过LED灯闪烁和蜂鸣器鸣响同时来对驾驶员进行预警,最大程度的提示驾驶员危险情况的发生,提高了预警的安全性。(6) The driver is given an early warning by flashing the LED light and the sound of the buzzer at the same time, prompting the driver of the occurrence of dangerous situations to the greatest extent, and improving the safety of the early warning.

(7)LED预警面板上设有至少分布在前后左右四个方向的LED预警灯,可以将检测到的预警情况发生的位置通过LED预警灯来表示出来,便于驾驶员及时了解预警发生的位置,提高了预警的及时性。(7) The LED early warning panel is equipped with LED early warning lights distributed in at least four directions, front, rear, left, and right, and the position of the detected early warning situation can be indicated by the LED early warning light, so that the driver can know the location of the early warning in time, Improve the timeliness of early warning.

附图说明Description of drawings

图1为后方车辆超车预警步骤的方法流程图;Fig. 1 is the method flowchart of the overtaking early warning step of vehicle in the rear;

图2为前方车辆超车预警步骤的方法流程图;Fig. 2 is the method flowchart of vehicle overtaking early warning step in front;

图3为实现基于可变部件模型算法的汽车超车预警方法的汽车各模块布局图;Fig. 3 is the layout diagram of each module of the automobile realizing the automobile overtaking warning method based on the variable component model algorithm;

图4为摄像头的视角范围示意图;FIG. 4 is a schematic diagram of a viewing angle range of a camera;

图5为实施例中超车预警的整体方法流程图;Fig. 5 is the flow chart of the overall method of overtaking early warning in the embodiment;

图6为可变部件模型算法的模型图,其中,(6a)为第一视角下其中一个组件的根模型图,(6b)为第一视角下其中一个组件的部件模型图,(6c)为第一视角下的模型变形损失,(6d)为第二视角下其中一个组件的根模型图,(6e)为第二视角下其中一个组件的部件模型图,(6f)为第二视角下的模型变形损失;Fig. 6 is a model diagram of a variable component model algorithm, where (6a) is the root model diagram of one of the components in the first perspective, (6b) is the component model diagram of one of the components in the first perspective, and (6c) is Model deformation loss in the first viewing angle, (6d) is the root model graph of one of the components in the second viewing angle, (6e) is the part model graph of one of the components in the second viewing angle, (6f) is the root model graph of one of the components in the second viewing angle Model deformation loss;

图7为模型的匹配过程图;Fig. 7 is the matching process figure of model;

图8为LED预警面板示意图;Figure 8 is a schematic diagram of the LED early warning panel;

其中,111为车辆,301为预警模块,302为前视摄像头,303为数据处理模块,304为后视摄像头,401~406均为LED灯。Wherein, 111 is a vehicle, 301 is an early warning module, 302 is a front-view camera, 303 is a data processing module, 304 is a rear-view camera, 401-406 are all LED lights.

具体实施方式detailed description

下面结合附图和具体实施例对本发明进行详细说明。本实施例以本发明技术方案为前提进行实施,给出了详细的实施方式和具体的操作过程,但本发明的保护范围不限于下述的实施例。The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments. This embodiment is carried out on the premise of the technical solution of the present invention, and detailed implementation and specific operation process are given, but the protection scope of the present invention is not limited to the following embodiments.

本实施例提供的是一种基于可变部件模型算法的汽车超车预警方法包括下列步骤:What the present embodiment provides is a kind of vehicle overtaking warning method based on variable component model algorithm comprising the following steps:

后方车辆超车预警步骤,汽车通过后视摄像头结合可变部件模型算法对后方车辆进行识别,通过识别后方车辆与本车以及车道线之间的位置关系,判断后方车辆是否进行超车并向驾驶员发出预警,具体为:In the overtaking warning step of the rear vehicle, the car recognizes the rear vehicle through the rear view camera combined with the variable component model algorithm, and by identifying the positional relationship between the rear vehicle, the vehicle and the lane line, judges whether the rear vehicle is overtaking and sends a signal to the driver. Warning, specifically:

A1)汽车根据可变部件模型算法,检测后视摄像头的拍摄图像内是否出现其他车辆,若是则进入步骤A2),若否则继续检测:A1) The car detects whether other vehicles appear in the image captured by the rear-view camera according to the variable component model algorithm, and if so, proceeds to step A2), otherwise continues to detect:

A11)根据后视摄像头的拍摄图像,构建尺度金字塔;A11) Build a scale pyramid according to the photographed images of the rear-view camera;

A12)在尺度金字塔内的每个尺度层内,通过滑动窗口检测方法将图像与通过可变部件模型算法训练后的模型进行匹配,并计算匹配分数;A12) In each scale layer in the scale pyramid, the image is matched with the model trained by the variable component model algorithm by the sliding window detection method, and the matching score is calculated;

A13)选取最高匹配分数对应的尺度层,若该匹配分数超过阈值则表明检测到车辆且车辆出现在与该尺度层内匹配分数最高所对应的位置;A13) Select the scale layer corresponding to the highest matching score, if the matching score exceeds the threshold, it indicates that the vehicle is detected and the vehicle appears at the position corresponding to the highest matching score in the scale layer;

A2)汽车判断检测到的车辆与本车之间的距离是否减小,若是则进入步骤A3),若否则返回步骤A1);A2) The car judges whether the distance between the detected vehicle and the vehicle decreases, if so, enter step A3), otherwise return to step A1);

A3)汽车对车道线进行识别,并判断本车与检测到的车辆是否位于同一车道线内,若是则向驾驶员发出预警,若否则进行步骤A4);A3) The car recognizes the lane line, and judges whether the car and the detected vehicle are located in the same lane line, and if so, sends an early warning to the driver, otherwise proceeds to step A4);

A4)汽车在检测到的车辆从后视摄像头内消失后进入前方车辆超车预警步骤;A4) After the detected vehicle disappears from the rear view camera, the car enters the overtaking warning step of the vehicle in front;

前方车辆超车预警步骤,汽车通过前视摄像头结合可变部件模型算法对前方车辆进行识别,通过识别前方车辆与本车以及车道线之间的位置关系,判断本车是否需要进行超车并在超车有危险时向驾驶员发出预警,具体为:In the overtaking warning step of the vehicle in front, the car recognizes the vehicle in front through the front-view camera combined with the variable component model algorithm. By identifying the positional relationship between the vehicle in front, the vehicle and the lane line, it is judged whether the vehicle needs to overtake and whether the overtaking is necessary. Alert the driver in case of danger, specifically:

B1)汽车根据可变部件模型算法,检测前视摄像头的拍摄图像内是否出现其他车辆,若是则进入步骤B2),若否则继续检测;B1) The car detects whether other vehicles appear in the image taken by the front-view camera according to the variable component model algorithm, if so, enters step B2), otherwise continues to detect;

B2)汽车判断检测到的车辆与本车之间的距离是否减小,若是则进入步骤B3),若否则返回步骤B1);B2) the car judges whether the distance between the detected vehicle and the vehicle decreases, if so, enter step B3), otherwise return to step B1);

B3)汽车对车道线进行识别,并判断本车与检测到的车辆是否位于同一车道线内,若是则向驾驶员发出预警,若否则进行步骤B4);B3) The car recognizes the lane line, and judges whether the car and the detected vehicle are located in the same lane line, and if so, sends an early warning to the driver, otherwise proceeds to step B4);

B4)汽车在检测到的车辆从前视摄像头内消失后进入后方车辆超车预警步骤。B4) The car enters the rear vehicle overtaking warning step after the detected vehicle disappears from the front view camera.

上述步骤的具体过程如下:The specific process of the above steps is as follows:

如图3所示,是实现基于可变部件模型算法的汽车超车预警方法的汽车各模块布局图,前视摄像头302安装与前挡风玻璃上方中间,用于收集车辆111前方160°视角的路况信息,后视摄像头304安装于后挡风玻璃上方中间,用于收集车辆111后方160°视角的路况信息,数据处理模块303分析计算前视摄像头302,后视摄像头304的图像信息,经计算识别出图像中的其他车辆及车道线,追踪在视野中的车辆,由于其他临近车辆的超车及变道对车辆111的安全行驶造成影响时,数据处理模块303向预警模块301发送信息,预警模块301发出警报,并将相应情况反映在LED预警面板上,预警模块301由蜂鸣器及LED预警面板组成,置于中控台之上。该摄像头的视角范围如图4所示,本实施例中,前视摄像头与后视摄像头的视角范围都为160°,所收集的视频能够在有效范围内辨识出相邻两车道内的车辆及车道线信息。As shown in Figure 3, it is the layout diagram of each module of the car that realizes the car overtaking warning method based on the variable component model algorithm. The front view camera 302 is installed in the middle of the top of the front windshield, and is used to collect the road conditions of the 160° angle of view in front of the vehicle 111. information, the rear view camera 304 is installed in the middle of the rear windshield top, and is used to collect the road condition information of the 160° angle of view behind the vehicle 111. The data processing module 303 analyzes and calculates the image information of the front view camera 302 and the rear view camera 304, and recognizes them through calculation The other vehicles and lane lines in the image are tracked, and the vehicles in the field of view are tracked. When the overtaking and lane changing of other adjacent vehicles affect the safe driving of the vehicle 111, the data processing module 303 sends information to the early warning module 301, and the early warning module 301 An alarm is issued, and the corresponding situation is reflected on the LED early warning panel. The early warning module 301 is composed of a buzzer and an LED early warning panel, and is placed on the center console. The viewing angle range of the camera is as shown in Figure 4. In this embodiment, the viewing angle ranges of the front-view camera and the rear-view camera are all 160°, and the collected video can identify the vehicles and vehicles in the adjacent two lanes within the effective range. Lane marking information.

基于上述部件,最终提出的基于可变部件模型算法的汽车超车预警方法如图5所示,主要步骤为:数据处理模块303通过后视摄像头304的信息,检测到有车辆从后方驶来,对驶来的车辆跟踪,然后判断该车辆与本车辆的距离是否缩短,若该车辆已远离本车辆,则放弃追踪。若该车辆与本车辆距离缩短到安全距离之内,数据处理模块303通过识别车道线及该车辆,做出判断该车辆是否与本车辆处于同一车道线之内,若本车辆与该车辆在同一车道线之内,则报警模块向驾驶员发出警报,提醒驾驶员有可能发生后方车辆追尾事故。若该车辆与本车辆不在同一车道线之内,则对该车辆继续追踪,当该车辆消失在后视摄像头视野中时,说明该车辆位于本车辆的盲区之内,预警模块发出警报,提醒驾驶员有车辆位于本车辆的盲区之内,不要再该情况下变道。该车辆继续向前行驶,出现在前视摄像头302的视野之内,数字处理模块303通过前视摄像头302检测到该车辆,对该车辆继续跟踪,若该车辆在相邻车道内远离本车辆,则停止追踪,若该车辆从相邻车道变道到本车所在车道,则预警模块向驾驶员发出报警,提醒驾驶员前方车辆变道,注意减速避让。Based on the above components, the vehicle overtaking warning method based on the variable component model algorithm finally proposed is shown in Figure 5, the main steps are: the data processing module 303 detects that a vehicle is coming from the rear through the information of the rear-view camera 304, and The approaching vehicle is tracked, and then it is judged whether the distance between the vehicle and the vehicle is shortened, and if the vehicle is far away from the vehicle, the tracking is abandoned. If the distance between the vehicle and the vehicle is shortened to within a safe distance, the data processing module 303 can judge whether the vehicle is in the same lane line as the vehicle by identifying the lane line and the vehicle. If it is within the lane line, the alarm module will send an alarm to the driver, reminding the driver that a rear-end collision accident may occur. If the vehicle is not within the same lane line as the vehicle, continue to track the vehicle. When the vehicle disappears from the view of the rear-view camera, it means that the vehicle is in the blind spot of the vehicle, and the early warning module sends out an alarm to remind the driver Do not change lanes if other vehicles are located in the blind spot of your own vehicle. The vehicle continues to move forward and appears in the field of view of the front-view camera 302. The digital processing module 303 detects the vehicle through the front-view camera 302 and continues to track the vehicle. If the vehicle is far away from the vehicle in the adjacent lane, Then stop tracking. If the vehicle changes lanes from the adjacent lane to the lane where the vehicle is located, the early warning module will send an alarm to the driver to remind the driver to change lanes of the vehicle ahead and pay attention to slow down and avoid.

上述是车辆被其他车辆超越的场景,超越其他的车辆场景下步骤为:数据处理模块303通过前视摄像头302检测到本车辆前方有车辆,对该车辆跟踪,若该车辆与本车辆距离变大,停止对该车辆跟踪。若该车辆与本车辆距离缩短,则数据处理模块303判断该车辆是否与本车辆处于同一车道线之内。若处于同一车道线之内,则预警模块301向驾驶员发出预警,提醒驾驶员前方可能会发生追尾事故,注意减速避让,若该车辆位于相邻车道,则继续对该车辆跟踪,当该车辆消失在前视摄像头302视野中时,说明该车辆位于本车辆的盲区内,预警模块向驾驶员发出预警,提醒驾驶员盲区内有车辆,在该请款下不能变道。本车辆超越该车辆继续向前行驶,当该车辆出现在后视摄像头304视野中时,对该车辆追踪,该车辆远离之后,停止对该车辆追踪。The above is the scene where the vehicle is overtaken by other vehicles. The steps in the overtaking other vehicle scene are: the data processing module 303 detects that there is a vehicle in front of the vehicle through the front-view camera 302, and tracks the vehicle. If the distance between the vehicle and the vehicle becomes larger , stop tracking the vehicle. If the distance between the vehicle and the host vehicle is shortened, the data processing module 303 determines whether the vehicle is within the same lane line as the host vehicle. If it is within the same lane line, the early warning module 301 sends an early warning to the driver, reminding the driver that a rear-end collision may occur ahead, and pay attention to slowing down and avoiding. If the vehicle is located in an adjacent lane, then continue to track the vehicle. When disappearing in the front view camera 302 field of view, it means that the vehicle is located in the blind spot of the vehicle, and the early warning module sends an early warning to the driver, reminding the driver that there is a vehicle in the blind spot, and the vehicle cannot change lanes under this request. The vehicle overtakes the vehicle and continues to drive forward. When the vehicle appears in the field of view of the rear view camera 304, the vehicle is tracked. After the vehicle moves away, the vehicle is stopped.

为了将摄像机采集到环境数据与车辆行驶环境中的真实物体相对应,找到摄像机所生成的图像像素坐标系中的点坐标与摄像机环境坐标系中物点坐标之间的转换关系,需要对摄像机进行标定。本方法采用摄像机和激光雷达联合标定,通过提取标定物在单线激光雷达和图像上对应的特征点来进行摄像机外部参数的标定,从而完成单线激光坐标、摄像机坐标、图像像素坐标传感器坐标的统一,实现激光雷达与摄像机的空间对准。In order to correspond the environmental data collected by the camera with the real objects in the driving environment of the vehicle, and to find the conversion relationship between the point coordinates in the pixel coordinate system of the image generated by the camera and the object point coordinates in the camera environment coordinate system, it is necessary to carry out the camera calibration. This method adopts the joint calibration of the camera and the laser radar, and calibrates the external parameters of the camera by extracting the corresponding feature points of the calibration object on the single-line laser radar and the image, thereby completing the unification of the single-line laser coordinates, camera coordinates, and image pixel coordinates. Enables spatial alignment of lidar and camera.

摄像机和激光雷达联合标定,激光雷达及摄像机都与汽车为刚性连接,它们各自的相对姿态和位移固定不变,在同一空间内,每个激光雷达的扫描数据点都在图像中存在位移的一个对应点。因此,通过建立合理的激光雷达坐标系与摄像机坐标系,利用激光雷达扫描点与摄像机图像的空间约束关系,即可求解两坐标系的空间变换关系,从而完成激光雷达与摄像机的空间对准,实现激光雷达数据与可见光图像的关联。摄像机的外部参数通过约束方程求解后,激光雷达、摄像机、图像和相对环境坐标系的相对关系就完全确定,因此激光雷达扫描点可以通过摄像机模型头投影至图像像素坐标上。其像素级数据融合可由下面的方程完成:其中,为摄像机的内部参数矩阵。当摄像机与激光雷达同时观测点P时,其在摄像机自身环境坐标系中的坐标为Pvc(xvc,yvc,zvc),在可见光图像中投影点的坐标为U=(u v 1)T在雷达自身世界坐标中的坐标为Plc(xlc,ylc,zlc)。由于摄像机与激光雷达使用了同一个环境坐标系,则有其中H为激光雷达的安装高度。上面两式联立,可得:其中,由激光雷达的外参标定和摄像机的内参标定可获得和Xlc。综上,通过提取足够多的图像雷达对应点对,通过求解线性方程即可获得相关的坐标旋转矩阵和坐标平移矩阵进而可得到激光雷达数据和其对应图像像素间的变换关系。The joint calibration of the camera and the lidar, the lidar and the camera are rigidly connected to the car, and their respective relative attitudes and displacements are fixed. In the same space, each scanning data point of the lidar has a displacement in the image. corresponding point. Therefore, by establishing a reasonable lidar coordinate system and camera coordinate system, and using the spatial constraint relationship between the lidar scanning point and the camera image, the spatial transformation relationship between the two coordinate systems can be solved, thereby completing the spatial alignment of the lidar and the camera. Realize the correlation of lidar data and visible light image. After the external parameters of the camera are solved through the constraint equation, the relative relationship between the lidar, the camera, the image and the relative environment coordinate system is completely determined, so the lidar scanning point can be projected onto the image pixel coordinates through the camera model head. Its pixel-level data fusion can be completed by the following equation: in, is the internal parameter matrix of the camera. When the camera and the lidar observe point P at the same time, its coordinates in the camera's own environment coordinate system are P vc (x vc , y vc , z vc ), and the coordinates of the projected point in the visible light image are U=(uv 1) The coordinates of T in the radar's own world coordinates are P lc (x lc , y lc , z lc ). Since the camera and lidar use the same environment coordinate system, there is Where H is the installation height of the lidar. Combining the above two formulas, we can get: in, It can be obtained by the external reference calibration of the lidar and the internal reference calibration of the camera and Xlc . In summary, by extracting enough image radar corresponding point pairs, the relevant coordinate rotation matrix can be obtained by solving the linear equation and coordinate translation matrix Furthermore, the transformation relationship between the lidar data and its corresponding image pixels can be obtained.

可变部件模型算法,是一种目标检测算法,可变部件模型采用PCA(主成分分析法)对HOG(梯度方向直方图)特征进行降维处理后进行特征提取;在模型训练中,采用LatentSVM(隐变量支持向量机)分类器,在目标检测时,采用滑动窗口的检测思想;针对目标的多视角问题,采用多组件策略,分别在不同视角下建立不同模型;针对目标的变形问题,采用基于图结构的部件模型策略。具体的,可变部件模型算法,采用一种星形模型,该星形模型由一个大体上覆盖整个目标的根模型及覆盖目标中小部件的高分辨率的部件模型构成。根模型定义了检测窗口,部件模型放置在分辨率是根所在层的两倍的特征层中。The variable component model algorithm is a target detection algorithm. The variable component model uses PCA (Principal Component Analysis) to perform dimensionality reduction processing on HOG (Histogram of Gradient Oriented) features and then extracts features; in model training, LatentSVM is used The (hidden variable support vector machine) classifier adopts the detection idea of sliding window when detecting the target; for the multi-view problem of the target, it adopts a multi-component strategy to build different models under different perspectives; for the deformation problem of the target, it adopts A component model strategy based on graph structure. Specifically, the variable component model algorithm adopts a star model, which is composed of a root model that generally covers the entire target and a high-resolution component model that covers small components in the target. The root model defines the detection window, and the part model is placed in a feature layer with twice the resolution of the root layer.

可变部件模型算法的特征采用了HOG特征,并对HOG特征进行了一些改进。可变部件模型算法取消了原HOG特征中的block,保留cell,归一化时直接将当前cell与其周围的4个cell所组成的一个区域归一化。计算梯度方向时,采用了有符号梯度(0-360°)和无符号梯度(0-180°)相结合的策略。The features of the variable part model algorithm adopt the HOG feature, and make some improvements to the HOG feature. The variable part model algorithm cancels the block in the original HOG feature, retains the cell, and directly normalizes an area composed of the current cell and the four surrounding cells when normalizing. When calculating the gradient direction, a strategy combining signed gradient (0-360°) and unsigned gradient (0-180°) is adopted.

可变部件模型算法的模型,每一个组件由一个根滤模型和多个部件模型组成。图6(a)和图6(b)是其中一个组件的根模型和部件模型的可视化效果。如图6(a)根模型比较粗糙,大致呈现一个车辆的侧面,如图6(b)部件模型为矩形框内的部分,共6个部分,部件模型的分辨率是根模型的两倍。图6(c)为模型的变形损失,越亮的区域表示变形损失花费越大,圆圈中心是部件模型的理性位置,如果检测出来的部件模型的位置恰好在此,那变形花费就为0,偏离的越远变形花费越大。对于多视角问题,采用多组件策略,图6(a)(b)(c)和图6(d)(e)(f)分别为两个不同视角的组件。The model of the variable component model algorithm, each component is composed of a root filter model and multiple component models. Figure 6(a) and Figure 6(b) are visualizations of the root model and part model of one of the components. As shown in Figure 6(a), the root model is relatively rough, roughly showing the side of a vehicle. As shown in Figure 6(b), the component model is a part inside a rectangular frame, with a total of 6 parts, and the resolution of the component model is twice that of the root model. Figure 6(c) shows the deformation loss of the model. The brighter the area, the greater the cost of deformation loss. The center of the circle is the rational position of the component model. If the detected position of the component model happens to be here, the deformation cost will be 0. The farther the deviation is, the more expensive the deformation will be. For multi-view problems, a multi-component strategy is adopted, and Figure 6(a)(b)(c) and Figure 6(d)(e)(f) are components of two different views respectively.

可变部件模型算法,在算法的检测方面,可变部件模型采用滑动窗口检测方式,通过构建尺度金字塔在各个尺度搜索。如图7所示为某一尺度下检测过程,即车辆模型的匹配过程。将模型看作一个滤波算子,响应得分为特征与待匹配模型的相似程度,越相似则得分越高。如图7所示,左侧为根模型的检测流程,越亮的区域代表响应得分越高。右侧为各部件模型的检测过程。首先,将特征图像与模型进行匹配得到滤波后的图像;然后,进行相应变换:以锚点(即左上角坐标)为参考位置,综合部件模型与特征的匹配程度和部件模型相对理想位置的变形花费(偏离损失),得到最优的部件模型位置和相应得分。在尺度为l0层,以(x0,y0)为锚点的检测得分,如下公式所示:其中,为根模型的检测分数。由于同一个目标有多个组件,而不同组件模型的检测分数需要对齐,所以需要偏移系数b。为第i个部件模型的响应,由于部件模型的分辨率是根模型的一倍,因此部件模型需要在尺度层l0-λ匹配。因此,锚点的坐标也需要重新映射到尺度层l0-λ,即放大了一倍2(x0,y0),部件模型i相对于锚点2(x0,y0)的偏移量vi,所以在尺度层l0-λ,部件模型i的理想位置为2(x0,y0)+viAlgorithm of the variable part model. In terms of algorithm detection, the variable part model adopts a sliding window detection method, and searches at various scales by building a scale pyramid. As shown in Figure 7, the detection process at a certain scale, that is, the matching process of the vehicle model. The model is regarded as a filter operator, and the response score is the degree of similarity between the feature and the model to be matched, and the more similar, the higher the score. As shown in Figure 7, the detection process of the root model is on the left, and the brighter the area, the higher the response score. On the right is the detection process of each component model. First, match the feature image with the model to obtain the filtered image; then, perform the corresponding transformation: take the anchor point (ie, the coordinates of the upper left corner) as the reference position, and integrate the degree of matching between the component model and the feature and the deformation of the component model relative to the ideal position cost (deviation loss), to get the optimal part model position and corresponding score. In the scale l 0 layer, the detection score with (x 0 , y 0 ) as the anchor point is shown in the following formula: in, is the detection score of the root model. Since the same target has multiple components, and the detection scores of different component models need to be aligned, the offset factor b is required. For the response of the i-th component model, since the resolution of the component model is twice that of the root model, the component model needs to be matched at the scale level l 0 -λ. Therefore, the coordinates of the anchor point also need to be remapped to the scale layer l 0 -λ, that is, doubled by 2(x 0 ,y 0 ), the offset of component model i relative to the anchor point 2(x 0 ,y 0 ) The quantity v i , so in the scale layer l 0 -λ, the ideal position of component model i is 2(x 0 ,y 0 )+v i .

hough变换在直线检测时,每个像素坐标点经过hough变换成为一系列离散点的集合。通过一个直线的离散极坐标公式,可以表达出直线的离散点几何等式如下:r=x cosθ+y sinθ,其中角度θ指r与x轴之间的夹角,r为到直线几何垂直距离。我们根据像素点坐标(x,y)的值绘制每个(r,θ),那么从图像笛卡尔坐标系转换到极坐标hough变换系统,这种熊点到曲线的变换称为直线的hough变换。变换通过量化hough参数空间为有限个值间隔等分或累加格子。Hough变换算法开始,每个像素坐标点(x,y)被转换到(r,θ)的曲线点上面,累加到对应的格子数据点,当一个波峰出现时,说明有直线存在。When hough transform detects a straight line, each pixel coordinate point becomes a set of discrete points after hough transform. Through the discrete polar coordinate formula of a straight line, the geometric equation of the discrete points of the straight line can be expressed as follows: r=x cosθ+y sinθ, where the angle θ refers to the angle between r and the x-axis, and r is the geometric vertical distance to the straight line . We draw each (r, θ) according to the value of the pixel point coordinates (x, y), then convert from the image Cartesian coordinate system to the polar coordinate hough transformation system, this bear point to curve transformation is called the hough transformation of a straight line . The transform quantizes the hough parameter space into a finite number of valued intervals that equally divide or accumulate a grid. At the beginning of the Hough transform algorithm, each pixel coordinate point (x, y) is converted to the curve point (r, θ) and accumulated to the corresponding grid data point. When a peak appears, it means that there is a straight line.

hough变换算法的检测过程如下:首先在参数空间建立一个二维计数器R(r,θ),r的范围是0到图像对角线的长度,θ的范围是0到2π,数组中的所有值初始化为0;然后,扫描图像空间中所有像素点(x,y),hough变换式进行图像空间到参数空间的变换(r,θ),并且计数器R(r,θ)加1;第三步,设定阈值thr(r,θ),即判断图像中有多少个点共线才认为存在直线,R(r,θ)大于thr(r,θ),则组成图像中的图像。The detection process of the hough transform algorithm is as follows: first, a two-dimensional counter R(r, θ) is established in the parameter space, the range of r is 0 to the length of the diagonal of the image, the range of θ is 0 to 2π, and all values in the array Initialize to 0; then, scan all pixels (x, y) in the image space, the hough transform transforms the image space to the parameter space (r, θ), and the counter R (r, θ) is increased by 1; the third step , set the threshold thr(r, θ), that is, judge how many points in the image are collinear to consider that there is a straight line, and if R(r, θ) is greater than thr(r, θ), the image in the image will be composed.

图8是LED预警面板示意图,面板上有6个LED灯,当其他车辆出现在本车左侧盲区时LED灯401闪烁;当其他车辆出现在本车右侧盲区时LED灯406闪烁;当有其他车辆与本车在同一车道并位于本车尾部,该车辆与本车辆距离过小时,LED灯404闪烁;当有其他车辆与本车在同一车道并位于本车前方,该车辆与本车辆距离过小时,LED灯403闪烁;前方左侧车道内车辆变道到与本车统一车道时,LED灯402闪烁;前方右侧车道内车辆变道到与本车统一车道时,LED灯405闪烁。Fig. 8 is a schematic diagram of the LED early warning panel. There are 6 LED lights on the panel. When other vehicles appear in the blind spot on the left side of the car, the LED light 401 flickers; When other vehicles are in the same lane as the vehicle and are located at the rear of the vehicle, and the distance between the vehicle and the vehicle is too small, the LED light 404 will flash; When the hour is too long, the LED light 403 flickers; when the vehicle in the left lane ahead changes lanes to the same lane as the car, the LED light 402 flickers; when the vehicle in the right lane ahead changes lanes to the same lane as the car, the LED light 405 flickers.

综上所述,本实施例提供了一种基于可变部件模型算法的汽车超车预警方法,首先通过前视摄像头及后视摄像头采集的图像,对数据处理模块进行训练,使其运用训练得出的模型能够在实际场景中识别出车辆及车道线,并对车辆进行跟踪,从而判断其他车辆在本车辆周围变道及超车等可能对本车辆造成危险的相关情况,并向驾驶员发送对应场景的预警,从而使驾驶员能够提早规避相关事故的发生。To sum up, this embodiment provides a vehicle overtaking early warning method based on variable component model algorithm. First, the data processing module is trained through the images collected by the front-view camera and the rear-view camera, so that it can use the training to obtain The model can identify the vehicle and the lane line in the actual scene, and track the vehicle, so as to judge other vehicles changing lanes and overtaking around the vehicle, which may cause danger to the vehicle, and send the corresponding scene information to the driver. Early warning, so that the driver can avoid the occurrence of related accidents in advance.

Claims (10)

1.一种基于可变部件模型算法的汽车超车预警方法,其特征在于,所述方法包括下列步骤:1. an automobile overtaking warning method based on variable component model algorithm, is characterized in that, described method comprises the following steps: 后方车辆超车预警步骤,汽车通过后视摄像头结合可变部件模型算法对后方车辆进行识别,通过识别后方车辆与本车以及车道线之间的位置关系,判断后方车辆是否进行超车并向驾驶员发出预警;In the overtaking warning step of the rear vehicle, the car recognizes the rear vehicle through the rear view camera combined with the variable component model algorithm, and by identifying the positional relationship between the rear vehicle, the vehicle and the lane line, judges whether the rear vehicle is overtaking and sends a signal to the driver. early warning; 前方车辆超车预警步骤,汽车通过前视摄像头结合可变部件模型算法对前方车辆进行识别,通过识别前方车辆与本车以及车道线之间的位置关系,判断本车是否需要进行超车并在超车有危险时向驾驶员发出预警。In the overtaking warning step of the vehicle in front, the car recognizes the vehicle in front through the front-view camera combined with the variable component model algorithm. By identifying the positional relationship between the vehicle in front, the vehicle and the lane line, it is judged whether the vehicle needs to overtake and whether the overtaking is necessary. Alerts the driver in case of danger. 2.根据权利要求1所述的基于可变部件模型算法的汽车超车预警方法,其特征在于,所述后方车辆超车预警步骤具体为:2. the automobile overtaking early warning method based on variable component model algorithm according to claim 1, is characterized in that, described rear vehicle overtaking early warning step is specifically: A1)汽车根据可变部件模型算法,检测后视摄像头的拍摄图像内是否出现其他车辆,若是则进入步骤A2),若否则继续检测;A1) The car detects whether other vehicles appear in the image captured by the rear-view camera according to the variable component model algorithm, and if so, enters step A2), otherwise continues to detect; A2)汽车判断检测到的车辆与本车之间的距离是否减小,若是则进入步骤A3),若否则返回步骤A1);A2) The car judges whether the distance between the detected vehicle and the vehicle decreases, if so, enter step A3), otherwise return to step A1); A3)汽车对车道线进行识别,并判断本车与检测到的车辆是否位于同一车道线内,若是则向驾驶员发出预警,若否则进行步骤A4);A3) The car recognizes the lane line, and judges whether the car and the detected vehicle are located in the same lane line, and if so, sends an early warning to the driver, otherwise proceeds to step A4); A4)汽车在检测到的车辆从后视摄像头内消失后进入前方车辆超车预警步骤。A4) After the detected vehicle disappears from the rear view camera, the car enters the overtaking warning step of the vehicle in front. 3.根据权利要求1所述的基于可变部件模型算法的汽车超车预警方法,其特征在于,所述前方车辆超车预警步骤具体为:3. the automobile overtaking early warning method based on variable component model algorithm according to claim 1, is characterized in that, described front vehicle overtaking early warning step is specifically: B1)汽车根据可变部件模型算法,检测前视摄像头的拍摄图像内是否出现其他车辆,若是则进入步骤B2),若否则继续检测;B1) The car detects whether other vehicles appear in the image taken by the front-view camera according to the variable component model algorithm, if so, enters step B2), otherwise continues to detect; B2)汽车判断检测到的车辆与本车之间的距离是否减小,若是则进入步骤B3),若否则返回步骤B1);B2) the car judges whether the distance between the detected vehicle and the vehicle decreases, if so, enter step B3), otherwise return to step B1); B3)汽车对车道线进行识别,并判断本车与检测到的车辆是否位于同一车道线内,若是则向驾驶员发出预警,若否则进行步骤B4);B3) The car recognizes the lane line, and judges whether the car and the detected vehicle are located in the same lane line, if so, an early warning is issued to the driver, otherwise step B4); B4)汽车在检测到的车辆从前视摄像头内消失后进入后方车辆超车预警步骤。B4) The car enters the rear vehicle overtaking warning step after the detected vehicle disappears from the front view camera. 4.根据权利要求2或3所述的基于可变部件模型算法的汽车超车预警方法,其特征在于,所述可变部件模型算法具体为:4. The automobile overtaking warning method based on variable component model algorithm according to claim 2 or 3, is characterized in that, described variable component model algorithm is specifically: A11)根据后视摄像头的拍摄图像,构建尺度金字塔;A11) Build a scale pyramid according to the photographed images of the rear-view camera; A12)在尺度金字塔内的每个尺度层内,通过滑动窗口检测方法将图像与通过可变部件模型算法训练后的模型进行匹配,并计算匹配分数;A12) In each scale layer in the scale pyramid, the image is matched with the model trained by the variable component model algorithm by the sliding window detection method, and the matching score is calculated; A13)选取最高匹配分数对应的尺度层,若该匹配分数超过阈值则表明检测到车辆且车辆出现在与该尺度层内匹配分数最高所对应的位置。A13) Select the scale layer corresponding to the highest matching score. If the matching score exceeds the threshold, it indicates that the vehicle is detected and the vehicle appears at the position corresponding to the highest matching score in the scale layer. 5.根据权利要求4所述的基于可变部件模型算法的汽车超车预警方法,其特征在于,所述匹配分数具体为:5. the automobile overtaking warning method based on variable component model algorithm according to claim 4, is characterized in that, described matching score is specifically: <mrow> <mi>s</mi> <mi>c</mi> <mi>o</mi> <mi>r</mi> <mi>e</mi> <mrow> <mo>(</mo> <msub> <mi>x</mi> <mn>0</mn> </msub> <mo>,</mo> <msub> <mi>y</mi> <mn>0</mn> </msub> <mo>,</mo> <msub> <mi>l</mi> <mn>0</mn> </msub> <mo>)</mo> </mrow> <mo>=</mo> <msub> <mi>R</mi> <mrow> <mn>0</mn> <mo>,</mo> <msub> <mi>l</mi> <mn>0</mn> </msub> </mrow> </msub> <mrow> <mo>(</mo> <msub> <mi>x</mi> <mn>0</mn> </msub> <mo>,</mo> <msub> <mi>y</mi> <mn>0</mn> </msub> <mo>)</mo> </mrow> <mo>+</mo> <munderover> <mo>&amp;Sigma;</mo> <mrow> <mi>i</mi> <mo>=</mo> <mn>1</mn> </mrow> <mi>n</mi> </munderover> <msub> <mi>D</mi> <mrow> <mi>i</mi> <mo>,</mo> <msub> <mi>l</mi> <mn>0</mn> </msub> <mo>-</mo> <mi>&amp;lambda;</mi> </mrow> </msub> <mrow> <mo>(</mo> <mn>2</mn> <mo>(</mo> <mrow> <msub> <mi>x</mi> <mn>0</mn> </msub> <mo>,</mo> <msub> <mi>y</mi> <mn>0</mn> </msub> </mrow> <mo>)</mo> <mo>+</mo> <msub> <mi>v</mi> <mi>i</mi> </msub> <mo>)</mo> </mrow> <mo>+</mo> <mi>b</mi> </mrow> <mrow> <mi>s</mi> <mi>c</mi> <mi>o</mi> <mi>r</mi> <mi>e</mi> <mrow> <mo>(</mo> <msub> <mi>x</mi> <mn>0</mn> </msub> <mo>,</mo> <msub> <mi>y</mi> <mn>0</mn> </msub> <mo>,</mo> <msub> <mi>l</mi> <mn>0</mn> </msub> <mo>)</mo> </mrow> <mo>=</mo> <msub> <mi>R</mi> <mrow> <mn>0</mn> <mo>,</mo> <msub> <mi>l</mi> <mn>0</mn> </msub> </mrow> </msub> <mrow> <mo>(</mo> <msub> <mi>x</mi> <mn>0</mn> </msub> <mo>,</mo> <msub> <mi>y</mi> <mn>0</mn> </msub> <mo>)</mo> </mrow> <mo>+</mo> <munderover> <mo>&amp;Sigma;</mo> <mrow> <mi>i</mi> <mo>=</mo> <mn>1</mn> </mrow> <mi>n</mi> </munderover> <msub> <mi>D</mi> <mrow> <mi>i</mi> <mo>,</mo> <msub> <mi>l</mi> <mn>0</mn> </msub> <mo>-</mo> <mi>&amp;lambda;</mi> </mrow> </msub> <mrow> <mo>(</mo> <mn>2</mn> <mo>(</mo> <mrow> <msub> <mi>x</mi> <mn>0</mn> </msub> <mo>,</mo> <msub> <mi>y</mi> <mn>0</mn> </msub> </mrow> <mo>)</mo> <mo>+</mo> <msub> <mi>v</mi> <mi>i</mi> </msub> <mo>)</mo> </mrow> <mo>+</mo> <mi>b</mi> </mrow> 其中,score为匹配分数,(x0,y0)为锚点,l0为尺度层数,为根模型的检测分数,为第i个部件模型的响应,vi为第i个部件模型相对于锚点的偏移量,b为偏移系数。Among them, score is the matching score, (x 0 ,y 0 ) is the anchor point, l 0 is the number of scale layers, is the detection score of the root model, is the response of the i-th component model, v i is the offset of the i-th component model relative to the anchor point, and b is the offset coefficient. 6.根据权利要求4所述的基于可变部件模型算法的汽车超车预警方法,其特征在于,所述通过可变部件模型算法训练后的模型具体为:通过采用PCA方法对训练图片的HOG特征降维处理后进行特征提取,再通过隐变量支持向量机分类器进行模型训练,得到通过可变部件模型算法训练后的模型。6. the automobile overtaking warning method based on variable component model algorithm according to claim 4, is characterized in that, described model after the training by variable component model algorithm is specifically: by adopting PCA method to the HOG feature of training picture After dimensionality reduction, feature extraction is carried out, and then model training is carried out through the latent variable support vector machine classifier, and the model trained by the variable component model algorithm is obtained. 7.根据权利要求2或3所述的基于可变部件模型算法的汽车超车预警方法,其特征在于,所述汽车判断检测到的车辆与本车之间的距离具体为:通过安装于汽车上的激光雷达进行测距,得到检测到的车辆与本车之间的距离。7. The vehicle overtaking warning method based on the variable component model algorithm according to claim 2 or 3, wherein the distance between the vehicle and the vehicle detected by the vehicle is specifically: by installing on the vehicle The laser radar is used to measure the distance, and the distance between the detected vehicle and the vehicle is obtained. 8.根据权利要求2或3所述的基于可变部件模型算法的汽车超车预警方法,其特征在于,所述汽车对车道线进行识别具体为:汽车通过Hough变换,扫描图像中的共线点,实现对车道线的识别。8. The vehicle overtaking early warning method based on the variable component model algorithm according to claim 2 or 3, wherein the vehicle recognizes the lane lines as follows: the vehicle scans collinear points in the image through Hough transform , to realize the recognition of lane lines. 9.根据权利要求1所述的基于可变部件模型算法的汽车超车预警方法,其特征在于,所述预警包括通过LED预警面板闪烁实现预警和通过蜂鸣器鸣响实现预警。9. The vehicle overtaking early warning method based on the variable component model algorithm according to claim 1, wherein the early warning includes the flashing of the LED early warning panel and the sounding of the buzzer to realize the early warning. 10.根据权利要求9所述的基于可变部件模型算法的汽车超车预警方法,其特征在于,所述LED预警面板上设有至少分布在前后左右四个方向的LED预警灯。10. The vehicle overtaking early warning method based on the variable component model algorithm according to claim 9, wherein the LED early warning panel is provided with LED early warning lights distributed in at least four directions, front, rear, left, and right.
CN201710318142.6A 2017-05-08 2017-05-08 A kind of automobile overtaking's method for early warning based on units of variance model algorithm Pending CN107229906A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710318142.6A CN107229906A (en) 2017-05-08 2017-05-08 A kind of automobile overtaking's method for early warning based on units of variance model algorithm

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710318142.6A CN107229906A (en) 2017-05-08 2017-05-08 A kind of automobile overtaking's method for early warning based on units of variance model algorithm

Publications (1)

Publication Number Publication Date
CN107229906A true CN107229906A (en) 2017-10-03

Family

ID=59933777

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710318142.6A Pending CN107229906A (en) 2017-05-08 2017-05-08 A kind of automobile overtaking's method for early warning based on units of variance model algorithm

Country Status (1)

Country Link
CN (1) CN107229906A (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107985189A (en) * 2017-10-26 2018-05-04 西安科技大学 Towards driver's lane change Deep Early Warning method under scorch environment
CN108714304A (en) * 2018-04-02 2018-10-30 网易(杭州)网络有限公司 Overtake other vehicles display methods and device in a kind of game
CN108847026A (en) * 2018-05-31 2018-11-20 安徽四创电子股份有限公司 A method of it is converted based on matrix coordinate and realizes that data investigation is shown
CN110509880A (en) * 2019-09-24 2019-11-29 上海为彪汽配制造有限公司 Automobile rear blind monitoring system and method, radar control box
CN110525333A (en) * 2018-05-23 2019-12-03 上海擎感智能科技有限公司 A kind of passing behavior monitoring method and system, car-mounted terminal based on car-mounted terminal
CN110588518A (en) * 2019-09-24 2019-12-20 上海为彪汽配制造有限公司 Automobile rear detection system and method and radar control box
CN110775057A (en) * 2019-08-29 2020-02-11 浙江零跑科技有限公司 Lane assist method for steering torque control based on vehicle blind spot visual scene analysis
CN112328970A (en) * 2020-11-05 2021-02-05 深圳壹账通智能科技有限公司 Accident prediction method and system based on vehicle performance parameters
CN112721931A (en) * 2021-01-18 2021-04-30 智马达汽车有限公司 Vehicle meeting method, device, equipment and storage medium
CN114023109A (en) * 2021-11-03 2022-02-08 中国矿业大学 Early warning system for preventing rear-end collision of mobile tank car
CN115546754A (en) * 2022-11-07 2022-12-30 浙江智马达智能科技有限公司 Training method of lane line detection model

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103295021A (en) * 2012-02-24 2013-09-11 北京明日时尚信息技术有限公司 Method and system for detecting and recognizing feature of vehicle in static image
CN103587467A (en) * 2013-11-21 2014-02-19 中国科学院合肥物质科学研究院 Dangerous-overtaking early-warning prompting method and system
CN106314276A (en) * 2016-09-22 2017-01-11 西华大学 Rear car overtaking reminding system based on distance measuring

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103295021A (en) * 2012-02-24 2013-09-11 北京明日时尚信息技术有限公司 Method and system for detecting and recognizing feature of vehicle in static image
CN103587467A (en) * 2013-11-21 2014-02-19 中国科学院合肥物质科学研究院 Dangerous-overtaking early-warning prompting method and system
CN106314276A (en) * 2016-09-22 2017-01-11 西华大学 Rear car overtaking reminding system based on distance measuring

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李春伟 等: "一种基于可变形部件模型的快速对象检测算法", 《电子与信息学报》 *

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107985189A (en) * 2017-10-26 2018-05-04 西安科技大学 Towards driver's lane change Deep Early Warning method under scorch environment
CN108714304A (en) * 2018-04-02 2018-10-30 网易(杭州)网络有限公司 Overtake other vehicles display methods and device in a kind of game
CN110525333A (en) * 2018-05-23 2019-12-03 上海擎感智能科技有限公司 A kind of passing behavior monitoring method and system, car-mounted terminal based on car-mounted terminal
CN108847026A (en) * 2018-05-31 2018-11-20 安徽四创电子股份有限公司 A method of it is converted based on matrix coordinate and realizes that data investigation is shown
CN110775057A (en) * 2019-08-29 2020-02-11 浙江零跑科技有限公司 Lane assist method for steering torque control based on vehicle blind spot visual scene analysis
CN110509880A (en) * 2019-09-24 2019-11-29 上海为彪汽配制造有限公司 Automobile rear blind monitoring system and method, radar control box
CN110588518A (en) * 2019-09-24 2019-12-20 上海为彪汽配制造有限公司 Automobile rear detection system and method and radar control box
CN112328970A (en) * 2020-11-05 2021-02-05 深圳壹账通智能科技有限公司 Accident prediction method and system based on vehicle performance parameters
CN112721931A (en) * 2021-01-18 2021-04-30 智马达汽车有限公司 Vehicle meeting method, device, equipment and storage medium
CN114023109A (en) * 2021-11-03 2022-02-08 中国矿业大学 Early warning system for preventing rear-end collision of mobile tank car
CN115546754A (en) * 2022-11-07 2022-12-30 浙江智马达智能科技有限公司 Training method of lane line detection model
CN115546754B (en) * 2022-11-07 2026-01-30 浙江智马达智能科技有限公司 A training method for a lane detection model

Similar Documents

Publication Publication Date Title
CN107229906A (en) A kind of automobile overtaking&#39;s method for early warning based on units of variance model algorithm
US7046822B1 (en) Method of detecting objects within a wide range of a road vehicle
US8311283B2 (en) Method for detecting lane departure and apparatus thereof
US10977504B2 (en) Vehicle-mounted image target objection recognition device
US8040227B2 (en) Method for detecting moving objects in a blind spot region of a vehicle and blind spot detection device
JP3822515B2 (en) Obstacle detection device and method
EP1671216B1 (en) Moving object detection using low illumination depth capable computer vision
CN102059978B (en) Driving assistance method and system
US8605947B2 (en) Method for detecting a clear path of travel for a vehicle enhanced by object detection
CN106324618B (en) Realize the method based on laser radar detection lane line system
Cualain et al. Automotive standards-grade lane departure warning system
Wu et al. Applying a functional neurofuzzy network to real-time lane detection and front-vehicle distance measurement
CN103879404B (en) Anti-collision warning method and device capable of tracking moving objects
CN102303563B (en) Front vehicle collision early warning system and method
JP2006527427A (en) Method and apparatus for locating and tracking an object from a vehicle
US12451012B2 (en) Method for collision warning, electronic device, and storage medium
JP3857698B2 (en) Driving environment recognition device
CN107985189A (en) Towards driver&#39;s lane change Deep Early Warning method under scorch environment
KR100816377B1 (en) Parking Lot Recognition Method and Apparatus Using Hough Transformation and Parking Assistance System Using the Same
KR101721442B1 (en) Avoiding Collision Systemn using Blackbox Rear Camera for vehicle and Method thereof
Cualain et al. Multiple-camera lane departure warning system for the automotive environment
CN107886729A (en) Vehicle identification method, device and vehicle
Suzuki et al. Sensor fusion-based pedestrian collision warning system with crosswalk detection
Kim et al. An intelligent and integrated driver assistance system for increased safety and convenience based on all-around sensing
KR20160133386A (en) Method of Avoiding Collision Systemn using Blackbox Rear Camera for vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20171003