CN116164748A - Decision planning system and decision planning device for complex road conditions in urban areas - Google Patents

Decision planning system and decision planning device for complex road conditions in urban areas Download PDF

Info

Publication number
CN116164748A
CN116164748A CN202310026531.7A CN202310026531A CN116164748A CN 116164748 A CN116164748 A CN 116164748A CN 202310026531 A CN202310026531 A CN 202310026531A CN 116164748 A CN116164748 A CN 116164748A
Authority
CN
China
Prior art keywords
trajectory
result
planning
decision
planned
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310026531.7A
Other languages
Chinese (zh)
Inventor
郑鑫宇
娄君杰
郑习羽
余勇
潘绍飞
邢文治
章航嘉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ningbo Junsheng Intelligent Automobile Technology Research Institute Co ltd
Original Assignee
Ningbo Junsheng Intelligent Automobile Technology Research Institute Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ningbo Junsheng Intelligent Automobile Technology Research Institute Co ltd filed Critical Ningbo Junsheng Intelligent Automobile Technology Research Institute Co ltd
Priority to CN202310026531.7A priority Critical patent/CN116164748A/en
Publication of CN116164748A publication Critical patent/CN116164748A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/20Instruments for performing navigational calculations

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)

Abstract

本发明提供了一种针对城区复杂路况的决策规划系统和决策规划装置,决策规划系统包括:检测驾驶车辆的行驶参数和周围环境参数,获得多个原始数据;将多个原始数据导入AI模型进行处理,得到多个感知结果;通过多个感知结果进行规划轨迹计算,得到第一规划轨迹结果;AI模型基于多个原始数据得到第二规划轨迹结果;将第一规划轨迹结果和第二规划轨迹结果导入轨迹评分仲裁模块验证最佳轨迹,并输出最佳轨迹。本发明实施例解决了现有算法中效率和安全性不高的问题。

Figure 202310026531

The present invention provides a decision-making planning system and a decision-making planning device for complex road conditions in urban areas. The decision-making planning system includes: detecting the driving parameters of the driving vehicle and surrounding environment parameters to obtain multiple original data; importing multiple original data into the AI model for processing to obtain multiple perception results; calculate the planned trajectory through multiple perception results to obtain the first planned trajectory result; the AI model obtains the second planned trajectory result based on multiple original data; combine the first planned trajectory result and the second planned trajectory The results are imported into the trajectory scoring arbitration module to verify the best trajectory and output the best trajectory. The embodiment of the present invention solves the problem of low efficiency and security in the existing algorithm.

Figure 202310026531

Description

针对城区复杂路况的决策规划系统和决策规划装置Decision-making planning system and decision-making planning device for complex road conditions in urban areas

技术领域technical field

本发明涉及自动领域,具体而言,涉及一种针对城区复杂路况的决策规划系统和决策规划装置。The invention relates to the field of automation, in particular to a decision-making planning system and a decision-making planning device for complex road conditions in urban areas.

背景技术Background technique

目前主流的自动驾驶算法技术栈以分层式的“感知-定位-决策规划-控制”为主,各模块相对独立和解耦。从并行开发效率的角度考虑,显然不可能把代码问题都留到实车多模块联合调试时再去暴露,每一个模块都应首先需要对自己的输出负责。决策规划模块的问题在于,其不像感知模块有明确的感知目标物体的真实值标签(比如当前看到的物体到底是卡车还是轿车,如果感知算法输出结果和实际不符合很容易判断出来),定位模块以及控制模块都有各自的定位精度和控制精度作为评价指标。但对于决策规划模块的输出,除了不能发生碰撞的安全要求以外就缺少了类似的唯一正确的真值作为参考。因此目前决策规划算法的效果好坏还是很大程度上需要依赖于和控制模块在实车上的联合调试效果来体现。这对于算法的敏捷开发和快速迭代都是比较不利的。At present, the mainstream autonomous driving algorithm technology stack is mainly based on the layered "perception-positioning-decision-making planning-control", and each module is relatively independent and decoupled. From the perspective of parallel development efficiency, it is obviously impossible to leave code problems to be exposed during multi-module joint debugging of the real vehicle. Each module should first be responsible for its own output. The problem with the decision-making planning module is that it does not have a clear label of the true value of the perceived target object like the perception module (for example, whether the currently seen object is a truck or a car, and it is easy to judge if the output result of the perception algorithm does not match the actual one), Both the positioning module and the control module have their own positioning accuracy and control accuracy as evaluation indicators. But for the output of the decision-making planning module, apart from the safety requirement that collisions cannot occur, there is a lack of a similar unique correct truth value as a reference. Therefore, the effect of the current decision-making planning algorithm still largely depends on the joint debugging effect of the control module on the real vehicle. This is not conducive to the agile development and rapid iteration of algorithms.

并且目前实际量产中,受限于算力、硬件成本,使用的决策规划算法技术方案还无法在很好地兼顾求解效率和复杂场景的处理能力。比如某一城区道路下,假设当前自车周围有超过二十辆以不同速度行驶的车,传统的决策规划算法很难同时对多个交通参与者进行交互式的轨迹规划,导致其策略会趋向于保守,不容易搜索求解出行驶效率更高的轨迹。In addition, in actual mass production, due to limitations in computing power and hardware costs, the decision-making and planning algorithm technical solutions used cannot give a good balance between solving efficiency and complex scene processing capabilities. For example, on a road in a certain urban area, assuming that there are more than 20 vehicles traveling at different speeds around the current vehicle, it is difficult for traditional decision-making and planning algorithms to plan interactive trajectories for multiple traffic participants at the same time, causing its strategy to tend to Because it is conservative, it is not easy to search and solve the trajectory with higher driving efficiency.

发明内容Contents of the invention

因此,本发明实施例提供一种针对城区复杂路况的决策规划系统和决策规划装置,解决了现有算法中效率和安全性不高的问题。Therefore, the embodiments of the present invention provide a decision-making planning system and a decision-making planning device for complex road conditions in urban areas, which solve the problems of low efficiency and safety in existing algorithms.

为解决上述问题,本发明提供一种针对城区复杂路况的决策规划系统,包括:检测驾驶车辆的行驶参数和周围环境参数,获得多个原始数据;将多个原始数据导入AI模型进行处理,得到多个感知结果;通过多个感知结果进行规划轨迹计算,得到第一规划轨迹结果;AI模型基于多个原始数据得到第二规划轨迹结果;将第一规划轨迹结果和第二规划轨迹结果导入轨迹评分仲裁模块验证最佳轨迹,并输出最佳轨迹。In order to solve the above problems, the present invention provides a decision-making and planning system for complex road conditions in urban areas, including: detecting the driving parameters of the driving vehicle and surrounding environment parameters, and obtaining multiple original data; importing multiple original data into the AI model for processing, and obtaining Multiple perception results; calculate the planned trajectory through multiple perception results to obtain the first planned trajectory result; the AI model obtains the second planned trajectory result based on multiple original data; import the first planned trajectory result and the second planned trajectory result into the trajectory The scoring arbitration module verifies the best trajectory and outputs the best trajectory.

与现有技术相比,采用该技术方案所达到的技术效果:通过设置检测车辆的行驶参数和周围环境参数来获得原始数据,使数据的来源更加贴合当前的车辆行驶的实际情况,根据实际情况来进行接下来的轨迹规划,使轨迹更符合当前车辆的驾驶环境,而通过将原始数据导入AI模型来进行处理,并得到感知结果,以此来进行传统轨迹运算,得到第一规划轨迹结果,再通过AI模型基于原始数据来进行处理得到第二规划轨迹结果,使轨迹的计算方式更多,通过不同的方式来得到不同的轨迹,使轨迹的实用性和安全性更高,同时再将两个规划轨迹结果导入评分仲裁模块来验证得到最佳轨迹,使轨迹的风险降到最低,同时也提高了算法的效率,能更加快速的得出车辆在目前驾驶环境下的最佳行驶轨迹,保障了驾驶人和驾驶车辆的安全,同时通过AI模型来对数据进行处理得到不同的轨迹模型,使自动驾驶系统的轨迹规划更加的全面安全,完备性更好,同时AI模型能更好的对当前驾驶环境做出反应决策,算法的效率更高,使得车辆能在复杂的驾驶环境中也能安全的进行自动驾驶,提高了自动驾驶的安全性和实用性,保障了驾驶人的安全。Compared with the existing technology, the technical effect achieved by adopting this technical solution: the original data is obtained by setting the driving parameters of the detected vehicle and the surrounding environment parameters, so that the source of the data is more suitable for the actual situation of the current vehicle driving, according to the actual situation According to the situation, the following trajectory planning is carried out, so that the trajectory is more in line with the current driving environment of the vehicle, and the raw data is imported into the AI model for processing, and the perception results are obtained, so as to perform traditional trajectory calculations and obtain the first planned trajectory results , and then use the AI model to process the second planning trajectory based on the original data, so that there are more ways to calculate the trajectory, and different trajectories can be obtained through different methods, so that the practicability and safety of the trajectory are higher. At the same time, the The results of the two planned trajectories are imported into the scoring arbitration module to verify the best trajectory, which minimizes the risk of the trajectory and improves the efficiency of the algorithm. It can more quickly obtain the best driving trajectory of the vehicle in the current driving environment. The safety of the driver and the driving vehicle is guaranteed. At the same time, the AI model is used to process the data to obtain different trajectory models, which makes the trajectory planning of the automatic driving system more comprehensive, safe and complete. At the same time, the AI model can better respond to The current driving environment makes a response decision, and the algorithm is more efficient, enabling the vehicle to safely drive automatically in a complex driving environment, improving the safety and practicality of automatic driving, and ensuring the safety of the driver.

在本发明的一个实例中,将多个原始数据导入AI模型进行处理,得到多个感知结果,还包括:采用卷积神经网络对多个原始数据进行预处理和局部特征提取,获得多个特征向量。In an example of the present invention, multiple raw data are imported into the AI model for processing to obtain multiple perceptual results, which also includes: using convolutional neural networks to preprocess multiple raw data and extract local features to obtain multiple features vector.

与现有技术相比,采用该技术方案所达到的技术效果:通过设置使用卷积神经网络来对原始数据进行预处理和局部特征提取,使获得原始数据能快速的祛除杂质和干扰因素,得到需要的数据特征,同时局部特征提取将系统需求的特征快速的提取,并转换为对应的特征向量供后续的操作使用,使算法的效率更高,过程更加精准,提供的结果更加清楚,使后续的规划轨迹更加的方便安全,使针对城区复杂路况的决策规划系统更加实用和安全,保障了驾驶人员的安全。Compared with the existing technology, the technical effect achieved by adopting this technical solution: by setting and using the convolutional neural network to preprocess the original data and extract local features, the obtained original data can quickly remove impurities and interference factors, and obtain The required data features, and local feature extraction can quickly extract the features required by the system and convert them into corresponding feature vectors for subsequent operations, making the algorithm more efficient, the process more accurate, and the results provided clearer. The planning trajectory is more convenient and safe, making the decision-making and planning system for complex road conditions in urban areas more practical and safe, and ensuring the safety of drivers.

在本发明的一个实例中,AI模型基于多个原始数据得到第二规划轨迹结果,还包括:将多个特征向量通过拼接操作进行合并,得到合并特征向量;通过一个全连接神经网络结构和Transformer网络结构作为中间层,对合并特征向量进行特征转换和编码,得到中间结果。In an example of the present invention, the AI model obtains the second planned trajectory result based on multiple original data, which also includes: combining multiple feature vectors through splicing operations to obtain the combined feature vector; through a fully connected neural network structure and Transformer The network structure acts as an intermediate layer to perform feature conversion and encoding on the merged feature vectors to obtain intermediate results.

与现有技术相比,采用该技术方案所达到的技术效果:通过设置将多特征向量拼接合并,使后续的操作和处理更加的方便快捷,同时使后续算法的效率更快,再通过全连接神经网络结构和Transformer网络结构来对合并特征向量进行特征转换和编码,得到中间结果,使合并特征向量能进行后续的处理操作,而且转换过程效率更高,同时得到的中间结果能直接使用,更加的方便,使算法更具有效率。Compared with the existing technology, the technical effect achieved by adopting this technical solution: by splicing and merging multiple feature vectors through setting, the subsequent operation and processing are more convenient and fast, and the efficiency of the subsequent algorithm is faster, and then through the full connection The neural network structure and the Transformer network structure are used to perform feature conversion and encoding on the merged feature vectors to obtain intermediate results, so that the combined feature vectors can be used for subsequent processing operations, and the conversion process is more efficient. At the same time, the obtained intermediate results can be used directly, which is more efficient. The convenience makes the algorithm more efficient.

在本发明的一个实例中,AI模型基于多个原始数据得到第二规划轨迹结果,还包括:将中间结果输入到LSTMDecoder网络生成一系列轨迹序列,预生成决策规划轨迹点;通过轨迹模型对决策规划轨迹点进行处理,输出为第二规划轨迹结果。In an example of the present invention, the AI model obtains the second planning trajectory result based on a plurality of original data, and further includes: inputting the intermediate result into the LSTMDecoder network to generate a series of trajectory sequences, and pre-generating decision planning trajectory points; The planned trajectory points are processed, and the output is the second planned trajectory result.

与现有技术相比,采用该技术方案所达到的技术效果:通过将中间结果输入LSTMDecoder网络生成一系列轨迹序列,使通过LSTMDecoder网络能更好的对轨迹进行预测,轨迹是一组连续性的数据信息,具有时间延续性和空间随机性,而LSTMDecoder网络能很好的对其进行预测处理,使轨迹预测更加的精准,通过轨迹模型对决策规划轨迹点进行处理,输出为第二规划轨迹结果,而模型结合LSTMDecoder网络能使得模型的精准度更高,使得后续的预测的精准度更高,使决策规划系统更加的全面和安全,更能保障驾驶人员的安全,使自动驾驶更加的智能化。Compared with the existing technology, the technical effect achieved by adopting this technical solution: a series of trajectory sequences are generated by inputting the intermediate results into the LSTMDecoder network, so that the trajectory can be better predicted through the LSTMDecoder network. The trajectory is a set of continuous Data information has time continuity and spatial randomness, and the LSTMDecoder network can predict and process it very well, making trajectory prediction more accurate. The decision planning trajectory points are processed through the trajectory model, and the output is the second planning trajectory result , and the model combined with the LSTMDecoder network can make the accuracy of the model higher, making subsequent predictions more accurate, making the decision-making planning system more comprehensive and safe, better protecting the safety of drivers, and making autonomous driving more intelligent .

在本发明的一个实例中,将第一规划轨迹结果和第二规划轨迹结果导入轨迹评分仲裁模块验证最佳轨迹,并输出最佳轨迹,还包括:通过预测模块进行轨迹预测,得到预测轨迹,并对预测轨迹进行可信度评估,得到第三规划轨迹结果;将第三规划轨迹结果和第二规划轨迹结果进行碰撞筛选,得到第四规划轨迹结果。In an example of the present invention, importing the result of the first planned trajectory and the result of the second planned trajectory into the trajectory scoring arbitration module to verify the optimal trajectory, and outputting the optimal trajectory, it also includes: performing trajectory prediction through the prediction module to obtain the predicted trajectory, The credibility of the predicted trajectory is evaluated to obtain a third planned trajectory result; the third planned trajectory result and the second planned trajectory result are subjected to collision screening to obtain a fourth planned trajectory result.

与现有技术相比,采用该技术方案所达到的技术效果:通过设置预测模块进行轨迹预测,得到预测轨迹,并对预测轨迹进行可信度评估,得到第三规划轨迹结果,使通过预测轨迹来辅助AI模型生成的轨迹进行判断评估,结合多个轨迹使最后输出的轨迹更加的全面和精准,更符合当前驾驶车辆所处的环境,保护驾驶人员的安全,再将第三规划轨迹结果和第二规划轨迹结果进行碰撞筛选,得到第四规划轨迹结果,一方面提升算法的整体求解效率,避免在无效轨迹上花费大量算力进行完整的可行性检查和舒适性评分;同时也是做了一次安全上的筛选。同时对于一些低可信度的轨迹点存在的碰撞可能予以忽略。不会因为一些低可信的预测轨迹就盲目删除了有效的自车规划轨迹,扩大了算法解空间的范围和完备性。Compared with the existing technology, the technical effect achieved by adopting this technical solution: by setting the prediction module to predict the trajectory, the predicted trajectory is obtained, and the credibility of the predicted trajectory is evaluated, and the result of the third planned trajectory is obtained, so that the predicted trajectory To assist the trajectory generated by the AI model to judge and evaluate, combine multiple trajectories to make the final output trajectory more comprehensive and accurate, more in line with the current environment of the driving vehicle, and protect the safety of the driver. The results of the second planning trajectory are subjected to collision screening to obtain the result of the fourth planning trajectory. On the one hand, the overall solution efficiency of the algorithm is improved, and a large amount of computing power is avoided on invalid trajectories for complete feasibility inspection and comfort scoring; at the same time, it is also done once. Security screening. At the same time, the collisions of some low-confidence trajectory points may be ignored. The effective self-vehicle planning trajectory will not be deleted blindly because of some low-confidence predicted trajectories, and the scope and completeness of the algorithm solution space will be expanded.

在本发明的一个实例中,将第一规划轨迹结果和第四规划轨迹结果进行舒适度评分、拟人度评分和效率评分;结果舒适度评分、拟人度评分和效率评分,将得分高的轨迹进行输出。In an example of the present invention, the first planned trajectory result and the fourth planned trajectory result are subjected to comfort score, anthropomorphic score and efficiency score; as a result of the comfort score, anthropomorphic score and efficiency score, the trajectory with a high score is evaluated. output.

与现有技术相比,采用该技术方案所达到的技术效果:通过设置将第一规划轨迹结果和第四规划轨迹结果进行舒适度评分、拟人度评分和效率评分,使输出的结果通过三个评分后能更具有代表性和更具有实用性,更加符合当前驾驶车辆的行驶路况,使轨迹能保障驾驶车辆的安全行驶,保障驾驶人员的安全。Compared with the existing technology, the technical effect achieved by adopting this technical solution: by setting the results of the first planned trajectory and the result of the fourth planned trajectory for comfort score, anthropomorphic score and efficiency score, the output results are passed through three After scoring, it can be more representative and practical, and more in line with the current road conditions of the driving vehicle, so that the trajectory can ensure the safe driving of the driving vehicle and the safety of the driver.

在本发明的一个实例中,舒适度评分还包括:舒适度=归一化(1/轨迹曲率)+归一化(1/加速度变化率)。In an example of the present invention, the comfort score further includes: comfort=normalized (1/track curvature)+normalized (1/acceleration rate).

与现有技术相比,采用该技术方案所达到的技术效果:通过设置舒适度来对轨迹进行评价,舒适度主要通过轨迹曲率变化率以及规划加速度变化率两部分指标来共同衡量:即在满足安全的前提下,轨迹的曲率变化率和加速度变化率都越低越好,使评分高的轨迹能更安全和更实用。Compared with the existing technology, the technical effect achieved by adopting this technical solution: the trajectory is evaluated by setting the comfort level, and the comfort level is mainly measured by the two indicators of the trajectory curvature change rate and the planning acceleration change rate: that is, when the Under the premise of safety, the lower the rate of curvature change and acceleration rate of the trajectory, the better, so that the trajectory with a high score can be safer and more practical.

在本发明的一个实例中,效率评分还包括:效率=归一化(轨迹总长度)。In an example of the present invention, the efficiency score further includes: efficiency=normalization (total length of track).

与现有技术相比,采用该技术方案所达到的技术效果:通过设置效率来对轨迹进行评分,使当路径越长,则速度越高、效率越好,使经过效率评分得到轨迹能更好的在当前路口下行驶。Compared with the existing technology, the technical effect achieved by adopting this technical solution: the trajectory is scored by setting the efficiency, so that the longer the path, the higher the speed and the better the efficiency, so that the trajectory obtained through efficiency scoring can be better to drive at the current intersection.

在本发明的一个实例中,拟人度评分还包括:拟人度=归一化(1/弗雷歇距离(对应场景人类司机的平均轨迹,目标轨迹))。In an example of the present invention, the anthropomorphic score further includes: anthropomorphic = normalization (1/Frescher distance (corresponding to the average trajectory of the human driver in the scene, the target trajectory)).

与现有技术相比,采用该技术方案所达到的技术效果:通过设置拟人度来对轨迹进行评分,使轨迹的行驶能更符合人类标准,同时与现有驾驶员的驾驶习惯更加符合,保障当前驾驶情况下的最佳路线行驶的同时使轨迹的人性化程度更高,保障驾驶的安全。Compared with the existing technology, the technical effect achieved by adopting this technical solution: scoring the trajectory by setting the anthropomorphic degree, so that the driving of the trajectory can be more in line with human standards, and at the same time more consistent with the driving habits of existing drivers, ensuring While driving on the best route under the current driving situation, it makes the trajectory more humanized and ensures driving safety.

本发明还提供一种决策规划装置,包括:获取模块:检测驾驶车辆的行驶参数和周围环境参数,获得多个原始数据;处理模块:将多个原始数据导入AI模型进行处理,得到多个感知结果;通过多个感知结果进行规划轨迹计算,得到第一规划轨迹结果;AI模型基于多个原始数据得到第二规划轨迹结果;评分模块:将第一规划轨迹结果和第二规划轨迹结果导入轨迹评分仲裁模块验证最佳轨迹,并输出最佳轨迹。The present invention also provides a decision-making and planning device, including: acquisition module: detect driving parameters of the driving vehicle and surrounding environment parameters, and obtain multiple original data; processing module: import multiple original data into AI model for processing, and obtain multiple perception Result; calculate the planned trajectory through multiple perception results to obtain the first planned trajectory result; the AI model obtains the second planned trajectory result based on multiple original data; scoring module: import the first planned trajectory result and the second planned trajectory result into the trajectory The scoring arbitration module verifies the best trajectory and outputs the best trajectory.

与现有技术相比,采用该技术方案所达到的技术效果:通过设置获取模块来获取当前车辆的行驶路况环境,来获得原始数据,使车辆的轨迹规划更符合当前的环境实际情况,使规划更具有实用性,而通过处理模块对原始数据进行处理,得到第一规划轨迹结果和第二规划轨迹结果,使得到的两个轨迹结果更加的精准和符合实际情况,同时多个轨迹结果的评价比较能使最后输出的轨迹更加的安全和实用,同时通过评分模块来对两个轨迹进行评分验证,使输出的归家贵最安全,最快捷最人性化的轨迹,通过三个模块的合作,使算法更具有效率,同时能兼顾不同的行驶环境,实用性更高。Compared with the existing technology, the technical effect achieved by adopting this technical solution: the original data is obtained by setting the acquisition module to obtain the current driving road condition environment of the vehicle, so that the trajectory planning of the vehicle is more in line with the actual situation of the current environment, and the planning It is more practical, and the original data is processed by the processing module to obtain the first planned trajectory result and the second planned trajectory result, so that the obtained two trajectory results are more accurate and in line with the actual situation, and the evaluation of multiple trajectory results at the same time Comparison can make the final output track more safe and practical. At the same time, the scoring module is used to score and verify the two tracks, so that the output home is the safest, fastest and most humanized track. Through the cooperation of the three modules, The algorithm is more efficient, and at the same time, it can take into account different driving environments and has higher practicability.

采用该技术方案有以下有益效果:Adopting this technical scheme has the following beneficial effects:

(1)通过设置检测车辆的行驶参数和周围环境参数来获得原始数据,使数据的来源更加贴合当前的车辆行驶的实际情况,根据实际情况来进行接下来的轨迹规划,使轨迹更符合当前车辆的驾驶环境,而通过将原始数据导入AI模型来进行处理,并得到感知结果,以此来进行传统轨迹运算,得到第一规划轨迹结果,再通过AI模型基于原始数据来进行处理得到第二规划轨迹结果,使轨迹的计算方式更多,通过不同的方式来得到不同的轨迹,使轨迹的实用性和安全性更高,同时再将两个规划轨迹结果导入评分仲裁模块来验证得到最佳轨迹,使轨迹的风险降到最低,同时也提高了算法的效率,能更加快速的得出车辆在目前驾驶环境下的最佳行驶轨迹,保障了驾驶人和驾驶车辆的安全,同时通过AI模型来对数据进行处理得到不同的轨迹模型,使自动驾驶系统的轨迹规划更加的全面安全,完备性更好,同时AI模型能更好的对当前驾驶环境做出反应决策,算法的效率更高,使得车辆能在复杂的驾驶环境中也能安全的进行自动驾驶,提高了自动驾驶的安全性和实用性,保障了驾驶人的安全。(1) The original data is obtained by setting the driving parameters of the detected vehicle and the surrounding environment parameters, so that the source of the data is more in line with the actual situation of the current vehicle driving, and the next trajectory planning is carried out according to the actual situation, so that the trajectory is more in line with the current situation The driving environment of the vehicle is processed by importing the original data into the AI model, and the perception result is obtained, and the traditional trajectory calculation is performed to obtain the first planning trajectory result, and then the AI model is processed based on the original data to obtain the second The result of the planned trajectory enables more calculation methods of the trajectory, and different trajectories are obtained through different methods, so that the practicability and safety of the trajectory are higher. At the same time, the two planned trajectory results are imported into the scoring arbitration module to verify that the best The trajectory minimizes the risk of the trajectory, and also improves the efficiency of the algorithm. It can more quickly obtain the optimal driving trajectory of the vehicle in the current driving environment, ensuring the safety of the driver and the driving vehicle. At the same time, through the AI model To process the data to obtain different trajectory models, so that the trajectory planning of the automatic driving system is more comprehensive, safe and complete. At the same time, the AI model can better respond to the current driving environment and make decisions, and the algorithm is more efficient. It enables the vehicle to safely drive automatically in a complex driving environment, improves the safety and practicability of automatic driving, and ensures the safety of the driver.

(2)通过设置使用卷积神经网络来对原始数据进行预处理和局部特征提取,使获得原始数据能快速的祛除杂质和干扰因素,得到需要的数据特征,同时局部特征提取将系统需求的特征快速的提取,并转换为对应的特征向量供后续的操作使用,使算法的效率更高,过程更加精准,提供的结果更加清楚,使后续的规划轨迹更加的方便安全,使针对城区复杂路况的决策规划系统更加实用和安全,保障了驾驶人员的安全。(2) By setting and using convolutional neural network to preprocess the original data and extract local features, the obtained original data can quickly remove impurities and interference factors, and obtain the required data features. Quickly extract and convert to corresponding feature vectors for subsequent operations, making the algorithm more efficient, the process more accurate, and the results provided clearer, making the subsequent planning trajectory more convenient and safe, and making the complex road conditions in urban areas more convenient and safe. The decision-making planning system is more practical and safe, which ensures the safety of drivers.

(3)通过设置预测模块进行轨迹预测,得到预测轨迹,并对预测轨迹进行可信度评估,得到第三规划轨迹结果,使通过预测轨迹来辅助AI模型生成的轨迹进行判断评估,结合多个轨迹使最后输出的轨迹更加的全面和精准,更符合当前驾驶车辆所处的环境,保护驾驶人员的安全,再将第三规划轨迹结果和第二规划轨迹结果进行碰撞筛选,得到第四规划轨迹结果,一方面提升算法的整体求解效率,避免在无效轨迹上花费大量算力进行完整的可行性检查和舒适性评分;同时也是做了一次安全上的筛选。同时对于一些低可信度的轨迹点存在的碰撞可能予以忽略。不会因为一些低可信的预测轨迹就盲目删除了有效的自车规划轨迹,扩大了算法解空间的范围和完备性。(3) Predict the trajectory by setting the prediction module, obtain the predicted trajectory, and evaluate the credibility of the predicted trajectory to obtain the third planning trajectory result, so that the trajectory generated by the predicted trajectory to assist the AI model can be judged and evaluated, combined with multiple The trajectory makes the final output trajectory more comprehensive and accurate, which is more in line with the current environment of the driving vehicle and protects the safety of the driver. Then, the third planning trajectory result and the second planning trajectory result are subjected to collision screening to obtain the fourth planning trajectory As a result, on the one hand, the overall solution efficiency of the algorithm is improved to avoid spending a lot of computing power on invalid trajectories for a complete feasibility check and comfort score; at the same time, a safety screening is also done. At the same time, the collisions of some low-confidence trajectory points may be ignored. The effective self-vehicle planning trajectory will not be deleted blindly because of some low-confidence predicted trajectories, and the scope and completeness of the algorithm solution space will be expanded.

(4)通过设置将第一规划轨迹结果和第四规划轨迹结果进行舒适度评分、拟人度评分和效率评分,使输出的结果通过三个评分后能更具有代表性和更具有实用性,更加符合当前驾驶车辆的行驶路况,使轨迹能保障驾驶车辆的安全行驶,保障驾驶人员的安全。(4) By setting the results of the first planned trajectory and the fourth planned trajectory to score comfort, anthropomorphism and efficiency, the output results can be more representative and practical after passing the three scores. It conforms to the driving conditions of the current driving vehicle, so that the trajectory can ensure the safe driving of the driving vehicle and the safety of the driver.

附图说明Description of drawings

为了更清楚地说明本发明实施例的技术方案,下面将对实施例描述中待要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions of the embodiments of the present invention more clearly, the accompanying drawings to be used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For Those of ordinary skill in the art can also obtain other drawings based on these drawings without making creative efforts.

图1为本发明提供的一种针对城区复杂路况的决策规划系统的流程图。FIG. 1 is a flowchart of a decision-making and planning system for urban complex road conditions provided by the present invention.

图2为本发明提供的一种决策规划装置的结构示意图。FIG. 2 is a schematic structural diagram of a decision planning device provided by the present invention.

图3为本发明提供的一种针对城区复杂路况的决策规划系统的详细流程图。Fig. 3 is a detailed flow chart of a decision-making planning system for urban complex road conditions provided by the present invention.

图4为本发明提供的多任务统一的AI模型的示意图。Fig. 4 is a schematic diagram of a multi-task unified AI model provided by the present invention.

图5为本发明提供的一种针对城区复杂路况的决策规划系统的轨迹评分仲裁流程图。FIG. 5 is a flow chart of trajectory scoring arbitration of a decision-making planning system for urban complex road conditions provided by the present invention.

图6为本发明提供的TrajectoryModel轨迹模型的示意图。Fig. 6 is a schematic diagram of the TrajectoryModel trajectory model provided by the present invention.

附图标记说明:Explanation of reference signs:

100为决策规划装置;110为获取模块;120为处理模块;130为评分模块。100 is a decision planning device; 110 is an acquisition module; 120 is a processing module; 130 is a scoring module.

具体实施方式Detailed ways

为使本发明的上述目的、特征和优点能够更为明显易懂,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the above objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention are clearly and completely described. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than Full examples. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

参见图1-6,本发明提供一种针对城区复杂路况的决策规划系统,包括:Referring to Figures 1-6, the present invention provides a decision-making and planning system for complex road conditions in urban areas, including:

步骤S100:检测驾驶车辆的行驶参数和周围环境参数,获得多个原始数据;Step S100: Detect the driving parameters of the driving vehicle and the surrounding environment parameters, and obtain a plurality of original data;

步骤S200:将多个原始数据导入AI模型进行处理,得到多个感知结果;通过多个感知结果进行规划轨迹计算,得到第一规划轨迹结果;AI模型基于多个原始数据得到第二规划轨迹结果;Step S200: Import multiple raw data into the AI model for processing to obtain multiple perception results; calculate the planned trajectory through multiple perception results to obtain the first planned trajectory result; the AI model obtains the second planned trajectory result based on the multiple raw data ;

步骤S300:将第一规划轨迹结果和第二规划轨迹结果导入轨迹评分仲裁模块验证最佳轨迹,并输出最佳轨迹。Step S300: Import the first planned trajectory result and the second planned trajectory result into the trajectory scoring arbitration module to verify the best trajectory, and output the best trajectory.

具体的,基于原始的传感器采集和输入驾驶车辆的行驶参数和周围环境参数,采用本发明提出的统一多任务AI模型进行处理,得到感知结果具体包括:车辆、自行车、行人等交通参与者等目标检测结果;车道线、交通标识、红绿灯等目标感知结果;交通参与者的预测行为轨迹;其他静止障碍物位置等。随后这些结果会直接输出给传统的决策规划算法,进行相应的规划轨迹计算,得到第一规划轨迹结果。而同时,AI模型也会直接输出基于数据驱动的方式得到的规划轨迹结果即第二规划轨迹结果。这两类轨迹经过一个轨迹评分仲裁模块后再进行最后的输出。Specifically, based on the original sensor collection and input of driving parameters and surrounding environment parameters of the driving vehicle, the unified multi-task AI model proposed by the present invention is used for processing, and the perception results obtained specifically include: traffic participants such as vehicles, bicycles, and pedestrians, etc. Target detection results; target perception results such as lane lines, traffic signs, traffic lights, etc.; predicted behavior trajectories of traffic participants; positions of other stationary obstacles, etc. Then these results will be directly output to the traditional decision-making planning algorithm, and the corresponding planning trajectory calculation will be performed to obtain the first planning trajectory result. At the same time, the AI model will also directly output the planned trajectory result based on the data-driven method, that is, the second planned trajectory result. These two types of trajectories pass through a trajectory scoring arbitration module before final output.

进一步的,具备多任务功能的统一AI模型框架:其在原始输入端可以支持多种类型传感器(视觉相机、激光雷达、毫米波雷达等)、多路传感器(如前向相机、侧向相机、后向相机等)的输入。针对不同的传感器的输入,分别采用对应的CNN(卷积神经网络)来进行预处理和局部特征提取。随后通过Concat(拼接)操作对提取自不同传感器的特征向量进行合并。随后通过一个DNN(全连接神经网络)结构以及Transformer网络结构作为中间层,对合并后的特征向量进行进一步的特征转换和编码:得到整个AI模型中间层的结果。该中间层的结果可再后接一些典型的任务网络块,如预测、目标物体检测以及车道线分割等,进行相应的多任务的感知结果输出;同时,该中间层的结果可以直接输出给LSTMDecoder网络生成一系列轨迹序列,进行决策规划轨迹点的预生成。随后通过本发明提出的TrajectoryModel轨迹模型对预生成的轨迹点进行处理后输出。上述这些模块共享同样的中间层结果,最大程度地复用训练好的AI网络模型。Further, a unified AI model framework with multi-tasking functions: it can support multiple types of sensors (visual cameras, lidar, millimeter-wave radar, etc.), multi-channel sensors (such as forward-facing cameras, side-facing cameras, input to the rear camera, etc.). For the input of different sensors, the corresponding CNN (convolutional neural network) is used for preprocessing and local feature extraction. The feature vectors extracted from different sensors are then merged by a Concat operation. Then, a DNN (fully connected neural network) structure and a Transformer network structure are used as the middle layer to perform further feature transformation and encoding on the merged feature vector: the result of the middle layer of the entire AI model is obtained. The result of this intermediate layer can be followed by some typical task network blocks, such as prediction, target object detection and lane line segmentation, etc., to output the corresponding multi-task perception results; at the same time, the result of this intermediate layer can be directly output to LSTMDecoder The network generates a series of trajectory sequences for pre-generation of trajectory points for decision planning. Then, the pre-generated trajectory points are processed and output through the TrajectoryModel trajectory model proposed by the present invention. These modules above share the same intermediate layer results, maximizing the reuse of the trained AI network model.

具体的,本发明提出了一种树状的决策规划轨迹表示模型,即Trajectory Model轨迹模型,最后需要用“树”的数据结构来实现。从功能上考虑,本方发明提出的树状决策规划轨迹模型能够更好地应对决策规划的多模态问题。即同一场景下,自车有多种可行解,而他车也会具备多种未来行驶行为的可能性。基于树状的结构能够去充分捕捉自车轨迹的多种可能性以及与他车的互动性。最终该模块会将LSTM生成的轨迹点转化为树状轨迹进行输出,以代表自车未来状态的多种可能性。Specifically, the present invention proposes a tree-like decision planning trajectory representation model, that is, the Trajectory Model trajectory model, which finally needs to be realized with a "tree" data structure. Considering the function, the tree decision planning trajectory model proposed by the present invention can better deal with the multimodal problem of decision planning. That is, in the same scene, the self-vehicle has multiple feasible solutions, and other vehicles will also have multiple possibilities for future driving behavior. The tree-based structure can fully capture the various possibilities of the trajectory of the own vehicle and the interaction with other vehicles. Finally, the module will convert the trajectory points generated by LSTM into tree-like trajectory for output to represent the various possibilities of the future state of the vehicle.

进一步的,将预测模块的预测结果(即针对自车周围的多位交通参与者,假如10位,进行一个可信度评估。假如预测轨迹即第三规划轨迹结果的形式为10条[a,b,c,d,e,f]轨迹坐标点序列。则本模块会分别对这些轨迹中的每一个点赋上对应的可信度折扣,如[(a,0.95),(b,0.9),(c,0.85),d(0.80),e(0.75),f(0.7)]。进行可信度评估后的预测轨迹会和AI模型输出的树状的轨迹模型进行碰撞筛选。在这一步中主要考虑那些高可信度(比如0.8以上)的预测轨迹点和自车的树状轨迹会发生的碰撞可能。对具有高可信的潜在碰撞风险的轨迹树直接进行剪枝处理,即在树状结构中删去对应的分支。这样一方面提升算法的整体求解效率,避免在无效轨迹上花费大量算力进行完整的可行性检查和舒适性评分;同时也是做了一次安全上的筛选。同时对于一些低可信度的(比如低于0.3)的轨迹点存在的碰撞可能予以忽略。这一步的好处在于不会因为一些低可信的预测轨迹就盲目删除了有效的自车规划轨迹,扩大了算法解空间的范围和完备性。最终在经过碰撞筛选后的轨迹树即第四规划轨迹结果与传统的本身就做过完备的碰撞检测的决策规划轨迹即第一规划轨迹结果一同通过后续的三个评分(舒适度、拟人度、效率)阶段,最终选择一条总分最高的单条轨迹序列进行输出。Further, the prediction results of the prediction module (i.e., a plurality of traffic participants around the vehicle, if 10, a credibility evaluation is performed. If the predicted trajectory, that is, the third planning trajectory result, is in the form of 10 [a, b,c,d,e,f] trajectory coordinate point sequence. Then this module will assign corresponding credibility discounts to each point in these trajectories, such as [(a,0.95),(b,0.9) ,(c,0.85),d(0.80),e(0.75),f(0.7)]. The predicted trajectory after the credibility evaluation will be collided with the tree-shaped trajectory model output by the AI model. In this step Mainly consider the possibility of collision between those predicted trajectory points with high confidence (such as above 0.8) and the tree trajectory of the ego vehicle. The trajectory tree with high confidence potential collision risk is directly pruned, that is, in Delete the corresponding branches in the tree structure. On the one hand, this improves the overall solution efficiency of the algorithm and avoids spending a lot of computing power on invalid trajectories for complete feasibility checks and comfort scores; at the same time, it also performs a security screening. At the same time, the collisions of some low-confidence (such as lower than 0.3) trajectory points may be ignored. The advantage of this step is that the effective self-vehicle planning trajectory will not be blindly deleted because of some low-confidence predicted trajectories. The scope and completeness of the algorithm solution space are expanded. Finally, the trajectory tree after collision screening, that is, the result of the fourth planning trajectory, and the traditional decision planning trajectory that has done complete collision detection, that is, the result of the first planning trajectory, pass through the follow-up The three scoring stages (comfort, anthropomorphism, and efficiency) of the three scoring stages, and finally select a single track sequence with the highest total score for output.

优选的,通过设置检测车辆的行驶参数和周围环境参数来获得原始数据,使数据的来源更加贴合当前的车辆行驶的实际情况,根据实际情况来进行接下来的轨迹规划,使轨迹更符合当前车辆的驾驶环境,而通过将原始数据导入AI模型来进行处理,并得到感知结果,以此来进行传统轨迹运算,得到第一规划轨迹结果,再通过AI模型基于原始数据来进行处理得到第二规划轨迹结果,使轨迹的计算方式更多,通过不同的方式来得到不同的轨迹,使轨迹的实用性和安全性更高,同时再将两个规划轨迹结果导入评分仲裁模块来验证得到最佳轨迹,使轨迹的风险降到最低,同时也提高了算法的效率,能更加快速的得出车辆在目前驾驶环境下的最佳行驶轨迹,保障了驾驶人和驾驶车辆的安全,同时通过AI模型来对数据进行处理得到不同的轨迹模型,使自动驾驶系统的轨迹规划更加的全面安全,完备性更好,同时AI模型能更好的对当前驾驶环境做出反应决策,算法的效率更高,使得车辆能在复杂的驾驶环境中也能安全的进行自动驾驶,提高了自动驾驶的安全性和实用性,保障了驾驶人的安全。Preferably, the original data is obtained by setting the driving parameters of the detected vehicle and the surrounding environment parameters, so that the source of the data is more suitable for the actual situation of the current vehicle driving, and the next trajectory planning is carried out according to the actual situation, so that the trajectory is more in line with the current situation. The driving environment of the vehicle is processed by importing the original data into the AI model, and the perception result is obtained, and the traditional trajectory calculation is performed to obtain the first planning trajectory result, and then the AI model is processed based on the original data to obtain the second The result of the planned trajectory enables more calculation methods of the trajectory, and different trajectories are obtained through different methods, so that the practicability and safety of the trajectory are higher. At the same time, the two planned trajectory results are imported into the scoring arbitration module to verify that the best The trajectory minimizes the risk of the trajectory, and also improves the efficiency of the algorithm. It can more quickly obtain the optimal driving trajectory of the vehicle in the current driving environment, ensuring the safety of the driver and the driving vehicle. At the same time, through the AI model To process the data to obtain different trajectory models, so that the trajectory planning of the automatic driving system is more comprehensive, safe and complete. At the same time, the AI model can better respond to the current driving environment and make decisions, and the algorithm is more efficient. It enables the vehicle to safely drive automatically in a complex driving environment, improves the safety and practicability of automatic driving, and ensures the safety of the driver.

具体的,将多个原始数据导入AI模型进行处理,得到多个感知结果,还包括:采用卷积神经网络对多个原始数据进行预处理和局部特征提取,获得多个特征向量。Specifically, multiple raw data are imported into the AI model for processing to obtain multiple perception results, which also includes: using convolutional neural networks to preprocess multiple raw data and extract local features to obtain multiple feature vectors.

优选的,通过设置使用卷积神经网络来对原始数据进行预处理和局部特征提取,使获得原始数据能快速的祛除杂质和干扰因素,得到需要的数据特征,同时局部特征提取将系统需求的特征快速的提取,并转换为对应的特征向量供后续的操作使用,使算法的效率更高,过程更加精准,提供的结果更加清楚,使后续的规划轨迹更加的方便安全,使针对城区复杂路况的决策规划系统更加实用和安全,保障了驾驶人员的安全。Preferably, by setting and using a convolutional neural network to perform preprocessing and local feature extraction on the original data, the obtained original data can quickly remove impurities and interference factors, and obtain the required data features. Quickly extract and convert to corresponding feature vectors for subsequent operations, making the algorithm more efficient, the process more accurate, and the results provided clearer, making the subsequent planning trajectory more convenient and safe, and making the complex road conditions in urban areas more convenient and safe. The decision-making planning system is more practical and safe, which ensures the safety of drivers.

具体的,AI模型基于多个原始数据得到第二规划轨迹结果,还包括:将多个特征向量通过拼接操作进行合并,得到合并特征向量;通过一个全连接神经网络结构和Transformer网络结构作为中间层,对合并特征向量进行特征转换和编码,得到中间结果。Specifically, the AI model obtains the second planning trajectory result based on multiple original data, which also includes: combining multiple feature vectors through splicing operations to obtain the combined feature vector; using a fully connected neural network structure and Transformer network structure as the middle layer , perform feature transformation and encoding on the merged feature vectors to obtain intermediate results.

优选的,通过设置将多特征向量拼接合并,使后续的操作和处理更加的方便快捷,同时使后续算法的效率更快,再通过全连接神经网络结构和Transformer网络结构来对合并特征向量进行特征转换和编码,得到中间结果,使合并特征向量能进行后续的处理操作,而且转换过程效率更高,同时得到的中间结果能直接使用,更加的方便,使算法更具有效率。Preferably, by setting and merging multiple feature vectors, the subsequent operations and processing are more convenient and quicker, and the efficiency of subsequent algorithms is faster, and then the combined feature vectors are characterized by a fully connected neural network structure and a Transformer network structure. Converting and coding to obtain intermediate results, so that the merged feature vectors can be used for subsequent processing operations, and the conversion process is more efficient. At the same time, the obtained intermediate results can be used directly, which is more convenient and makes the algorithm more efficient.

具体的,AI模型基于多个原始数据得到第二规划轨迹结果,还包括:将中间结果输入到LSTMDecoder网络生成一系列轨迹序列,预生成决策规划轨迹点;通过轨迹模型对决策规划轨迹点进行处理,输出为第二规划轨迹结果。Specifically, the AI model obtains the second planning trajectory results based on multiple original data, which also includes: inputting the intermediate results into the LSTMDecoder network to generate a series of trajectory sequences, and pre-generating the decision planning trajectory points; processing the decision planning trajectory points through the trajectory model , the output is the result of the second planned trajectory.

优选的,通过将中间结果输入LSTMDecoder网络生成一系列轨迹序列,使通过LSTMDecoder网络能更好的对轨迹进行预测,轨迹是一组连续性的数据信息,具有时间延续性和空间随机性,而LSTMDecoder网络能很好的对其进行预测处理,使轨迹预测更加的精准,通过轨迹模型对决策规划轨迹点进行处理,输出为第二规划轨迹结果,而模型结合LSTMDecoder网络能使得模型的精准度更高,使得后续的预测的精准度更高,使决策规划系统更加的全面和安全,更能保障驾驶人员的安全,使自动驾驶更加的智能化。Preferably, a series of trajectory sequences are generated by inputting the intermediate results into the LSTMDecoder network, so that the trajectory can be better predicted by the LSTMDecoder network. The trajectory is a set of continuous data information with time continuity and spatial randomness, and LSTMDecoder The network can predict and process it very well, making the trajectory prediction more accurate. The decision-making planning trajectory points are processed through the trajectory model, and the output is the second planning trajectory result, and the model combined with the LSTMDecoder network can make the model more accurate. , making subsequent predictions more accurate, making the decision-making planning system more comprehensive and safe, better ensuring the safety of drivers, and making autonomous driving more intelligent.

具体的,将第一规划轨迹结果和第二规划轨迹结果导入轨迹评分仲裁模块验证最佳轨迹,并输出最佳轨迹,还包括:通过预测模块进行轨迹预测,得到预测轨迹,并对预测轨迹进行可信度评估,得到第三规划轨迹结果;将第三规划轨迹结果和第二规划轨迹结果进行碰撞筛选,得到第四规划轨迹结果。Specifically, the results of the first planned trajectory and the second planned trajectory are imported into the trajectory scoring arbitration module to verify the optimal trajectory, and output the optimal trajectory, which also includes: performing trajectory prediction through the prediction module to obtain the predicted trajectory, and performing a calculation on the predicted trajectory The reliability evaluation is performed to obtain the third planned trajectory result; the third planned trajectory result and the second planned trajectory result are subjected to collision screening to obtain the fourth planned trajectory result.

优选的,通过设置预测模块进行轨迹预测,得到预测轨迹,并对预测轨迹进行可信度评估,得到第三规划轨迹结果,使通过预测轨迹来辅助AI模型生成的轨迹进行判断评估,结合多个轨迹使最后输出的轨迹更加的全面和精准,更符合当前驾驶车辆所处的环境,保护驾驶人员的安全,再将第三规划轨迹结果和第二规划轨迹结果进行碰撞筛选,得到第四规划轨迹结果,一方面提升算法的整体求解效率,避免在无效轨迹上花费大量算力进行完整的可行性检查和舒适性评分;同时也是做了一次安全上的筛选。同时对于一些低可信度的轨迹点存在的碰撞可能予以忽略。不会因为一些低可信的预测轨迹就盲目删除了有效的自车规划轨迹,扩大了算法解空间的范围和完备性。Preferably, the trajectory prediction is performed by setting the prediction module to obtain the predicted trajectory, and the predicted trajectory is evaluated for credibility to obtain the third planning trajectory result, so that the trajectory generated by the predicted trajectory to assist the AI model is judged and evaluated, combined with multiple The trajectory makes the final output trajectory more comprehensive and accurate, which is more in line with the current environment of the driving vehicle and protects the safety of the driver. Then, the third planning trajectory result and the second planning trajectory result are subjected to collision screening to obtain the fourth planning trajectory As a result, on the one hand, the overall solution efficiency of the algorithm is improved to avoid spending a lot of computing power on invalid trajectories for a complete feasibility check and comfort score; at the same time, a safety screening is also done. At the same time, the collisions of some low-confidence trajectory points may be ignored. The effective self-vehicle planning trajectory will not be deleted blindly because of some low-confidence predicted trajectories, and the scope and completeness of the algorithm solution space will be expanded.

具体的,将第一规划轨迹结果和第四规划轨迹结果进行舒适度评分、拟人度评分和效率评分;结果舒适度评分、拟人度评分和效率评分,将得分高的轨迹进行输出。Specifically, the results of the first planned trajectory and the fourth planned trajectory are scored for comfort, anthropomorphism, and efficiency; the resulting comfort, anthropomorphic, and efficiency scores are scored, and trajectories with high scores are output.

优选的,通过设置将第一规划轨迹结果和第四规划轨迹结果进行舒适度评分、拟人度评分和效率评分,使输出的结果通过三个评分后能更具有代表性和更具有实用性,更加符合当前驾驶车辆的行驶路况,使轨迹能保障驾驶车辆的安全行驶,保障驾驶人员的安全。Preferably, by setting the first planned trajectory result and the fourth planned trajectory result to carry out comfort score, anthropomorphic score and efficiency score, the output results can be more representative and practical after passing the three scores, and more It conforms to the driving conditions of the current driving vehicle, so that the trajectory can ensure the safe driving of the driving vehicle and the safety of the driver.

具体的,舒适度评分还包括:舒适度=归一化(1/轨迹曲率)+归一化(1/加速度变化率)。Specifically, the comfort score further includes: comfort=normalized (1/track curvature)+normalized (1/acceleration rate).

优选的,通过设置舒适度来对轨迹进行评价,舒适度主要通过轨迹曲率变化率以及规划加速度变化率两部分指标来共同衡量:即在满足安全的前提下,轨迹的曲率变化率和加速度变化率都越低越好,使评分高的轨迹能更安全和更实用。Preferably, the trajectory is evaluated by setting the comfort level. The comfort level is mainly measured by the two indicators of the trajectory curvature change rate and the planning acceleration change rate: that is, under the premise of satisfying safety, the trajectory curvature change rate and acceleration change rate The lower the better, making higher-scoring trajectories safer and more practical.

具体的,效率评分还包括:效率=归一化(轨迹总长度)。Specifically, the efficiency score also includes: efficiency=normalization (total length of track).

具体的,轨迹的效率可以通过规划轨迹的总长度来衡量,即当每次轨迹规划都是针对自车未来的(比如说)10秒的状态进行规划时,该路径越长,则速度越高、效率越好。Specifically, the efficiency of the trajectory can be measured by the total length of the planned trajectory, that is, when each trajectory planning is planned for the state of the vehicle in the future (say) 10 seconds, the longer the path, the higher the speed , The better the efficiency.

优选的,通过设置效率来对轨迹进行评分,使当路径越长,则速度越高、效率越好,使经过效率评分得到轨迹能更好的在当前路口下行驶。Preferably, the trajectory is scored by setting the efficiency, so that the longer the path, the higher the speed and the better the efficiency, so that the trajectory obtained through the efficiency score can better drive at the current intersection.

具体的,拟人度评分还包括:拟人度=归一化(1/弗雷歇距离(对应场景人类司机的平均轨迹,目标轨迹))。Specifically, the score of anthropomorphism also includes: anthropomorphism = normalization (1/Frescher distance (corresponding to the average trajectory of human drivers in the scene, target trajectory)).

具体的,拟人度指标则衡量当前轨迹与人类司机驾驶员行驶轨迹的相似性,越趋近于人类标准,则更容易被用户接受,评分也更高,不过这一步首先需要假设基于大数据得到对应场景/工况下的人类司机平均轨迹。Specifically, the anthropomorphic index measures the similarity between the current trajectory and the trajectory of a human driver. The closer to the human standard, the easier it is to be accepted by users and the higher the score. The average trajectory of human drivers in corresponding scenarios/working conditions.

进一步的,当两条曲线的弗雷歇距离越小,可以理解为这两条曲线的相似程度越高。Furthermore, when the Frescher distance of two curves is smaller, it can be understood that the similarity between the two curves is higher.

具体的,上述的指标评分即舒适度评分、拟人度评分和效率评分都进行了归一化处理,使得最终的总评分不会被不同参数间计算数量级上的差异带来较大的负面影响。Specifically, the above index scores, namely the comfort score, anthropomorphism score and efficiency score, are all normalized, so that the final total score will not be greatly negatively affected by the difference in the calculation order of magnitude between different parameters.

优选的,通过设置拟人度来对轨迹进行评分,使轨迹的行驶能更符合人类标准,同时与现有驾驶员的驾驶习惯更加符合,保障当前驾驶情况下的最佳路线行驶的同时使轨迹的人性化程度更高,保障驾驶的安全。Preferably, the trajectory is scored by setting the degree of anthropomorphism, so that the driving of the trajectory can be more in line with human standards, and at the same time more consistent with the driving habits of existing drivers, so as to ensure the best route in the current driving situation while driving. Higher degree of humanization to ensure driving safety.

本发明还提供一种决策规划装置100,包括:获取模块110:检测驾驶车辆的行驶参数和周围环境参数,获得多个原始数据;处理模块120:将多个原始数据导入AI模型进行处理,得到多个感知结果;通过多个感知结果进行规划轨迹计算,得到第一规划轨迹结果;AI模型基于多个原始数据得到第二规划轨迹结果;评分模块130:将第一规划轨迹结果和第二规划轨迹结果导入轨迹评分仲裁模块验证最佳轨迹,并输出最佳轨迹。The present invention also provides a decision-making and planning device 100, including: acquisition module 110: detecting driving parameters of the driving vehicle and surrounding environment parameters, and obtaining a plurality of original data; processing module 120: importing a plurality of original data into the AI model for processing, and obtaining Multiple perception results; planning trajectory calculation through multiple perception results to obtain the first planning trajectory result; the AI model obtains the second planning trajectory result based on multiple original data; scoring module 130: compare the first planning trajectory result and the second planning trajectory result The trajectory results are imported into the trajectory scoring arbitration module to verify the best trajectory and output the best trajectory.

优选的,通过设置获取模块110来获取当前车辆的行驶路况环境,来获得原始数据,使车辆的轨迹规划更符合当前的环境实际情况,使规划更具有实用性,而通过处理模块120对原始数据进行处理,得到第一规划轨迹结果和第二规划轨迹结果,使得到的两个轨迹结果更加的精准和符合实际情况,同时多个轨迹结果的评价比较能使最后输出的轨迹更加的安全和实用,同时通过评分模块130来对两个轨迹进行评分验证,使输出的归家贵最安全,最快捷最人性化的轨迹,通过三个模块的合作,使算法更具有效率,同时能兼顾不同的行驶环境,实用性更高。Preferably, by setting the acquisition module 110 to obtain the driving road condition environment of the current vehicle, the original data is obtained, so that the trajectory planning of the vehicle is more in line with the current environmental reality, making the planning more practical, and the original data is processed by the processing module 120 After processing, the results of the first planned trajectory and the second planned trajectory are obtained, so that the obtained two trajectory results are more accurate and in line with the actual situation. At the same time, the evaluation of multiple trajectory results can make the final output trajectory more safe and practical. At the same time, the scoring module 130 is used to score and verify the two trajectories, so that the output home is the safest, fastest and most humanized trajectory. Through the cooperation of the three modules, the algorithm is more efficient and can take into account different The driving environment is more practical.

最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims (10)

1.一种针对城区复杂路况的决策规划系统,其特征在于,包括:1. A decision-making and planning system for complex road conditions in urban areas, characterized in that it comprises: 检测驾驶车辆的行驶参数和周围环境参数,获得多个原始数据;Detect the driving parameters of the driving vehicle and the surrounding environment parameters to obtain multiple raw data; 将所述多个原始数据导入AI模型进行处理,得到多个感知结果;Importing the multiple raw data into the AI model for processing to obtain multiple perception results; 通过所述多个感知结果进行规划轨迹计算,得到第一规划轨迹结果;Perform planning trajectory calculation through the plurality of perception results to obtain a first planning trajectory result; 所述AI模型基于所述多个原始数据得到第二规划轨迹结果;The AI model obtains a second planned trajectory result based on the plurality of raw data; 将所述第一规划轨迹结果和所述第二规划轨迹结果导入轨迹评分仲裁模块验证最佳轨迹,并输出最佳轨迹。Importing the first planned trajectory result and the second planned trajectory result into the trajectory scoring arbitration module to verify the best trajectory, and output the best trajectory. 2.根据权利要求1所述的针对城区复杂路况的决策规划系统,其特征在于,所述将所述多个原始数据导入AI模型进行处理,得到多个感知结果,还包括:2. The decision-making and planning system for complex road conditions in urban areas according to claim 1, wherein said importing said plurality of raw data into an AI model for processing to obtain a plurality of perception results also includes: 采用卷积神经网络对所述多个原始数据进行预处理和局部特征提取,获得多个特征向量。A convolutional neural network is used to perform preprocessing and local feature extraction on the plurality of original data to obtain a plurality of feature vectors. 3.根据权利要求2所述的针对城区复杂路况的决策规划系统,其特征在于,所述所述AI模型基于所述多个原始数据得到第二规划轨迹结果,还包括:3. The decision-making and planning system for urban complex road conditions according to claim 2, wherein the AI model obtains the second planning track result based on the plurality of raw data, and also includes: 将所述多个特征向量通过拼接操作进行合并,得到合并特征向量;Merging the plurality of feature vectors through a splicing operation to obtain a merged feature vector; 通过一个全连接神经网络结构和Transformer网络结构作为中间层,对所述合并特征向量进行特征转换和编码,得到中间结果。A fully connected neural network structure and a Transformer network structure are used as an intermediate layer to perform feature conversion and encoding on the merged feature vector to obtain an intermediate result. 4.根据权利要求3所述的针对城区复杂路况的决策规划系统,其特征在于,所述所述AI模型基于所述多个原始数据得到第二规划轨迹结果,还包括:4. The decision-making and planning system for complex road conditions in urban areas according to claim 3, wherein the AI model obtains the second planning trajectory result based on the plurality of raw data, and also includes: 将所述中间结果输入到LSTMDecoder网络生成一系列轨迹序列,预生成决策规划轨迹点;The intermediate result is input to the LSTMDecoder network to generate a series of trajectory sequences, and pre-generated decision planning trajectory points; 通过轨迹模型对所述决策规划轨迹点进行处理,输出为第二规划轨迹结果。The decision-planning trajectory points are processed by a trajectory model, and output as a second planning trajectory result. 5.根据权利要求4所述的针对城区复杂路况的决策规划系统,其特征在于,所述将所述第一规划轨迹结果和所述第二规划轨迹结果导入轨迹评分仲裁模块验证最佳轨迹,并输出最佳轨迹,还包括:5. The decision-making planning system for complex road conditions in urban areas according to claim 4, wherein said importing said first planned trajectory result and said second planned trajectory result into a trajectory scoring arbitration module to verify the best trajectory, And output the best trajectory, also includes: 通过预测模块进行轨迹预测,得到预测轨迹,并对所述预测轨迹进行可信度评估,得到第三规划轨迹结果;Predicting the trajectory through the prediction module to obtain a predicted trajectory, and evaluating the credibility of the predicted trajectory to obtain a third planning trajectory result; 将所述第三规划轨迹结果和所述第二规划轨迹结果进行碰撞筛选,得到第四规划轨迹结果。Perform collision screening on the third planned trajectory result and the second planned trajectory result to obtain a fourth planned trajectory result. 6.根据权利要求5所述的针对城区复杂路况的决策规划系统,其特征在于,6. the decision-making planning system for urban complex road conditions according to claim 5, characterized in that, 将所述第一规划轨迹结果和所述第四规划轨迹结果进行舒适度评分、拟人度评分和效率评分;Carrying out comfort scoring, anthropomorphic scoring and efficiency scoring on the first planned trajectory result and the fourth planned trajectory result; 结果所述舒适度评分、所述拟人度评分和所述效率评分,将得分高的轨迹进行输出。As a result of the comfort score, the anthropomorphic score, and the efficiency score, tracks with high scores are output. 7.根据权利要求6所述的针对城区复杂路况的决策规划系统,其特征在于,所述舒适度评分包括:7. The decision-making and planning system for urban complex road conditions according to claim 6, wherein the comfort score comprises: 舒适度=归一化(1/轨迹曲率)+归一化(1/加速度变化率)。Comfort = normalized (1/track curvature) + normalized (1/acceleration rate). 8.根据权利要求6所述的针对城区复杂路况的决策规划系统,其特征在于,效率评分包括:8. The decision-making and planning system for urban complex road conditions according to claim 6, wherein the efficiency score comprises: 效率=归一化(轨迹总长度)。Efficiency = normalized (total track length). 9.根据权利要求6所述的针对城区复杂路况的决策规划系统,其特征在于,拟人度评分包括:9. The decision-making and planning system for urban complex road conditions according to claim 6, wherein the anthropomorphic scoring comprises: 拟人度=归一化(1/弗雷歇距离(对应场景人类司机的平均轨迹,目标轨迹))。Anthropomorphism = normalization (1/Fresher distance (corresponding to the average trajectory of human drivers in the scene, target trajectory)). 10.一种决策规划装置,其特征在于,包括:10. A decision planning device, characterized in that it comprises: 获取模块:检测驾驶车辆的行驶参数和周围环境参数,获得多个原始数据;Acquisition module: detect the driving parameters of the driving vehicle and the surrounding environment parameters, and obtain multiple raw data; 处理模块:将所述多个原始数据导入AI模型进行处理,得到多个感知结果;通过所述多个感知结果进行规划轨迹计算,得到第一规划轨迹结果;所述AI模型基于所述多个原始数据得到第二规划轨迹结果;Processing module: import the plurality of raw data into the AI model for processing to obtain a plurality of perception results; calculate the planned trajectory through the plurality of perception results to obtain the first planned trajectory result; the AI model is based on the plurality of The raw data obtains the second planning trajectory result; 评分模块:将所述第一规划轨迹结果和所述第二规划轨迹结果导入轨迹评分仲裁模块验证最佳轨迹,并输出最佳轨迹。Scoring module: Import the first planned trajectory result and the second planned trajectory result into the trajectory scoring arbitration module to verify the best trajectory, and output the best trajectory.
CN202310026531.7A 2023-01-09 2023-01-09 Decision planning system and decision planning device for complex road conditions in urban areas Pending CN116164748A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310026531.7A CN116164748A (en) 2023-01-09 2023-01-09 Decision planning system and decision planning device for complex road conditions in urban areas

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310026531.7A CN116164748A (en) 2023-01-09 2023-01-09 Decision planning system and decision planning device for complex road conditions in urban areas

Publications (1)

Publication Number Publication Date
CN116164748A true CN116164748A (en) 2023-05-26

Family

ID=86412667

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310026531.7A Pending CN116164748A (en) 2023-01-09 2023-01-09 Decision planning system and decision planning device for complex road conditions in urban areas

Country Status (1)

Country Link
CN (1) CN116164748A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117056783A (en) * 2023-08-25 2023-11-14 重庆长安汽车股份有限公司 Driving trajectory decision-making method and device, equipment, computer-readable storage medium
CN118818952A (en) * 2024-06-27 2024-10-22 大卓智能科技有限公司 Track verification method, device, electronic device, storage medium and program product

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180292222A1 (en) * 2017-04-07 2018-10-11 TuSimple System and method for path planning of autonomous vehicles based on gradient
CN109489675A (en) * 2017-09-11 2019-03-19 百度(美国)有限责任公司 The path planning based on cost for automatic driving vehicle
CN110568841A (en) * 2019-08-05 2019-12-13 西藏宁算科技集团有限公司 Automatic driving decision method and system
US20220188667A1 (en) * 2020-12-15 2022-06-16 Woven Planet North America, Inc. Vehicle prediction module evaluation and training
CN115235476A (en) * 2022-09-26 2022-10-25 宁波均胜智能汽车技术研究院有限公司 Full-coverage path planning method and device, storage medium and electronic equipment
CN115230721A (en) * 2022-08-31 2022-10-25 阿波罗智能技术(北京)有限公司 Perceptual data processing method, device and autonomous vehicle

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180292222A1 (en) * 2017-04-07 2018-10-11 TuSimple System and method for path planning of autonomous vehicles based on gradient
CN109489675A (en) * 2017-09-11 2019-03-19 百度(美国)有限责任公司 The path planning based on cost for automatic driving vehicle
CN110568841A (en) * 2019-08-05 2019-12-13 西藏宁算科技集团有限公司 Automatic driving decision method and system
US20220188667A1 (en) * 2020-12-15 2022-06-16 Woven Planet North America, Inc. Vehicle prediction module evaluation and training
CN115230721A (en) * 2022-08-31 2022-10-25 阿波罗智能技术(北京)有限公司 Perceptual data processing method, device and autonomous vehicle
CN115235476A (en) * 2022-09-26 2022-10-25 宁波均胜智能汽车技术研究院有限公司 Full-coverage path planning method and device, storage medium and electronic equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117056783A (en) * 2023-08-25 2023-11-14 重庆长安汽车股份有限公司 Driving trajectory decision-making method and device, equipment, computer-readable storage medium
CN118818952A (en) * 2024-06-27 2024-10-22 大卓智能科技有限公司 Track verification method, device, electronic device, storage medium and program product

Similar Documents

Publication Publication Date Title
CN112258841B (en) Intelligent vehicle risk assessment method based on vehicle track prediction
CN119283896B (en) A trajectory planning method for autonomous driving vehicles
Hu et al. Agentscomerge: Large language model empowered collaborative decision making for ramp merging
CN107272687A (en) A kind of driving behavior decision system of automatic Pilot public transit vehicle
CN117612140B (en) Road scene identification method and device, storage medium and electronic equipment
CN115837919A (en) Interactive behavior decision method and device for automatic driving vehicle and automatic driving vehicle
CN116164748A (en) Decision planning system and decision planning device for complex road conditions in urban areas
CN118968441A (en) A multi-vehicle joint trajectory prediction method based on vehicle intention learning
CN117950399A (en) An automatic obstacle avoidance decision method and system based on multimodal knowledge graph
CN119596948A (en) Extreme environment decision method of automatic driving system based on neural evolution game
Xue et al. Informer-FDR: A short-term vehicle speed prediction model in car-following scenario based on traffic environment
Yuan et al. Driving intention recognition and speed prediction at complex urban intersections considering traffic environment
Chi et al. Multi-modal GPT-4 aided action planning and reasoning for self-driving vehicles
Mobahi et al. An improved deep learning solution for object detection in self-driving cars
CN112180913A (en) Special vehicle identification method
Fourati et al. A Novel MLLM-Based Approach for Autonomous Driving in Different Weather Conditions
CN121209296B (en) A driving decision model optimization method and electronic device
Acharjee Driverless Car Using AI
CN121341228B (en) A method, device, electronic device and storage medium for controlling the driving of a vehicle.
CN119882431B (en) Data-driven autonomous driving decision optimization system and method
CN119781478B (en) Automatic driving decision planning method and system based on visual large language model
Li Research on pedestrian trajectory prediction method based on informer
US20260070577A1 (en) Computer-implemented method for generating a control command for an autonomous vehicle
Zou et al. Research on Anti-Collision System of Urban Road
Mo et al. Testing Methods for Advanced Intelligent Driving Systems Based on Natural Driving Behavior Characteristics

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination