CN114187365A - Camera and millimeter wave radar combined calibration method and system for roadside sensing system - Google Patents

Camera and millimeter wave radar combined calibration method and system for roadside sensing system Download PDF

Info

Publication number
CN114187365A
CN114187365A CN202111501492.9A CN202111501492A CN114187365A CN 114187365 A CN114187365 A CN 114187365A CN 202111501492 A CN202111501492 A CN 202111501492A CN 114187365 A CN114187365 A CN 114187365A
Authority
CN
China
Prior art keywords
camera
coordinates
calibrating
world coordinate
coordinate system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111501492.9A
Other languages
Chinese (zh)
Inventor
王亚飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lianlu Intelligent Transportation Technology Shanghai Co ltd
Original Assignee
Lianlu Intelligent Transportation Technology Shanghai Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lianlu Intelligent Transportation Technology Shanghai Co ltd filed Critical Lianlu Intelligent Transportation Technology Shanghai Co ltd
Priority to CN202111501492.9A priority Critical patent/CN114187365A/en
Publication of CN114187365A publication Critical patent/CN114187365A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/02Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
    • G01S7/40Means for monitoring or calibrating

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Radar Systems Or Details Thereof (AREA)
  • Traffic Control Systems (AREA)

Abstract

本发明提供了一种路侧感知系统的相机与毫米波雷达联合标定方法及系统,所述方法包括如下步骤:步骤S1:建立GPS到世界坐标系投影;步骤S2:对世界坐标进行相机标定;步骤S3:对雷达到世界坐标系进行标定;步骤S4:对世界坐标到GPS坐标进行转换。本发明通过GPS近似投影建立世界坐标系,具体实施可借助于高精度RTK设备,提高了测量精度及操作便捷性;实现雷达坐标、像素坐标、GPS坐标的相互转换,方便路侧感知系统直接输出检测目标的GPS坐标;引入GPS高程信息可针对平直路面以及坡度路面进行标定,相机、雷达安装位置及角度灵活,提高了路侧感知系统的适用性。

Figure 202111501492

The present invention provides a method and system for joint calibration of a camera and a millimeter-wave radar of a roadside perception system. The method includes the following steps: step S1: establishing a GPS to world coordinate system projection; step S2: performing camera calibration on world coordinates; Step S3: calibrating the radar to the world coordinate system; Step S4: converting the world coordinates to GPS coordinates. The present invention establishes the world coordinate system through GPS approximate projection, and the specific implementation can rely on high-precision RTK equipment, which improves the measurement accuracy and the convenience of operation; realizes the mutual conversion of radar coordinates, pixel coordinates and GPS coordinates, and facilitates the direct output of the roadside perception system Detect the GPS coordinates of the target; the introduction of GPS elevation information can be used for calibration of straight and sloped roads. The installation position and angle of cameras and radars are flexible, which improves the applicability of the roadside perception system.

Figure 202111501492

Description

Camera and millimeter wave radar combined calibration method and system for roadside sensing system
Technical Field
The invention relates to the technical field of intelligent traffic systems, in particular to a method and a system for jointly calibrating a camera and a millimeter wave radar of a roadside sensing system.
Background
The intelligent traffic system is a comprehensive system integrating a plurality of functions of environment dynamic cooperative sensing, data information processing, transmission and storage, traffic control and management and the like, and all main bodies such as people, vehicles, roads and the like become safer, more intelligent and more efficient by fully utilizing the modern advanced technology. The sensing part composed of various sensors plays an important role as senses of eyes, ears and the like in the intelligent traffic system.
And the multi-sensor fusion inevitably involves the joint calibration of multiple sensors. At present, a multi-sensor fusion scheme for automatic driving is mainly based on a laser radar, and comprises sensors such as a camera, a millimeter wave radar and an ultrasonic radar, wherein the installation positions of the sensors are relatively fixed, and a coordinate system is established based on a vehicle to sense the peripheral information of the vehicle. The roadside sensing system mainly detects traffic participants such as vehicle personnel on the road surface and the like, and needs to output GPS information of a sensing target to the RSU/OBU. The road traffic condition is complex, the camera and the radar are arranged on the fixed vertical rod, the installation angle and orientation of the camera and the radar are limited by the actual road trend, and the establishment of a coordinate system and the implementation of measurement engineering are difficult. Therefore, it is of great significance to discuss a combined calibration method applicable to road side perception (cameras and millimeter wave radars) of the road surface and capable of being implemented in an engineering mode.
A method, an apparatus, and a medium for detecting an object in which a roadside camera is fused with 4D millimeter waves are disclosed in patent document No. CN113655494A, the method for detecting an object including the steps of: acquiring a first image of a road side camera and a first point cloud of a 4D millimeter wave radar; projecting the first point cloud onto the first image, adding distance information on the first image, and acquiring a second image; taking the second image as the input of a depth completion convolution network to obtain a third image, wherein the third image is a dense depth image; converting the third image into a second point cloud, and encoding to generate a fourth image; inputting the fourth image into a convolutional neural network for target detection to obtain a target frame; and mapping the target frame into a 3D frame under a camera coordinate system, and adding speed information on the 3D frame based on the first point cloud.
In view of the above-mentioned technologies, it is necessary to provide a technical solution to improve the above-mentioned technical problems.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide a method and a system for calibrating a camera and a millimeter wave radar of a roadside sensing system in a combined manner.
According to the camera and millimeter wave radar combined calibration method of the roadside sensing system, provided by the invention, the method comprises the following steps:
step S1: establishing projection from a GPS to a world coordinate system;
step S2: calibrating a camera for world coordinates;
step S3: calibrating a world coordinate system from a radar;
step S4: the world coordinates are converted to GPS coordinates.
Preferably, the step S1 includes the steps of:
step S1.1: establishing a world coordinate system;
step S1.2: the GPS coordinates are projected into the world coordinate system.
Preferably, the establishing of the world coordinate system in step S1.1 specifically includes using the ground right below the camera as an origin P0, using the longitude and latitude of the point P0 as the Xw axis and Yw axis of the world coordinate, and using the point P0 as the Zw axis vertically above the ground.
Preferably, the step S2 includes the steps of:
step S2.1: calibrating an internal reference;
step S2.2: and (5) calibrating external reference.
Preferably, the radar coordinates in step S3 are obtained by means of a reflection target; the conversion between the radar coordinate system and the world coordinate is three-dimensional coordinate rigid body transformation.
The invention also provides a camera and millimeter wave radar combined calibration system of the roadside sensing system, which comprises the following modules:
module M1: establishing projection from a GPS to a world coordinate system;
module M2: calibrating a camera for world coordinates;
module M3: calibrating a world coordinate system from a radar;
module M4: the world coordinates are converted to GPS coordinates.
Preferably, the module M1 includes the following modules:
module M1.1: establishing a world coordinate system;
module M1.2: the GPS coordinates are projected into the world coordinate system.
Preferably, the world coordinate system established in the module M1.1 is specifically that the ground right below the camera is taken as an origin P0, the latitude and longitude lines of the point P0 are taken as the Xw axis and Yw axis of the world coordinate, and the point P0 is taken as the Zw axis vertically above the ground.
Preferably, the module M2 includes the following modules:
module M2.1: calibrating an internal reference;
module M2.2: and (5) calibrating external reference.
Preferably, the radar coordinates in the module M3 are obtained by means of a reflection target; the conversion between the radar coordinate system and the world coordinate is three-dimensional coordinate rigid body transformation.
Compared with the prior art, the invention has the following beneficial effects:
1. according to the invention, a world coordinate system is established through GPS approximate projection, and the high-precision RTK equipment can be used for specific implementation, so that the measurement precision and the operation convenience are improved;
2. the invention realizes the mutual conversion of radar coordinates, pixel coordinates and GPS coordinates, and facilitates the roadside sensing system to directly output the GPS coordinates of the detection target;
3. the GPS elevation information is introduced, calibration can be carried out on straight roads and gradient roads, the installation positions and angles of the camera and the radar are flexible, and the applicability of the roadside sensing system is improved.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
FIG. 1 is a diagram of a joint calibration coordinate model according to the present invention.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that it would be obvious to those skilled in the art that various changes and modifications can be made without departing from the spirit of the invention. All falling within the scope of the present invention.
The invention provides a high-precision GPS coordinate-based joint calibration method applicable to engineering implementation of cameras and millimeter wave radars on straight roads and gradient roads, which can directly output GPS information of a sensing target after sensing fusion; the method specifically comprises the following steps:
step S1: establishing projection from a GPS to a world coordinate system; step S1.1: establishing a world coordinate system; the ground right below the camera is taken as an origin P0, the latitude and longitude of a P0 point are taken as Xw axes and Yw of world coordinates, and a P0 point is taken as a Zw axis vertically above the ground. Step S1.2: projection of GPS coordinates into a world coordinate system; the high precision GPS coordinates can be obtained by RTK. Taking a certain point P1 on the ground as an example, RTK is used to measure P0 GPS coordinates (longitude, latitude, elevation) as (P0_ lo, P0_ la, P0_ h) and P1 GPS coordinates as (P1_ lo, P1_ la, P1_ h).
According to the triangular relation, the approximate projection coordinates of the GPS coordinates of the point P1 in the world coordinate system are obtained as follows:
equation 1: xw1 ═ f1(P1_ la, P0_ lo)
Equation 2: yw1 ═ f2(P1_ la, P0_ la)
Equation 3: zw1 ═ f3(P1_ h, P0_ h)
I.e., the world coordinate of point P1 is (Xw1, Yw1, Zw1)
Therefore, RTK can be used for acquiring the coordinates of each measuring point of the road surface in a world coordinate system.
Step S2: calibrating a camera; there are four coordinate systems in the camera, respectively world, camera, image, pixel.
The camera calibration is to calculate the internal and external parameters and distortion parameters of the camera, and realize the conversion from world coordinates to image coordinates.
The conversion formula of the pixel coordinates (u, v) to the world coordinates (x, y, z) is as follows:
equation 4:
Figure BDA0003401825980000041
wherein: s is a scaling factor;
Figure BDA0003401825980000042
is an internal reference matrix of the camera;
Figure BDA0003401825980000043
is the external parameter matrix RT of the camera.
Step S2.1: calibrating an internal reference; obtained by using a checkerboard-Zhang Zhengyou calibration algorithm to obtain (f)x,fy,cx,cy) I.e. the first matrix to the right of equation 4.
Step S2.2: calibrating external parameters; the RT matrix can be obtained by PNP estimation, the second matrix to the right of equation 4.
A Perspective-n-Point is a method for estimating the camera position by the world coordinates and pixel coordinates of n sets of given points.
Therefore, after the camera internal and external parameters are obtained through calibration, the conversion between the pixel coordinate and the world coordinate can be realized according to the formula 4.
Step S3: calibrating a radar to a world coordinate system; the radar coordinates can be obtained by means of a reflecting target such as an angular reflection (vehicle). Conversion between the radar coordinate system and world coordinates is converted into a three-dimensional coordinate rigid body, and the corresponding point coordinates of a point P in the coordinate system A in the coordinate system B can be calculated by only calculating a conversion matrix, namely:
PB=T*PA+t
PA: the coordinate of the point P in the coordinate system A;
PB: the coordinate of the point P in the coordinate system B;
t: a 3x3 transformation matrix;
t: a displacement of 3x1 transforms the vector.
Using the SVD calculation method, T and T, i.e. the RT matrix, can be calculated given at least 3 pairs of points.
Therefore, the mutual conversion from the radar coordinate to the world coordinate can be realized.
Step S4: converting world coordinates into GPS coordinates; taking a certain point P1 on the ground as an example, knowing the world coordinate of point P1 and the GPS coordinate of point P0 according to equations 1, 2 and 3, the GPS coordinate of point P1 can be deduced.
The implementation process of the invention is as follows:
1. point selection
Taking five points in total, and taking four points of P1, P2, P3 and P4 on the road surface; the world coordinate system origin P0 is taken directly below the camera.
2. Measuring
2.1, P1, P2, P3, P4 each point acquires three sets of data:
(1) radar coordinate system data (Xradar, Yradar, 0), radar coordinates of reflectors such as corner reflectors (vehicles) at corresponding points on the road surface are measured:
P1(Xradar,Yradar,0)、P2(Xradar,Yradar,0)、P3(Xradar,Yradar,0)、P4(Xradar,Yradar,0)。
(2) and acquiring GPS coordinates of each point on the road surface by using RTK, wherein the GPS elevation information of all points on the straight road surface can be uniformly set to be 0. And (3) taking elevation information actually measured by RTK on a slope road surface:
P1(lo,la,h)、P2(lo,la,h)、P3(lo,la,h)、P4(lo,la,h)。
(3) and (3) acquiring pixel coordinates of each point on the road surface through a camera capture:
P1(u,v)、P2(u,v)、P3(u,v)、P4(u,v)。
2.2, Point P0 GPS coordinates P0(lo, la, h)
The world coordinate of point P0 is (0, 0, H), and H is the camera mounting height.
3. Calculating the conversion of P1, P2, P3, P4 GPS coordinates to world coordinates
Taking P1, P2, P3 and P4 GPS coordinates and P0 point GPS coordinates:
p1(lo, la, h), P2(lo, la, h), P3(lo, la, h), P4(lo, la, h), P0(lo, la, h); with reference to formula 1, formula 2, and formula 3, the world coordinates of P1, P2, P3, and P4 are calculated, that is:
P1(Xworld,Yworld,Zworld)、P2(Xworld,Yworld,Zworld)、P3(Xworld,Yworld,Zworld)、P4(Xworld,Yworld,Zworld)。
4. conversion of computed radar coordinates to world coordinates
Taking the radar coordinates of P1, P2, P3 and P4:
P1(Xradar,Yradar,0)、P2(Xradar,Yradar,0)、P3(Xradar,Yradar,0)、P4(Xradar,Yradar,0)。
taking world coordinates of P1, P2, P3 and P4:
p1(Xworld, Yworld, zwold), P2(Xworld, Yworld, zwold), P3(Xworld, Yworld, zwold), P4(Xworld, Yworld, zwold); and obtaining an RT matrix from a radar coordinate system to a world coordinate system based on an SVD calculation method.
5. And (3) calculating external parameters of the camera, and obtaining R _ T from a world coordinate system to a pixel coordinate system:
taking world coordinates of P1, P2, P3 and P4:
P1(Xworld,Yworld,Zworld)、P2(Xworld,Yworld,Zworld)、P3(Xworld,Yworld,Zworld)、P4(Xworld,Yworld,Zworld)。
taking the coordinates of P1, P2, P3 and P4:
p1(u, v), P2(u, v), P3(u, v), P4(u, v); taking camera parameters, and calculating R _ T from a world coordinate system to a pixel coordinate system by using solvePnP.
6. Conversion of computing world coordinates to pixel coordinates
According to equation 4, the conversion of world coordinates to pixel coordinates can be achieved.
The invention also provides a camera and millimeter wave radar combined calibration system of the roadside sensing system, which comprises the following modules: module M1: establishing projection from a GPS to a world coordinate system; module M1.1: establishing a world coordinate system; the ground right below the camera is taken as an origin P0, the latitude and longitude of a P0 point are taken as the Xw axis and Yw of world coordinates, and the axis is the Zw axis when the point P0 is vertically above the ground. Module M1.2: the GPS coordinates are projected into the world coordinate system.
Module M2: calibrating a camera for world coordinates; module M2.1: calibrating an internal reference; module M2.2: and (5) calibrating external reference.
Module M3: calibrating a world coordinate system from a radar; the radar coordinates are obtained by means of a reflection target; the conversion between the radar coordinate system and the world coordinate is three-dimensional coordinate rigid body transformation.
Module M4: the world coordinates are converted to GPS coordinates.
According to the invention, a world coordinate system is established through GPS approximate projection, and the high-precision RTK equipment can be used for specific implementation, so that the measurement precision and the operation convenience are improved; the mutual conversion of radar coordinates, pixel coordinates and GPS coordinates is realized, and the roadside sensing system can directly output the GPS coordinates of the detected target conveniently; the introduced GPS elevation information can be calibrated for straight roads and gradient roads, the installation positions and angles of the camera and the radar are flexible, and the applicability of the roadside sensing system is improved.
Those skilled in the art will appreciate that, in addition to implementing the system and its various devices, modules, units provided by the present invention as pure computer readable program code, the system and its various devices, modules, units provided by the present invention can be fully implemented by logically programming method steps in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Therefore, the system and various devices, modules and units thereof provided by the invention can be regarded as a hardware component, and the devices, modules and units included in the system for realizing various functions can also be regarded as structures in the hardware component; means, modules, units for performing the various functions may also be regarded as structures within both software modules and hardware components for performing the method.
The foregoing description of specific embodiments of the present invention has been presented. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes or modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention. The embodiments and features of the embodiments of the present application may be combined with each other arbitrarily without conflict.

Claims (10)

1. A camera and millimeter wave radar combined calibration method for a roadside sensing system is characterized by comprising the following steps:
step S1: establishing projection from a GPS to a world coordinate system;
step S2: calibrating a camera for world coordinates;
step S3: calibrating a world coordinate system from a radar;
step S4: the world coordinates are converted to GPS coordinates.
2. The method for calibrating the camera and the millimeter wave radar of the roadside perception system as claimed in claim 1, wherein the step S1 includes the following steps:
step S1.1: establishing a world coordinate system;
step S1.2: the GPS coordinates are projected into the world coordinate system.
3. The method for calibrating a camera and millimeter wave radar in combination for a roadside sensing system according to claim 1, wherein the establishing of the world coordinate system in step S1.1 is specifically to use the ground right below the camera as an origin P0, use the longitude and latitude of a point P0 as the Xw axis and Yw axis of the world coordinate, and use the point P0 as the Zw axis vertically above the ground.
4. The method for calibrating the camera and the millimeter wave radar of the roadside perception system as claimed in claim 1, wherein the step S2 includes the following steps:
step S2.1: calibrating an internal reference;
step S2.2: and (5) calibrating external reference.
5. The method for calibrating the camera and the millimeter wave radar of the roadside sensing system as claimed in claim 1, wherein the radar coordinates in the step S3 are obtained by means of a reflection target; the conversion between the radar coordinate system and the world coordinate is three-dimensional coordinate rigid body transformation.
6. The camera and millimeter wave radar combined calibration system of the road side sensing system is characterized by comprising the following modules:
module M1: establishing projection from a GPS to a world coordinate system;
module M2: calibrating a camera for world coordinates;
module M3: calibrating a world coordinate system from a radar;
module M4: the world coordinates are converted to GPS coordinates.
7. The system for calibrating the roadside perception system camera and the millimeter wave radar in combination according to claim 6, wherein the module M1 comprises the following modules:
module M1.1: establishing a world coordinate system;
module M1.2: the GPS coordinates are projected into the world coordinate system.
8. The system for calibrating the roadside perception system camera and millimeter wave radar in combination as set forth in claim 6, wherein the module M1.1 establishes the world coordinate system, specifically, the ground right below the camera is taken as an origin P0, the longitude and latitude of the point P0 are taken as the Xw axis and Yw axis of the world coordinate, the axis is the Xw axis, and the point P0 is taken as the Zw axis vertically above the ground.
9. The system for calibrating the roadside perception system camera and the millimeter wave radar in combination according to claim 6, wherein the module M2 comprises the following modules:
module M2.1: calibrating an internal reference;
module M2.2: and (5) calibrating external reference.
10. The system for calibrating the roadside perception system by combining the camera and the millimeter wave radar according to claim 6, wherein the radar coordinates in the module M3 are obtained by means of a reflection target; the conversion between the radar coordinate system and the world coordinate is three-dimensional coordinate rigid body transformation.
CN202111501492.9A 2021-12-09 2021-12-09 Camera and millimeter wave radar combined calibration method and system for roadside sensing system Pending CN114187365A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111501492.9A CN114187365A (en) 2021-12-09 2021-12-09 Camera and millimeter wave radar combined calibration method and system for roadside sensing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111501492.9A CN114187365A (en) 2021-12-09 2021-12-09 Camera and millimeter wave radar combined calibration method and system for roadside sensing system

Publications (1)

Publication Number Publication Date
CN114187365A true CN114187365A (en) 2022-03-15

Family

ID=80604121

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111501492.9A Pending CN114187365A (en) 2021-12-09 2021-12-09 Camera and millimeter wave radar combined calibration method and system for roadside sensing system

Country Status (1)

Country Link
CN (1) CN114187365A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116229713A (en) * 2023-02-09 2023-06-06 同济大学 A spatial alignment method and system for vehicle-road coordination
CN117008165A (en) * 2023-06-28 2023-11-07 上海智能网联汽车技术中心有限公司 On-site calibration-free roadside unit pre-calibration method and on-site calibration-free roadside unit
CN117784121A (en) * 2024-02-23 2024-03-29 四川天府新区北理工创新装备研究院 A roadside sensor joint calibration method, system and electronic equipment
CN119832503A (en) * 2025-03-20 2025-04-15 浙江大学 Video target fusion method for drive test sensing system

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014137321A (en) * 2013-01-18 2014-07-28 Nec Corp Position coordinate conversion system, position coordinate conversion method, on-vehicle device, global coordinate measurement device and position coordinate conversion program
CN107464264A (en) * 2016-06-02 2017-12-12 南京理工大学 A kind of camera parameter scaling method based on GPS
CN109871019A (en) * 2019-02-28 2019-06-11 北京百度网讯科技有限公司 Method and apparatus for obtaining coordinate
CN110532896A (en) * 2019-08-06 2019-12-03 北京航空航天大学 A road vehicle detection method based on the fusion of roadside millimeter-wave radar and machine vision
CN111787481A (en) * 2020-06-17 2020-10-16 北京航空航天大学 A 5G-based high-precision perception method for road-vehicle coordination
CN112836737A (en) * 2021-01-29 2021-05-25 同济大学 An online calibration method for roadside combined sensing equipment based on vehicle-road data fusion
CN113093254A (en) * 2021-04-12 2021-07-09 南京速度软件技术有限公司 Multi-sensor fusion based vehicle positioning method in viaduct with map features
CN113514803A (en) * 2021-03-25 2021-10-19 武汉光庭信息技术股份有限公司 Combined calibration method for monocular camera and millimeter wave radar
CN114814758A (en) * 2022-06-24 2022-07-29 国汽智控(北京)科技有限公司 Camera-millimeter wave radar-laser radar combined calibration method and device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014137321A (en) * 2013-01-18 2014-07-28 Nec Corp Position coordinate conversion system, position coordinate conversion method, on-vehicle device, global coordinate measurement device and position coordinate conversion program
CN107464264A (en) * 2016-06-02 2017-12-12 南京理工大学 A kind of camera parameter scaling method based on GPS
CN109871019A (en) * 2019-02-28 2019-06-11 北京百度网讯科技有限公司 Method and apparatus for obtaining coordinate
CN110532896A (en) * 2019-08-06 2019-12-03 北京航空航天大学 A road vehicle detection method based on the fusion of roadside millimeter-wave radar and machine vision
CN111787481A (en) * 2020-06-17 2020-10-16 北京航空航天大学 A 5G-based high-precision perception method for road-vehicle coordination
CN112836737A (en) * 2021-01-29 2021-05-25 同济大学 An online calibration method for roadside combined sensing equipment based on vehicle-road data fusion
CN113514803A (en) * 2021-03-25 2021-10-19 武汉光庭信息技术股份有限公司 Combined calibration method for monocular camera and millimeter wave radar
CN113093254A (en) * 2021-04-12 2021-07-09 南京速度软件技术有限公司 Multi-sensor fusion based vehicle positioning method in viaduct with map features
CN114814758A (en) * 2022-06-24 2022-07-29 国汽智控(北京)科技有限公司 Camera-millimeter wave radar-laser radar combined calibration method and device

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
LEONARDOHAIG: "毫米波雷达与视觉融合———联合标定及外参标定问题", Retrieved from the Internet <URL:https://blog.csdn.net/leonardohaig/article/details/88724365> *
ZHENGYOU ZHANG等: "A Flexible New Technique for Camera Calibration", A FLEXIBLE NEW TECHNIQUE FOR CAMERA CALIBRATION, 6 August 2002 (2002-08-06), pages 1330 *
孔筱芳等: "基于全球定位系统的相机标定方法研究", 兵工学报, no. 12, 15 December 2016 (2016-12-15), pages 127 - 133 *
杨洋等: "机器人控制理论基础", 31 October 2021, 机械工业出版社, pages: 207 - 209 *
陈少春等: "海鹰智库丛书 导航制导与控制技术篇", 31 January 2021, 北京理工大学出版社, pages: 15 - 19 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116229713A (en) * 2023-02-09 2023-06-06 同济大学 A spatial alignment method and system for vehicle-road coordination
CN117008165A (en) * 2023-06-28 2023-11-07 上海智能网联汽车技术中心有限公司 On-site calibration-free roadside unit pre-calibration method and on-site calibration-free roadside unit
WO2025001656A1 (en) * 2023-06-28 2025-01-02 上海智能网联汽车技术中心有限公司 Onsite calibration-free roadside unit pre-calibration method and onsite calibration-free roadside unit
CN117784121A (en) * 2024-02-23 2024-03-29 四川天府新区北理工创新装备研究院 A roadside sensor joint calibration method, system and electronic equipment
CN119832503A (en) * 2025-03-20 2025-04-15 浙江大学 Video target fusion method for drive test sensing system

Similar Documents

Publication Publication Date Title
CN113359097B (en) Millimeter wave radar and camera combined calibration method
CN114187365A (en) Camera and millimeter wave radar combined calibration method and system for roadside sensing system
CN113985405B (en) Obstacle detection method and obstacle detection device for vehicle
CN110031829B (en) An accurate ranging method for targets based on monocular vision
US11953602B2 (en) Detecting three-dimensional structure models at runtime in vehicles
CN109764858B (en) A monocular camera-based photogrammetry method and system
CN108020826A (en) Multi-line laser radar and multichannel camera mixed calibration method
CN114413958A (en) Monocular vision distance and speed measurement method of unmanned logistics vehicle
CN103759670A (en) Object three-dimensional information acquisition method based on digital close range photography
CN111538008B (en) Transformation matrix determining method, system and device
CN113205604A (en) Feasible region detection method based on camera and laser radar
CN116030202B (en) Three-dimensional image reconstruction method and device, electronic equipment and storage medium
CN111382591B (en) Binocular camera ranging correction method and vehicle-mounted equipment
CN105551020A (en) Method and device for detecting dimensions of target object
CN111208493A (en) Rapid calibration method of vehicle-mounted laser radar in whole vehicle coordinate system
CN115690017A (en) Road inspection method, device, computer equipment and storage medium
CN115523929B (en) SLAM-based vehicle-mounted integrated navigation method, device, equipment and medium
CN113465572A (en) Monocular distance measurement method and system based on camera imaging geometric relation
CN100417231C (en) Stereo vision hardware-in-the-loop simulation system and method
CN117523086A (en) Multi-mode data three-dimensional scene reconstruction method and device
CN115984218A (en) A tunnel detection system based on binocular vision
CN115248446B (en) Three-dimensional ultrasonic imaging method and system based on laser radar
CN110068308A (en) A kind of distance measuring method and range-measurement system based on more mesh cameras
CN115359459B (en) Road sign board recognition system and detection, positioning and evaluation method
CN111141252B (en) Monocular calibration ranging method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20220315