CN104794425A - Vehicle counting method based on movement track - Google Patents

Vehicle counting method based on movement track Download PDF

Info

Publication number
CN104794425A
CN104794425A CN201410805130.2A CN201410805130A CN104794425A CN 104794425 A CN104794425 A CN 104794425A CN 201410805130 A CN201410805130 A CN 201410805130A CN 104794425 A CN104794425 A CN 104794425A
Authority
CN
China
Prior art keywords
coordinate system
coordinate
point
relative distance
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410805130.2A
Other languages
Chinese (zh)
Other versions
CN104794425B (en
Inventor
宋焕生
赵倩倩
崔华
李怀宇
朱龙生
李钢
公维宾
王璇
孙士杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changan University
Original Assignee
Changan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changan University filed Critical Changan University
Priority to CN201410805130.2A priority Critical patent/CN104794425B/en
Publication of CN104794425A publication Critical patent/CN104794425A/en
Application granted granted Critical
Publication of CN104794425B publication Critical patent/CN104794425B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Traffic Control Systems (AREA)

Abstract

本发明公开了一种基于车辆轨迹的统计方法,涉及交通检测领域。所述发明包括稳定特征点的选取与跟踪,利用稳定特征点在真实空间中轨迹的同时刻相对距离之间的关系变化进行聚类,当同时刻相对距离的方差小于预设阈值时,不更新所述车辆计数器的计数值,当所述同时刻相对距离的方差大于预设阈值时所述车辆计数器的计数值加一。本发明通过提取拍摄到的道路视频图像中的车辆轨迹,对其中的车辆轨迹进行处理,得到轨迹在同时刻的相对距离,根据同时刻相对距离的变化关系确定该视频图像内的车辆数目,使得在车辆数目的统计过程中避免了环境的影响以及仅能统计单一车型的限制,提高了车辆数目的统计精度和统计效率。

The invention discloses a statistical method based on vehicle tracks, which relates to the field of traffic detection. The invention includes the selection and tracking of stable feature points, clustering is performed by using the relationship changes between the relative distances of the stable feature points in the real space trajectory at the same moment, and when the variance of the relative distance at the same moment is less than the preset threshold, no update The count value of the vehicle counter, when the variance of the relative distance at the same time is greater than a preset threshold, the count value of the vehicle counter is increased by one. The present invention extracts the vehicle trajectory in the captured road video image, processes the vehicle trajectory therein, obtains the relative distance of the trajectory at the same time, and determines the number of vehicles in the video image according to the variation relationship of the relative distance at the same time, so that In the process of counting the number of vehicles, the influence of the environment and the limitation that only a single vehicle type can be counted are avoided, and the statistical precision and efficiency of the number of vehicles are improved.

Description

一种基于行驶轨迹的车辆统计方法A Vehicle Statistical Method Based on Trajectory

技术领域technical field

本发明涉及交通检测领域,特别涉及一种基于车辆轨迹的统计方法。The invention relates to the field of traffic detection, in particular to a statistical method based on vehicle tracks.

背景技术Background technique

随着经济的快速发展,汽车的保有量在迅速增长,为了减少因汽车数量增长带来的交通拥堵问题,需要获取道路上的实时的汽车数量,以便及时进行交通疏导。With the rapid development of the economy, the number of cars is increasing rapidly. In order to reduce the traffic congestion caused by the increase in the number of cars, it is necessary to obtain the real-time number of cars on the road for timely traffic management.

在现有的技术中,进行车辆统计的方法主要有地感线圈法,波频检测法等,其中地感线圈法是行驶的车辆通过埋有线圈的路面,引起线圈磁场的变化,使得检测器获取该车辆的数目;而波频检测法则是向一定区域内发射连续的低功率调制电磁波,在路面上留下一条投影,并按照规定的距离将该投影区域分为多层,当车辆进入该投影区域后,会反射电磁波,进而由接收器接收,根据固定车型的车厂与接收到反射电磁波的时间,估算经过投影区域的车辆数目。In the existing technology, the methods for vehicle statistics mainly include the ground induction coil method, wave frequency detection method, etc., wherein the ground induction coil method is that the driving vehicle passes through the road surface buried with coils, causing the change of the coil magnetic field, so that the detector Obtain the number of the vehicle; and the wave frequency detection method is to launch continuous low-power modulated electromagnetic waves into a certain area, leaving a projection on the road surface, and divide the projection area into multiple layers according to the specified distance. When the vehicle enters the After the projected area, electromagnetic waves will be reflected and then received by the receiver. According to the car manufacturer of the fixed model and the time when the reflected electromagnetic wave is received, the number of vehicles passing through the projected area is estimated.

在实现本发明的过程中,发明人发现现有技术至少存在以下问题:In the process of realizing the present invention, the inventor finds that there are at least the following problems in the prior art:

使用地感线圈法的线圈被埋在地下,容易受到冰冻、路基下沉、盐碱等环境的影响,导致精度受到影响;而波频检测法虽然精度不会受到影响,但是由于发射的电磁波频率单一,仅能对预设的一类车型进行统计,一旦出现多种车型,就不能进行准确统计,降低了统计效率。The coil using the ground induction coil method is buried underground, which is easily affected by freezing, subsidence of the roadbed, saline-alkali and other environments, which will affect the accuracy; although the accuracy of the wave frequency detection method will not be affected, but due to the frequency of the emitted electromagnetic wave Single, only one type of vehicle type can be counted. Once multiple types of vehicle types appear, accurate statistics cannot be carried out, which reduces the statistical efficiency.

发明内容Contents of the invention

为了解决现有技术的问题,本发明提供了一种基于行驶轨迹的车辆统计方法,所述方法用于对拍摄到的道路视频图像进行处理,所述方法包括:In order to solve the problems of the prior art, the present invention provides a vehicle statistics method based on driving trajectory, the method is used to process the captured road video images, and the method includes:

在所述视频图像中选取第一数量的样本点,在所述视频图像中建立第一坐标系,在实际空间中建立第二坐标系,确定所述第一数量样本点在所述第一坐标系中的坐标和在所述第二坐标系中的坐标,根据所述第一数量样本点在所述第一坐标系中的坐标和在所述第二坐标系中的坐标确定坐标转换矩阵;Select a first number of sample points in the video image, establish a first coordinate system in the video image, establish a second coordinate system in real space, and determine the first number of sample points at the first coordinates Coordinates in the first coordinate system and coordinates in the second coordinate system, determine a coordinate transformation matrix according to the coordinates of the first number of sample points in the first coordinate system and the coordinates in the second coordinate system;

将所述视频图像进行处理,得到二值化后的图像;Processing the video image to obtain a binarized image;

在所述视频图像中选取特征点,确定所述特征点在所述第一坐标系内的坐标,在所述二值化后的图像中确定与所述特征点对应的垂足点,确定所述垂足点在所述第一坐标系内的坐标;Select feature points in the video image, determine the coordinates of the feature points in the first coordinate system, determine the foot point corresponding to the feature points in the binarized image, and determine the feature points. the coordinates of the foot point in the first coordinate system;

根据所述特征点在所述第一坐标系内的坐标,结合所述坐标转换矩阵,获取所述特征点在所述第二坐标系内的坐标,根据所述特征点在所述第二坐标系内的坐标,确定稳定特征点;According to the coordinates of the feature points in the first coordinate system, combined with the coordinate transformation matrix, obtain the coordinates of the feature points in the second coordinate system, and according to the coordinates of the feature points in the second coordinate system Coordinates in the system to determine stable feature points;

获取所述稳定特征点在每帧所述视频图像中的所述第一坐标系中的坐标,结合所述坐标转换矩阵,确定所述稳定特征点在所述第二坐标系内的连续坐标,根据所述连续坐标,确定移动轨迹;Obtaining the coordinates of the stable feature points in the first coordinate system in each frame of the video image, and combining the coordinate transformation matrix to determine the continuous coordinates of the stable feature points in the second coordinate system, determining a movement trajectory according to the continuous coordinates;

在所述第二坐标系内选取基准检测线,在所述移动轨迹经过所述基准检测线时,对所述移动轨迹中的所述稳定特征点的高度值进行滤波处理,得到处理后的均值;Select a reference detection line in the second coordinate system, and when the movement trajectory passes the reference detection line, perform filtering processing on the height values of the stable feature points in the movement trajectory to obtain a processed mean value ;

获取多组所述移动轨迹的同时刻相对距离,当所述同时刻相对距离的方差大于预设阈值时,更新车辆计数器的计数值,依次对将获取到的所述移动轨迹的同时刻相对距离的方差进行判断,直至判断结束,根据所述车辆计数器的所述计数值,确定所述视频图像中的车辆数目。Obtain multiple sets of relative distances at the same time of the moving track, when the variance of the relative distance at the same time is greater than a preset threshold, update the count value of the vehicle counter, and sequentially compare the relative distance at the same time of the moving track to be acquired Judgment is made until the judgment ends, and the number of vehicles in the video image is determined according to the count value of the vehicle counter.

可选的,所述将所述视频图像进行处理,得到二值化后的图像包括:Optionally, the processing of the video image to obtain a binarized image includes:

将视频中的每一帧图像的背景移除,得到仅存在车辆主体的初始二值化图像;Remove the background of each frame of image in the video to obtain an initial binarized image with only the vehicle subject;

对所述初始二值化目标图像进行连通域分析和孔洞填充,得到处理后的二值化后的图像。Connected domain analysis and hole filling are performed on the initial binarized target image to obtain a processed binarized image.

可选的,在所述二值化后的图像中确定与所述特征点对应的垂足点,包括:Optionally, determining the foot point corresponding to the feature point in the binarized image includes:

在所述二值化后的图像中,从所述特征点起始,结合所述第一坐标系,向垂直方向做垂线,所述垂线与所述二值化后的图像中的交界处存在一交点,令所述交点为与所述特征点对应的所述垂足点。In the binarized image, starting from the feature point, combined with the first coordinate system, a vertical line is drawn in the vertical direction, and the intersection between the vertical line and the binarized image There is an intersection point at , and let the intersection point be the foot point corresponding to the feature point.

可选的,所述根据所述特征点在所述第二坐标系内的坐标,确定稳定特征点,包括:Optionally, the determining stable feature points according to the coordinates of the feature points in the second coordinate system includes:

在所述第二坐标系内,确定所述特征点的高度值;In the second coordinate system, determine the height value of the feature point;

当所述高度值小于预设的高度阈值时,令所述特征点为所述稳定特征点。When the height value is less than a preset height threshold, the feature point is the stable feature point.

可选的,在所述确定移动轨迹后,所述方法还包括:Optionally, after the determination of the movement trajectory, the method further includes:

利用卡尔曼滤波对所述移动轨迹进行平滑处理,根据所述平滑处理后的对所述移动轨迹进行修正,得到修正后的轨迹。The moving track is smoothed by Kalman filtering, and the moving track is corrected according to the smoothed track to obtain a corrected track.

可选的,所述对所述移动轨迹中的所述稳定特征点的高度值进行滤波处理,得到处理后的均值,根据所述均值对所述移动轨迹进行修正,包括:Optionally, performing filtering processing on the height values of the stable feature points in the moving trajectory to obtain a processed mean value, and correcting the moving trajectory according to the mean value, including:

提取所述移动轨迹中全部所述稳定特征点的高度值;Extracting the height values of all the stable feature points in the moving track;

获取全部所述高度值的平均值;Obtain the average value of all said height values;

根据所述平均值对所述移动轨迹进行修正。The moving track is corrected according to the average value.

可选的,在所述获取多组所述移动轨迹的相对距离后,所述方法还包括:Optionally, after the acquisition of the relative distances of multiple sets of the moving tracks, the method further includes:

当所述同时刻相对距离的方差小于预设阈值时,将所述相对距离对应的两个所述移动轨迹标记为同一组,不更新所述车辆计数器的计数值;否则,当所述同时刻相对距离的方差大于预设阈值时,将所述相对距离对应的两个所述移动轨迹标记为不同组,令所述车辆计数器的计数值加一,继续将获取到的所述移动轨迹的相对距离进行判断,直至判断结束。When the variance of the relative distance at the same time is less than a preset threshold, mark the two moving trajectories corresponding to the relative distance as the same group, and do not update the count value of the vehicle counter; otherwise, when the same time When the variance of the relative distance is greater than the preset threshold, mark the two moving trajectories corresponding to the relative distance as different groups, add one to the count value of the vehicle counter, and continue to obtain the relative distance of the moving trajectories. The distance is judged until the end of the judgment.

本发明提供的技术方案带来的有益效果是:The beneficial effects brought by the technical scheme provided by the invention are:

通过提取拍摄到的道路视频图像中的车辆轨迹,对其中的车辆轨迹进行处理,得到轨迹在同时刻的相对距离,根据同时刻相对距离的变化关系确定该视频图像内的车辆数目,使得在车辆数目的统计过程中避免了环境的影响以及仅能统计单一车型的限制,提高了车辆数目的统计精度和统计效率。By extracting the vehicle trajectory in the captured road video image, and processing the vehicle trajectory, the relative distance of the trajectory at the same time is obtained, and the number of vehicles in the video image is determined according to the change relationship of the relative distance at the same time, so that in the vehicle The process of counting the number avoids the influence of the environment and the limitation that only a single vehicle type can be counted, and improves the statistical accuracy and efficiency of the number of vehicles.

附图说明Description of drawings

为了更清楚地说明本发明的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solution of the present invention more clearly, the accompanying drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. Ordinary technicians can also obtain other drawings based on these drawings on the premise of not paying creative work.

图1是本发明提供的一种基于行驶轨迹的车辆统计方法的流程示意图;Fig. 1 is a schematic flow chart of a vehicle statistics method based on driving trajectory provided by the present invention;

图2是本发明提供的统计方法中选取样本点的示意图;Fig. 2 is the schematic diagram of selecting sample points in the statistical method provided by the present invention;

图3是本发明提供的统计方法中获取到的二值化图像;Fig. 3 is the binary image obtained in the statistical method provided by the present invention;

图4是本发明提供的统计方法中在二值化图像中确定特征点以及对应的垂足的示意图。Fig. 4 is a schematic diagram of determining feature points and corresponding feet in a binarized image in the statistical method provided by the present invention.

图5是本发明提供的统计方法中多个稳定特征点形成移动轨迹的示意图;Fig. 5 is a schematic diagram of a moving track formed by a plurality of stable feature points in the statistical method provided by the present invention;

图6是本发明提供的统计方法中确定检测线示意图;Fig. 6 is a schematic diagram of determining detection lines in the statistical method provided by the present invention;

图7是本发明提供的统计方法中对获取到的移动轨迹进行分析的示意图。Fig. 7 is a schematic diagram of analyzing the acquired movement trajectory in the statistical method provided by the present invention.

具体实施方式detailed description

为使本发明的结构和优点更加清楚,下面将结合附图对本发明的结构作进一步地描述。In order to make the structure and advantages of the present invention clearer, the structure of the present invention will be further described below in conjunction with the accompanying drawings.

实施例一Embodiment one

本发明提供了一种基于行驶轨迹的车辆统计方法,所述方法用于对拍摄到的道路视频图像进行处理,如图1所示,所述方法包括:The present invention provides a vehicle statistics method based on driving trajectory, the method is used to process the captured road video images, as shown in Figure 1, the method includes:

101、在视频图像中选取第一数量的样本点,在视频图像中建立第一坐标系,在实际空间中建立第二坐标系,确定第一数量样本点在第一坐标系中的坐标和在第二坐标系中的坐标,根据第一数量样本点在第一坐标系中的坐标和在第二坐标系中的坐标确定坐标转换矩阵。101. Select the first number of sample points in the video image, establish the first coordinate system in the video image, establish the second coordinate system in the actual space, and determine the coordinates of the first number of sample points in the first coordinate system and the coordinates in the second coordinate system, and determine a coordinate transformation matrix according to the coordinates of the first number of sample points in the first coordinate system and the coordinates in the second coordinate system.

在实施中,第一坐标系是基于视频图像建立的,即为X-Y平面坐标系,而第二坐标系是基于实际场景建立的,即为X-Y-Z立体坐标系,这里的第一数量的样本点至少为六个已知坐标的点,其中至少四个点为平面坐标系上的点,至少两个为立体坐标系中具有高度值(即在Z轴上具有非零坐标值)的点。In implementation, the first coordinate system is established based on the video image, that is, the X-Y plane coordinate system, and the second coordinate system is established based on the actual scene, that is, the X-Y-Z three-dimensional coordinate system, where the first number of sample points is at least are six points with known coordinates, at least four of which are points on the plane coordinate system, and at least two are points with height values (that is, non-zero coordinate values on the Z axis) in the solid coordinate system.

为了便于描述,在本实施例中选取的六个点位置如图2所示,其中(i,j,k,l,m,n)在第二坐标系的坐标值为i=(15,0,0),j=(15,15,0),k=(0,15,0),l=(0,0,0),m=(0,0,1.1),n=(0,15,1.1),(i,j,k,l,m,n)在第一坐标系中的坐标值与在图像中的位置有关。由(i,j,k,l,m,n)在第一坐标系和第二坐标系中的对应关系确定转换矩阵C。For the convenience of description, the six point positions selected in this embodiment are shown in Figure 2, where the coordinate values of (i, j, k, l, m, n) in the second coordinate system are i=(15,0 ,0), j=(15,15,0), k=(0,15,0), l=(0,0,0), m=(0,0,1.1), n=(0,15 ,1.1), the coordinate values of (i, j, k, l, m, n) in the first coordinate system are related to the position in the image. The conversion matrix C is determined by the corresponding relationship between (i, j, k, l, m, n) in the first coordinate system and the second coordinate system.

上述转换矩阵C的计算公式为:The calculation formula of the above conversion matrix C is:

uu vv ll == CC xx ythe y zz ll ,, -- -- -- (( 11 ))

坐标(x,y,z,1)对应的点Q为第二坐标系中的点,坐标(u,v,1)对应的点q为Q在第一坐标系中对应的点。上述坐标之所以使用齐次坐标是因为在求转换矩阵C的过程中,需要进行相机坐标系、图像坐标系和世界坐标系之间的转换,利用齐次坐标便于进行坐标系之间的转换。The point Q corresponding to the coordinates (x, y, z, 1) is a point in the second coordinate system, and the point q corresponding to the coordinates (u, v, 1) is the point corresponding to Q in the first coordinate system. The above coordinates use homogeneous coordinates because in the process of obtaining the transformation matrix C, conversion between the camera coordinate system, the image coordinate system and the world coordinate system is required. Using homogeneous coordinates facilitates the conversion between coordinate systems.

102、将视频图像进行处理,得到二值化后的图像。102. Process the video image to obtain a binarized image.

该步骤具体包括:This step specifically includes:

将视频中的每一帧图像的背景移除,得到仅存在车辆主体的初始二值化图像;Remove the background of each frame of image in the video to obtain an initial binarized image with only the vehicle subject;

对初始二值化目标图像进行连通域分析和孔洞填充,得到处理后的二值化后的图像。Connected domain analysis and hole filling are performed on the initial binarized target image to obtain the processed binarized image.

在实施中,针对视频图像中的每一帧图像,作如下处理:In implementation, for each frame image in the video image, do the following processing:

首先,确定视频图像中每一帧图像的目标主体。First, identify the target subject for each frame of the video image.

可选的,本实施例中图像的目标主体为单一的车辆。Optionally, the target subject of the image in this embodiment is a single vehicle.

其次,在每一帧图像中,将除目标主体之外的背景移除,并对剩余的带有目标主体的图像继续二值化处理,得到初始二值化图像。Secondly, in each frame of image, the background except the target subject is removed, and the remaining images with the target subject are binarized to obtain the initial binarized image.

可选的,在每一帧图像中确认目标主体后,可以将除目标主体之外的背景部分置为黑色,将目标主体置为白色,这样就得到了初始二值化图像。当然这里也可以使用其他二值化算法,得到类似的初始二值化图像。Optionally, after confirming the target subject in each frame of image, the background part except the target subject can be set to black, and the target subject can be set to white, so that an initial binarized image is obtained. Of course, other binarization algorithms can also be used here to obtain a similar initial binarization image.

最后,对初始二值化图像进行连通域分析和孔洞填充,得到处理后的二值化图像。Finally, the connected domain analysis and hole filling are performed on the initial binary image to obtain the processed binary image.

可选的,由于在之前得到的初始二值化图像中由于算法限制,会在初始二值化图像中留下毛刺、隔断等特征,针对存在的上述特征,这可以使用连通域分析和孔洞填充的方法,将存在的毛刺和隔断等特征去除,得到相对于初始二值化图像更为清楚明确的二值化图像,二值化图像如图3所示。Optionally, due to algorithm limitations in the previously obtained initial binary image, features such as burrs and cut-offs will be left in the initial binary image. For the above-mentioned features that exist, this can use connected domain analysis and hole filling The method removes the existing features such as burrs and partitions, and obtains a clearer and clearer binarized image than the original binarized image. The binarized image is shown in Figure 3.

103、在视频图像中选取特征点,确定特征点在第一坐标系内的坐标,在二值化后的图像中确定与特征点对应的垂足点,确定垂足点在第一坐标系内的坐标。103. Select feature points in the video image, determine the coordinates of the feature points in the first coordinate system, determine the foot points corresponding to the feature points in the binarized image, and determine that the foot points are in the first coordinate system coordinate of.

其中,在二值化后的图像中确定与特征点对应的垂足点,包括:Wherein, determining the foot point corresponding to the feature point in the binarized image includes:

在二值化后的图像中,从特征点起始,结合第一坐标系,向垂直方向做垂线,垂线与二值化后的图像中的交界处存在一交点,令交点为与特征点对应的垂足点。In the binarized image, starting from the feature point, combined with the first coordinate system, a vertical line is drawn in the vertical direction. There is an intersection point between the vertical line and the binarized image, and the intersection point is the feature point corresponding to the foot point.

在实施中,从视频图像中选取特征点,并得到该特征点在第一坐标系内的坐标,在如图4所示的二值化图像中,确定的特征点为f,在第一坐标系中,从该特征点开始沿垂直方向做垂线,该垂线与目标图像的边界处相交于点b,该点b为特征点f对应的垂足。In the implementation, the feature point is selected from the video image, and the coordinates of the feature point in the first coordinate system are obtained. In the binarized image as shown in Figure 4, the determined feature point is f, and at the first coordinate In the system, a vertical line is drawn along the vertical direction from the feature point, and the vertical line intersects with the boundary of the target image at point b, which is the vertical foot corresponding to the feature point f.

104、根据特征点在第一坐标系内的坐标,结合坐标转换矩阵,获取特征点在第二坐标系内的坐标,根据特征点在第二坐标系内的坐标,确定稳定特征点。104. Obtain the coordinates of the feature points in the second coordinate system according to the coordinates of the feature points in the first coordinate system combined with the coordinate transformation matrix, and determine the stable feature points according to the coordinates of the feature points in the second coordinate system.

其中,根据特征点在第二坐标系内的坐标,确定稳定特征点,包括:Among them, according to the coordinates of the feature points in the second coordinate system, the stable feature points are determined, including:

在第二坐标系内,确定特征点的高度值;In the second coordinate system, determine the height value of the feature point;

当高度值小于预设的高度阈值时,令特征点为稳定特征点。When the height value is less than the preset height threshold, the feature point is a stable feature point.

在实施中,由特征点的图像坐标(x,y)、转换矩阵C以及特征点的X-Y轴平面坐标系的平面坐标(X,Y),可求得特征点在3D空间中的坐标值为(X,Y,Z),对于其中的高度值Z的计算过程,如下所示:In the implementation, from the image coordinates (x, y) of the feature points, the transformation matrix C and the plane coordinates (X, Y) of the X-Y axis plane coordinate system of the feature points, the coordinate values of the feature points in the 3D space can be obtained as (X,Y,Z), for the calculation process of the height value Z, as follows:

在图4中,f=(x,y)为特征点,b=(u,v)为垂足点;根据已知的转换矩阵C,带入公式(2)In Fig. 4, f=(x, y) is the feature point, b=(u, v) is the foot point; according to the known transformation matrix C, it is brought into the formula (2)

uu vv ll == CC Xx YY 00 ll ,, -- -- -- (( 22 ))

中求得垂足点b对应第二坐标系的坐标(X,Y,0);又由于稳定特征点与垂足点在第二坐标系中处于同一条垂线上,所以第二坐标系中特征点F与垂足点B的(X,Y)坐标值相同,已知特征点在第一坐标系中的坐标值(x,y)带入公式(3)Obtain the coordinates (X, Y, 0) of the foot point b corresponding to the second coordinate system; and because the stable feature point and the foot point are on the same vertical line in the second coordinate system, so in the second coordinate system The (X, Y) coordinate values of the feature point F and the foot point B are the same, and the coordinate values (x, y) of the known feature point in the first coordinate system are brought into the formula (3)

xx ythe y ll == CC Xx YY ZZ ll ,, -- -- -- (( 33 ))

求得高度值Z。Get the height value Z.

在根据上述步骤确定了特征点的高度值Z后,如果该高度值Z小于预设高度阈值Th,则将该高度值Z对应的特征点作为稳定特征点;如果该高度值Z大于或等于预设高度阈值Th,则放弃该特征点,继续下一特征点的比较,直至将全部特征点比较完毕。After the height value Z of the feature point is determined according to the above steps, if the height value Z is less than the preset height threshold Th, the feature point corresponding to the height value Z is used as a stable feature point; if the height value Z is greater than or equal to the preset If the height threshold Th is set, the feature point is discarded, and the comparison of the next feature point is continued until all feature points are compared.

105、获取稳定特征点在每帧视频图像中的第一坐标系中的坐标,结合坐标转换矩阵,确定稳定特征点在第二坐标系内的连续坐标,根据连续坐标,确定移动轨迹。105. Acquire the coordinates of the stable feature points in the first coordinate system in each frame of video image, determine the continuous coordinates of the stable feature points in the second coordinate system in combination with the coordinate transformation matrix, and determine the movement trajectory according to the continuous coordinates.

进一步的,在确定移动轨迹后,方法还包括:Further, after determining the movement track, the method also includes:

利用卡尔曼滤波对移动轨迹进行平滑处理,根据平滑处理后的轨迹对移动轨迹进行修正,得到修正后的轨迹。The moving trajectory is smoothed by Kalman filter, and the moving trajectory is corrected according to the smoothed trajectory to obtain the corrected trajectory.

在实施中,该步骤105具体描述如下:In implementation, this step 105 is specifically described as follows:

首先,获取稳定特征点在每帧视频图像中第一坐标系中的坐标,结合转换矩阵C,获取该稳定特征点在第二坐标系内的坐标。Firstly, the coordinates of the stable feature point in the first coordinate system in each frame of video image are obtained, combined with the transformation matrix C, the coordinates of the stable feature point in the second coordinate system are obtained.

其次,根据上述方法,确定该稳定特征点在多帧视频图像中的连续坐标,根据连续坐标获取该稳定特征点的移动轨迹,该连续轨迹如图5所示。Secondly, according to the above method, the continuous coordinates of the stable feature point in the multi-frame video images are determined, and the moving track of the stable feature point is obtained according to the continuous coordinates, the continuous track is shown in FIG. 5 .

最后,利用卡尔曼滤波对获取到的移动轨迹进行平滑处理,根据平滑处理后的轨迹对移动轨迹进行修正,得到修正后的轨迹。Finally, the Kalman filter is used to smooth the obtained moving trajectory, and the moving trajectory is corrected according to the smoothed trajectory to obtain the corrected trajectory.

可选的,这里的卡尔曼滤波是对移动轨迹中每个点的坐标值进行评估,根据每个坐标轴方向上多个坐标值的平均水平,将明显偏离该平均水平的坐标值进行替换,从而使得每个坐标轴方向上的坐标值基本趋近统一,这样修正后的坐标值对应的轨迹会更为平滑。当然,这里仅使用卡尔曼滤波进行轨迹修正,还可以采取其他滤波方式的进行类似处理,本处不再赘述。Optionally, the Kalman filter here is to evaluate the coordinate value of each point in the moving track, and replace the coordinate values that obviously deviate from the average level according to the average level of multiple coordinate values in the direction of each coordinate axis, As a result, the coordinate values in the direction of each coordinate axis are basically close to unity, so that the trajectory corresponding to the corrected coordinate values will be smoother. Of course, only the Kalman filter is used for trajectory correction here, and other filtering methods can also be used for similar processing, which will not be repeated here.

106、在第二坐标系内选取基准检测线,在移动轨迹经过基准检测线时,对移动轨迹中的稳定特征点的高度值进行滤波处理,得到处理后的均值,根据均值对移动轨迹进行修正。106. Select a reference detection line in the second coordinate system, and when the moving trajectory passes the reference detection line, filter the height values of the stable feature points in the moving trajectory to obtain the processed average value, and correct the moving trajectory according to the average value .

其中,对移动轨迹中的稳定特征点的高度值进行滤波处理,得到处理后的均值,包括:Among them, the height value of the stable feature point in the moving track is filtered to obtain the processed mean value, including:

提取移动轨迹中全部稳定特征点的高度值;Extract the height values of all stable feature points in the moving trajectory;

获取全部高度值的平均值;Get the average of all height values;

根据平均值对移动轨迹进行修正。The movement trajectory is corrected according to the average value.

在实施中,首先,与步骤104中的计算过程类似,利用转换矩阵矩阵C确定第i条图像轨迹上所有稳定特征点的在第二坐标系内的坐标这些坐标带有误差。In implementation, first, similar to the calculation process in step 104, the coordinates of all stable feature points on the i-th image trajectory in the second coordinate system are determined using the transformation matrix matrix C These coordinates come with errors.

其次,选取一条位于路面且垂直于车道线的检测线作为基准检测线,该基准检测线在实际场景中如图6中的虚线所示,当有移动轨迹经过检测线时,对该轨迹上的所有稳定特征点的高度信息进行中值滤波求得该轨迹的高度为即求得的高度zi为全部高度值的平均值。Secondly, a detection line located on the road surface and perpendicular to the lane line is selected as the reference detection line. The reference detection line is shown as the dotted line in Figure 6 in the actual scene. When a moving trajectory passes the detection line, the Median filtering is performed on the height information of all stable feature points to obtain the height of the trajectory as That is, the obtained height z i is the average value of all height values.

最后,利用上述高度平均值zi对该轨迹上的每一个稳定特征点在第二坐标系中的坐标值进行修正,得出修正后的坐标为(xi1,yi1,zi)…(xin,yin,zi),这样减小了在利用垂足点求特征点第二坐标系内坐标时带来的误差。Finally, the coordinate value of each stable feature point on the trajectory in the second coordinate system is corrected by using the above average height z i , and the corrected coordinates are (x i1 , y i1 , z i )...( x in , y in , z i ), which reduces the error caused when using the foot point to find the coordinates of the feature point in the second coordinate system.

107、获取多组移动轨迹的同时刻的相对距离,当同时刻的相对距离的方差大于预设阈值时,更新车辆计数器的计数值,依次对将获取到的移动轨迹的同时刻相对距离的方差进行判断,直至判断结束,根据车辆计数器的计数值,确定视频图像中的车辆数目。107. Obtain the relative distances of multiple groups of moving trajectories at the same time. When the variance of the relative distances at the same time is greater than the preset threshold, update the count value of the vehicle counter, and sequentially compare the variance of the relative distances at the same time of the acquired moving trajectories. Judging until the end of the judgment, according to the count value of the vehicle counter, determine the number of vehicles in the video image.

其中,在获取多组移动轨迹的相对距离后,还包括:Among them, after obtaining the relative distances of multiple sets of moving trajectories, it also includes:

当同时刻的相对距离的方差小于预设阈值时,将相对距离对应的两个移动轨迹标记为同一组,不更新车辆计数器的计数值;否则,当同时刻的相对距离的方差大于预设阈值时,将相对距离对应的两个移动轨迹标记为不同组,令车辆计数器的计数值加一,继续将获取到的移动轨迹的相对距离进行判断,直至判断结束。When the variance of the relative distance at the same moment is less than the preset threshold, mark the two moving trajectories corresponding to the relative distance as the same group, and do not update the count value of the vehicle counter; otherwise, when the variance of the relative distance at the same moment is greater than the preset threshold , mark the two moving trajectories corresponding to the relative distance as different groups, add one to the count value of the vehicle counter, and continue to judge the relative distance of the acquired moving trajectories until the judgment ends.

在实施中,此处的相对距离指的是两条轨迹线同时刻的相对距离,选取连续的多个时刻,得到多个相对距离,用相对距离的方差作为衡量相对距离变化的依据,相对距离的方差小于预设的阈值时,说明这两条轨迹线在跟踪的过程中同时刻的相对距离基本保持不变,是属于同一辆车的轨迹线,车辆计数器的值不变;否则当相对距离的方差大于预设的阈值时,说明这两条轨迹线在跟踪的过程中同时刻的相对距离变化较大,是不属于同一辆车的轨迹线,车辆计数器的值加一。In practice, the relative distance here refers to the relative distance of the two trajectory lines at the same moment. Select multiple consecutive moments to obtain multiple relative distances. The variance of the relative distance is used as the basis for measuring the change of the relative distance. The relative distance When the variance of is less than the preset threshold, it means that the relative distance between the two trajectories at the same moment during the tracking process remains basically unchanged, and they belong to the same vehicle, and the value of the vehicle counter remains unchanged; otherwise, when the relative distance When the variance of is greater than the preset threshold, it means that the relative distance between the two trajectories changes greatly at the same time during the tracking process, and the trajectories do not belong to the same vehicle, and the value of the vehicle counter is increased by one.

统计示意图如图7所示,其中标记值为0的轨迹线表示一辆车,标记值为1的两条轨迹线同时刻相对距离d的方差为1.2,小于Th2,的阈值Th2取值为2.5,这两条轨迹线表示一辆车,标记值为2的轨迹线表示另一辆车;对检测区域内经过检测线的所有车辆进行计数。The statistical diagram is shown in Figure 7, where the trajectory line with a marker value of 0 represents a vehicle, and the variance of the relative distance d between two trajectory lines with a marker value of 1 at the same time is 1.2, which is less than Th2, and the threshold value Th2 is 2.5 , these two trajectory lines represent a vehicle, and the trajectory line with a marker value of 2 represents another vehicle; count all vehicles passing the detection line in the detection area.

上述根据相对距离对两个轨迹是否确定为统一车辆的轨迹采用的是“聚类”的思想。即获取第一条轨迹,标记1,获取第二条轨迹,与第一条轨迹计算同时刻相对距离的方差,若同时刻相对距离的方差小于阈值,将第二轨迹标记为1,若同时刻相对距离的方差大于阈值,标记为2,计数器加1,即每次获取新的轨迹,均与前边所有轨迹进行同时刻相对距离方差的判断,并根据结果进行计数器加1与否的操作,直至判断结束,计数结束。The idea of "clustering" is used to determine whether the two trajectories are the trajectories of the same vehicle according to the relative distance. That is, get the first track, mark 1, get the second track, and calculate the variance of the relative distance at the same time as the first track, if the variance of the relative distance at the same time is less than the threshold, mark the second track as 1, if at the same time The variance of the relative distance is greater than the threshold, marked as 2, and the counter is incremented by 1, that is, every time a new trajectory is obtained, the relative distance variance is judged at the same time as all the previous trajectories, and the operation of adding 1 to the counter is performed according to the result, until Judgment ends, counting ends.

在本步骤中,之所以一直在强调将“同时刻的相对距离”进行对比,是因为在采集到的视频图像中,每一帧图像对应的即为同一时刻下道路的情况,使用“同时刻”进行描述,是对真实情况的描述;另外,只有在“同时刻”下的轨迹进行相对距离的比较,才能确定一辆车的移动情况,否则,即便是一辆车的轨迹,在不同时刻下也会不尽相同,就丧失了根据轨迹判断车辆数目的意义。In this step, the reason why we have been emphasizing the comparison of "relative distance at the same moment" is because in the collected video images, each frame of image corresponds to the situation of the road at the same moment, using "simultaneous moment "Description is a description of the real situation; in addition, only by comparing the relative distances of the trajectories at the "simultaneous moment" can the movement of a vehicle be determined, otherwise, even the trajectory of a vehicle will The situation will be different, and the meaning of judging the number of vehicles based on the trajectory will be lost.

本实施例中提出的一种基于行驶轨迹的车辆统计方法,通过提取拍摄到的道路视频图像中的车辆轨迹,对其中的车辆轨迹进行处理,得到轨迹在同时刻的相对距离,根据同时刻相对距离的变化关系确定该视频图像内的车辆数目,使得在车辆数目的统计过程中避免了环境的影响以及仅能统计单一车型的限制,提高了车辆数目的统计精度和统计效率。A vehicle statistics method based on driving trajectory proposed in this embodiment extracts the vehicle trajectory in the captured road video images and processes the vehicle trajectory to obtain the relative distance of the trajectory at the same time, according to the relative distance at the same time The variation relationship of the distance determines the number of vehicles in the video image, so that the influence of the environment and the limitation of only a single vehicle type can be counted in the process of counting the number of vehicles, and the statistical accuracy and efficiency of the number of vehicles are improved.

需要说明的是:上述实施例提供的统计方法进行车辆统计的实施例,仅作为该统计方法中在实际应用中的说明,还可以根据实际需要而将上述统计方法在其他应用场景中使用,其具体实现过程类似于上述实施例,这里不再赘述。It should be noted that the statistical method provided by the above-mentioned embodiment is only used as an illustration of the actual application of the statistical method, and the above-mentioned statistical method can also be used in other application scenarios according to actual needs. The specific implementation process is similar to the above embodiment, and will not be repeated here.

以上所述仅为本发明的实施例,并不用以限制本发明,凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above description is only an embodiment of the present invention, and is not intended to limit the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present invention shall be included in the protection scope of the present invention Inside.

Claims (7)

1., based on a statistical method for track of vehicle, described method is used for processing the road video image photographed, and it is characterized in that, described method comprises:
The sample point of the first quantity is chosen in described video image, the first coordinate system is set up in described video image, the second coordinate system is set up in real space, determine the described coordinate of the first number of samples point in described first coordinate system and the coordinate in described second coordinate system, according to the coordinate of described first number of samples point in described first coordinate system and the coordinate determination coordinate conversion matrix in described second coordinate system;
Described video image is processed, obtains the image after binaryzation;
Selected characteristic point in described video image, determines the coordinate of described unique point in described first coordinate system, determines the intersection point point with described Feature point correspondence, determine the coordinate of described intersection point point in described first coordinate system in the image after described binaryzation;
According to the coordinate of described unique point in described first coordinate system, in conjunction with described coordinate conversion matrix, obtain the coordinate of described unique point in described second coordinate system, according to the coordinate of described unique point in described second coordinate system, determine invariant feature point;
Obtain the coordinate in described first coordinate system of described invariant feature point in video image described in every frame, in conjunction with described coordinate conversion matrix, determine the continuous coordinate of described invariant feature point in described second coordinate system, according to described continuous coordinate, determine motion track;
Benchmaring line is chosen in described second coordinate system, at described motion track through described benchmaring line, filtering process is carried out to the height value of the described invariant feature point in described motion track, obtains the average after processing, according to described average, described motion track is revised;
Obtain the relative distance in the same time of the described motion track of many groups, when the variance of described relative distance is in the same time greater than predetermined threshold value, upgrade the count value of vehicle counter, successively the variance of the relative distance in the same time by the described motion track got is judged, until judge to terminate, according to the described count value of described vehicle counter, determine the number of vehicles in described video image.
2. method according to claim 1, is characterized in that, is describedly processed by described video image, obtains the image after binaryzation and comprises:
By the background removal of each two field picture in video, only be there is the initial binary image of vehicle body;
Connected domain analysis and holes filling are carried out to described initial binary target image, obtains the image after the binaryzation after processing.
3. method according to claim 1, is characterized in that, determines, with the intersection point point of described Feature point correspondence, to comprise in the image after described binaryzation:
In image after described binaryzation, initial from described unique point, in conjunction with described first coordinate system, do vertical line to vertical direction, there is an intersection point in the intersection in the image after described vertical line and described binaryzation, makes described intersection point be the described intersection point point with described Feature point correspondence.
4. method according to claim 1, is characterized in that, described according to the coordinate of described unique point in described second coordinate system, determines invariant feature point, comprising:
In described second coordinate system, determine the height value of described unique point;
When described height value is less than default height threshold, described unique point is made to be described invariant feature point.
5. method according to claim 1, is characterized in that, described determine motion track after, described method also comprises:
Utilize Kalman filtering to the smoothing process of described motion track, according to the track after described smoothing processing, described motion track is revised, obtain revised track.
6. method according to claim 1, is characterized in that, the described height value to the described invariant feature point in described motion track carries out filtering process, obtains the average after processing, revises, comprising according to described average to described motion track:
Extract the height value of whole described invariant feature point in described motion track;
Obtain the mean value of whole described height value;
According to described mean value, described motion track is revised.
7. method according to claim 1, is characterized in that, organize the relative distance in the same time of described motion track in described acquisition after, described method also comprises more:
When the variance of described relative distance is in the same time less than predetermined threshold value, corresponding for described relative distance two described motion tracks is labeled as same group, does not upgrade the count value of described vehicle counter; Otherwise, when the variance of described relative distance is in the same time greater than predetermined threshold value, corresponding for described relative distance two described motion tracks are labeled as different groups, the count value of described vehicle counter is made to add one, continue the relative distance of the described motion track got to judge, until judge to terminate.
CN201410805130.2A 2014-12-19 2014-12-19 A kind of car statistics method based on driving trace Expired - Fee Related CN104794425B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410805130.2A CN104794425B (en) 2014-12-19 2014-12-19 A kind of car statistics method based on driving trace

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410805130.2A CN104794425B (en) 2014-12-19 2014-12-19 A kind of car statistics method based on driving trace

Publications (2)

Publication Number Publication Date
CN104794425A true CN104794425A (en) 2015-07-22
CN104794425B CN104794425B (en) 2018-05-18

Family

ID=53559213

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410805130.2A Expired - Fee Related CN104794425B (en) 2014-12-19 2014-12-19 A kind of car statistics method based on driving trace

Country Status (1)

Country Link
CN (1) CN104794425B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105243354A (en) * 2015-09-08 2016-01-13 长安大学 Vehicle detection method based on target feature points
CN105761507A (en) * 2016-03-28 2016-07-13 长安大学 Vehicle counting method based on three-dimensional trajectory clustering
CN106682565A (en) * 2015-11-09 2017-05-17 富士通株式会社 Vehicle counting method, vehicle counting device and electronic device
CN109813327A (en) * 2019-02-01 2019-05-28 安徽中科美络信息技术有限公司 A kind of vehicle driving trace absent compensation method
CN110288833A (en) * 2019-07-15 2019-09-27 北京航空航天大学 A traffic flow detection system based on high precision infrared array sensor
CN110555449A (en) * 2018-05-30 2019-12-10 百度在线网络技术(北京)有限公司 Method and apparatus for outputting information
CN112632208A (en) * 2020-12-25 2021-04-09 际络科技(上海)有限公司 Traffic flow trajectory deformation method and device
CN112861565A (en) * 2019-11-12 2021-05-28 上海高德威智能交通系统有限公司 Method and device for determining track similarity, computer equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127085A (en) * 2006-07-28 2008-02-20 索尼株式会社 Image processing method and image processing device
US20110033088A1 (en) * 2009-08-07 2011-02-10 Junichi Rekimoto Position Detection Apparatus and Position Detection Method
CN103400142A (en) * 2013-05-14 2013-11-20 上海交通大学 Pedestrian counting method
CN103853725A (en) * 2012-11-29 2014-06-11 深圳先进技术研究院 Traffic track data noise reduction method and system
CN104182718A (en) * 2013-05-21 2014-12-03 腾讯科技(深圳)有限公司 Method and device for locating facial feature points

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127085A (en) * 2006-07-28 2008-02-20 索尼株式会社 Image processing method and image processing device
US20110033088A1 (en) * 2009-08-07 2011-02-10 Junichi Rekimoto Position Detection Apparatus and Position Detection Method
CN103853725A (en) * 2012-11-29 2014-06-11 深圳先进技术研究院 Traffic track data noise reduction method and system
CN103400142A (en) * 2013-05-14 2013-11-20 上海交通大学 Pedestrian counting method
CN104182718A (en) * 2013-05-21 2014-12-03 腾讯科技(深圳)有限公司 Method and device for locating facial feature points

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105243354A (en) * 2015-09-08 2016-01-13 长安大学 Vehicle detection method based on target feature points
CN105243354B (en) * 2015-09-08 2018-10-26 长安大学 A kind of vehicle checking method based on target feature point
CN106682565A (en) * 2015-11-09 2017-05-17 富士通株式会社 Vehicle counting method, vehicle counting device and electronic device
CN105761507A (en) * 2016-03-28 2016-07-13 长安大学 Vehicle counting method based on three-dimensional trajectory clustering
CN105761507B (en) * 2016-03-28 2018-03-02 长安大学 A kind of vehicle count method based on three-dimensional track cluster
CN110555449A (en) * 2018-05-30 2019-12-10 百度在线网络技术(北京)有限公司 Method and apparatus for outputting information
CN109813327A (en) * 2019-02-01 2019-05-28 安徽中科美络信息技术有限公司 A kind of vehicle driving trace absent compensation method
CN110288833A (en) * 2019-07-15 2019-09-27 北京航空航天大学 A traffic flow detection system based on high precision infrared array sensor
CN112861565A (en) * 2019-11-12 2021-05-28 上海高德威智能交通系统有限公司 Method and device for determining track similarity, computer equipment and storage medium
CN112632208A (en) * 2020-12-25 2021-04-09 际络科技(上海)有限公司 Traffic flow trajectory deformation method and device

Also Published As

Publication number Publication date
CN104794425B (en) 2018-05-18

Similar Documents

Publication Publication Date Title
CN104794425B (en) A kind of car statistics method based on driving trace
CN111801711B (en) Image annotation
CN105260699B (en) A kind of processing method and processing device of lane line data
CN104599249B (en) Cableway platform bridge floor car load is distributed real-time detection method
CN115049700A (en) Target detection method and device
CN102289948B (en) Multi-characteristic fusion multi-vehicle video tracking method under highway scene
CN107301776A (en) Track road conditions processing and dissemination method based on video detection technology
CN110379168B (en) A traffic vehicle information acquisition method based on Mask R-CNN
JP4363295B2 (en) Plane estimation method using stereo images
CN104050818B (en) The moving vehicle speed-measuring method of based target tracking and Feature Points Matching
CN102592454A (en) Intersection vehicle movement parameter measuring method based on detection of vehicle side face and road intersection line
Luo et al. Multiple lane detection via combining complementary structural constraints
CN104766058A (en) Method and device for obtaining lane line
CN104063882B (en) Vehicle video speed measuring method based on binocular camera
CN114758096B (en) A roadside detection method, device, terminal equipment and storage medium
CN101364347A (en) A video-based detection method for vehicle control delays at intersections
CN111754388B (en) Picture construction method and vehicle-mounted terminal
CN112447060A (en) Method and device for recognizing lane and computing equipment
CN107133623A (en) A kind of pointer position accurate detecting method positioned based on background subtraction and the center of circle
Revilloud et al. A lane marker estimation method for improving lane detection
CN113392170A (en) High-precision map data generation method and device and server
CN112749577A (en) Parking space detection method and device
CN112149471B (en) Loop detection method and device based on semantic point cloud
CN115457780A (en) Vehicle flow and flow speed automatic measuring and calculating method and system based on priori knowledge set
CN105761507B (en) A kind of vehicle count method based on three-dimensional track cluster

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information

Inventor after: Cui Hua

Inventor after: Sun Shijie

Inventor after: Song Huansheng

Inventor after: He Zhili

Inventor after: Zhao Qianqian

Inventor after: Li Huaiyu

Inventor after: Zhu Longsheng

Inventor after: Li Gang

Inventor after: Gong Weibin

Inventor after: Wang Xuan

Inventor before: Song Huansheng

Inventor before: Zhao Qianqian

Inventor before: Cui Hua

Inventor before: Li Huaiyu

Inventor before: Zhu Longsheng

Inventor before: Li Gang

Inventor before: Gong Weibin

Inventor before: Wang Xuan

Inventor before: Sun Shijie

CB03 Change of inventor or designer information
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180518

Termination date: 20211219

CF01 Termination of patent right due to non-payment of annual fee