CN117011839B - Security inspection methods, devices, and robots based on point cloud processing - Google Patents
Security inspection methods, devices, and robots based on point cloud processingInfo
- Publication number
- CN117011839B CN117011839B CN202310811511.0A CN202310811511A CN117011839B CN 117011839 B CN117011839 B CN 117011839B CN 202310811511 A CN202310811511 A CN 202310811511A CN 117011839 B CN117011839 B CN 117011839B
- Authority
- CN
- China
- Prior art keywords
- license plate
- robot
- point cloud
- image data
- central axis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
- G06V20/625—License plates
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/10—Internal combustion engine [ICE] based vehicles
- Y02T10/40—Engine management systems
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Analysis (AREA)
Abstract
本发明适用于点云数据处理的技术领域，提供了一种基于点云处理的安全检查方法、装置及机器人，方法包括：获取真彩图像数据和深度图像数据；检测真彩图像数据中是否存在车牌；在真彩图像数据中存在车牌的情况下，获取车牌的检测框；根据车牌的检测框对应区域的深度图像数据的像素点进行转换处理，得到车牌的点云数据；计算点云数据的法向量；计算机器人距离车牌的中轴线的距离；判断机器人相对于车牌的方位；计算机器人与车牌的中轴线的夹角；移动至车牌的中轴线上；沿着车牌的中轴线移动通过车辆底部，在经过车辆底部时，采集车底图像，以通过所述车底图像进行安全检查。
This invention relates to the technical field of point cloud data processing, and provides a security inspection method, apparatus, and robot based on point cloud processing. The method includes: acquiring true-color image data and depth image data; detecting whether a license plate exists in the true-color image data; if a license plate exists in the true-color image data, acquiring a detection frame of the license plate; performing conversion processing on the pixels of the depth image data corresponding to the detection frame of the license plate to obtain point cloud data of the license plate; calculating the normal vector of the point cloud data; calculating the distance between the robot and the central axis of the license plate; determining the orientation of the robot relative to the license plate; calculating the angle between the robot and the central axis of the license plate; moving to the central axis of the license plate; moving along the central axis of the license plate through the bottom of the vehicle, and acquiring an image of the bottom of the vehicle while passing through the bottom of the vehicle, so as to perform a security inspection through the image of the bottom of the vehicle.
Description
Technical Field
The invention belongs to the technical field of point cloud data processing, and particularly relates to a safety inspection method and device based on point cloud processing and a robot.
Background
With the development of economy, the quantity of automobiles is increased, and the factors such as automobile height and structure cause the bottom of the automobile to be difficult to check, so that lawbreakers can hide dangerous bans at the bottom of the automobile, and the bottom safety inspection of the vehicles entering and exiting is required at important checkpoints such as ports and customs in order to ensure safety and avoid the entrance of dangerous bans.
Currently, important checkpoints such as ports and customs mainly rely on manual work to carry out human eye inspection in sequence, so that the inspection efficiency is low and the personal safety of security inspectors is difficult to guarantee.
Disclosure of Invention
In view of the above, the embodiments of the present invention provide a security inspection method, apparatus, robot and computer readable storage medium based on point cloud processing, so as to solve the technical problems that the conventional technology mainly relies on manual work to perform human eye inspection in sequence when performing vehicle bottom inspection, the inspection efficiency is low, and the personal safety of security inspectors is difficult to be ensured.
A first aspect of an embodiment of the present invention provides a security inspection method based on point cloud processing, applied to a robot, including:
The first acquisition step of acquiring true color image data and depth image data;
Detecting whether a license plate exists in the true color image data;
the second acquisition step is to acquire a detection frame of the license plate under the condition that the license plate exists in the true color image data;
the conversion step is that the pixel points of the depth image data of the corresponding area of the detection frame of the license plate are converted to obtain point cloud data of the license plate;
calculating normal vector of the point cloud data;
a second calculation step of calculating the distance between the robot and the central axis of the license plate;
Judging, namely judging the azimuth of the robot relative to the license plate;
a third calculation step of calculating an included angle between the robot and the central axis of the license plate;
The moving step is to move to the central axis of the license plate according to the distance between the robot and the central axis of the license plate, the azimuth of the robot relative to the license plate and the included angle between the robot and the central axis of the license plate;
And the acquisition step is to move along the central axis of the license plate to pass through the bottom of the vehicle, and acquire an image of the bottom of the vehicle when passing through the bottom of the vehicle so as to perform safety inspection through the image of the bottom of the vehicle.
A second aspect of an embodiment of the present invention provides a security inspection device based on point cloud processing, applied to a robot, including:
the first acquisition module is used for acquiring true color image data and depth image data;
The detection module is used for detecting whether a license plate exists in the true color image data;
The second acquisition module is used for acquiring a detection frame of the license plate under the condition that the license plate exists in the true color image data;
the conversion module is used for carrying out conversion processing according to the pixel points of the depth image data of the corresponding area of the detection frame of the license plate to obtain point cloud data of the license plate;
the first calculation module is used for calculating the normal vector of the point cloud data;
The second calculation module is used for calculating the distance between the robot and the central axis of the license plate;
The judging module is used for judging the azimuth of the robot relative to the license plate;
the third calculation module is used for calculating an included angle between the robot and the central axis of the license plate;
The mobile module is used for moving to the central axis of the license plate according to the distance between the robot and the central axis of the license plate, the orientation of the robot relative to the license plate and the included angle between the robot and the central axis of the license plate;
And the acquisition module is used for moving through the bottom of the vehicle along the central axis of the license plate, and acquiring an image of the bottom of the vehicle when passing through the bottom of the vehicle so as to perform safety inspection through the image of the bottom of the vehicle.
A third aspect of an embodiment of the present invention provides a robot, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the security inspection method based on point cloud processing according to the first aspect when the processor executes the computer program.
A fourth aspect of the embodiments of the present invention provides a computer-readable storage medium storing a computer program, which when executed by a processor, implements the steps of the security inspection method based on point cloud processing described in the first aspect.
Compared with the prior art, the method has the beneficial effects that the robot is precisely controlled according to the point cloud data of the license plate by identifying the license plate, the robot is controlled to move through the bottom of the vehicle along the central axis of the license plate, and the bottom image is acquired when the robot passes through the bottom of the vehicle, so that more basis is provided for the bottom safety inspection, the bottom safety inspection of ports and customs is assisted, the inspection efficiency is improved, and the personal safety of security inspectors is ensured.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are required to be used in the embodiments or the related technical descriptions will be briefly described, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to the drawings without inventive effort for those skilled in the art.
Fig. 1 shows a schematic flow chart of a security inspection method based on point cloud processing provided by the invention;
Fig. 2 shows a schematic structural diagram of a security inspection device based on point cloud processing according to the present invention;
Fig. 3 shows a schematic structural diagram of a robot according to the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth such as the particular system architecture, techniques, etc., in order to provide a thorough understanding of the embodiments of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
Firstly, the invention provides a security inspection method based on point cloud processing, which is applied to a robot.
In one possible embodiment, the robot is provided with a camera, a line camera and a light filling lamp. The linear array camera and the light supplementing lamp are arranged at the top of the robot and used for collecting the vehicle bottom image after the robot enters the vehicle bottom, providing more basis for vehicle bottom safety inspection and assisting in carrying out vehicle bottom safety inspection at ports and customs.
Referring to fig. 1, fig. 1 shows a flow chart of a security inspection method based on point cloud processing according to the present invention. As shown in fig. 1, the security inspection method based on the point cloud processing may include the following steps:
And the first acquisition step is to acquire true color image data and depth image data.
The true color image data is also called RGB image data, and can be obtained through shooting by a common camera. The depth image data may be acquired by a depth camera that uses special techniques (such as structured light, time of flight, or binocular vision) to measure the distance of objects in the scene to the sensor and generate a corresponding depth image.
The true color image data and the depth image data can be acquired simultaneously by the same camera or respectively by different cameras.
In one possible embodiment, after the first obtaining step, the method further includes:
And an alignment step of aligning the true color image data and the depth image data.
If the true color image data and the depth image data are acquired simultaneously by the same camera, the true color image data and the depth image data can be aligned in an internal reference alignment mode. Specifically, the true color image and the depth image are aligned in a camera coordinate system using internal parameters including a focal length of the camera, an optical center (image center), distortion parameters, and the like.
If the true color image data and the depth image data are acquired by different cameras, respectively, the true color image and the depth image may be aligned in a world coordinate system. Firstly, converting pixel points in the depth image into three-dimensional points in a world coordinate system, and utilizing the depth values and the external parameter information. The pixel coordinates in the real color image and the camera's extrinsic information are then used to convert the points in the real color image to three-dimensional points in the world coordinate system. Finally, according to the coordinate correspondence, the true color image and the depth image can be aligned.
By aligning the true color image data and the depth image data, it is further ensured that license plate regions determined in the true color image data can be accurately mapped into the depth image data.
And detecting whether a license plate exists in the true color image data.
Alternatively, license plate detection algorithms may be implemented using an open source computer vision library (e.g., openCV) or a deep learning framework (e.g., tensorFlow, pyTorch).
Specifically, first, features in the image are extracted using image processing and computer vision techniques to aid license plate detection. Some commonly used features include color information, shape features, and edge information. Image segmentation techniques or object detection methods are used to extract image regions that may contain license plates, which typically have color, shape, or edge features of the license plates, based on the feature information. In the extracted area, candidate license plate frames are generated, and possible license plate boundaries can be found by using an edge detection algorithm or a connected area analysis and other technologies. And verifying the generated candidate license plate frames by a feature analysis, pattern matching, machine learning or deep learning method to determine whether the license plate is really contained.
Further, if no license plate exists in the true color image data, ending the flow.
And a second acquisition step of acquiring a detection frame of the license plate under the condition that the license plate exists in the true color image data.
Specifically, the detection frame of the license plate can be obtained through a target detection algorithm (such as Faster R-CNN, YOLO, SSD and the like) based on deep learning.
And a conversion step of carrying out conversion processing according to pixel points of the depth image data of the region corresponding to the detection frame of the license plate to obtain point cloud data of the license plate.
Optionally, the pixel points of the depth image data of the license plate region are converted into point cloud data. The depth value of each pixel point may be represented as a Z coordinate in the point cloud, while the abscissa and ordinate of the pixel point may be converted into X and Y coordinates in the point cloud by the pixel coordinates of the depth image.
In one possible embodiment, the converting step includes:
traversing pixel points of depth image data of a region corresponding to a detection frame of the license plate, and carrying out conversion processing on the pixel points of the depth image data according to a formula 1 to obtain point cloud data of the license plate:
wherein cx, cy, fx, fy denotes an internal parameter of the true color image data, depth denotes the depth image data, and i and j denote column coordinates and row coordinates of the pixel point, respectively.
And a counting sub-step, counting the number of points in the point cloud data, and ending the flow when the number of points is smaller than the preset number.
It should be noted that, by counting the number of points in the point cloud data and ending the flow when the number of points is smaller than the preset number, the deficiency of the point cloud data can be identified in advance, unnecessary calculation and analysis processes are avoided, the quality and accuracy of the point cloud data are ensured, and the overall processing efficiency is improved.
And a first calculation step of calculating a normal vector of the point cloud data.
The normal vector of the point cloud data is a basis for calculating the distance between the robot and the central axis of the license plate, the azimuth of the robot relative to the license plate and the included angle between the robot and the central axis of the license plate.
In one possible implementation, the first calculating step includes:
a first calculation sub-step of calculating a normal vector (α, β, γ) T of the point cloud data by equation 2:
Wherein pointCloud denotes a point cloud data set, C denotes a covariance matrix, P center denotes a license plate center point, n denotes the number of point cloud data, P i denotes three-site information of the ith point cloud data, and λ is a minimum feature value.
In the present invention, the center point of the license plate is taken as the midpoint in the width direction of the automobile body.
It should be noted that, the coordinates of the central point of the license plate can be calculated by calculating the coordinates of the upper left corner and the coordinates of the lower right corner of the detection frame of the license plate.
Further, the calculated normal vector may be smoothed to improve its accuracy and continuity. Common smoothing methods include weighted average or least squares fitting, etc.
And a second calculation step of calculating the distance between the robot and the central axis of the license plate.
In one possible implementation, the second calculating step includes:
the second calculation sub-step is that the distance d between the robot and the central axis of the license plate is calculated through a formula 3:
wherein, the The z-axis coordinate value representing the license plate center point P center,And the x-axis coordinate value of the license plate center point P center is represented.
And judging the azimuth of the robot relative to the license plate.
In one possible implementation manner, the determining step includes:
The third calculation sub-step is to calculate the intersection point x0 of the central axis of the license plate and the x axis of the world coordinate axis through the formula 4:
wherein, the The z-axis coordinate value representing the license plate center point P center,And the x-axis coordinate value of the license plate center point P center is represented.
And judging, namely judging that the robot is positioned on the right side of the license plate under the condition that the intersection point x0 is more than 0. And under the condition that the intersection point x0 is less than 0, judging that the robot is positioned at the left side of the license plate.
And a third calculation step of calculating an included angle between the robot and the central axis of the license plate.
In one possible implementation manner, the third calculation step includes:
a fourth calculation sub-step of calculating an included angle ang of the robot and the central axis of the license plate through a formula 5:
ang=arctan (αγ) equation 5.
And a moving step of moving the robot to the central axis of the license plate according to the distance d between the robot and the central axis of the license plate, the orientation of the robot relative to the license plate and the included angle ang between the robot and the central axis of the license plate.
In the practical application process, if the robot is on the right side of the central axis of the license plate, the robot rotates pi/2-ang degrees to the right, then moves forward by a distance d in a straight line, and finally rotates pi/2 degrees to the left, and if x0 is smaller than zero, the robot rotates pi/2-ang degrees to the left, moves forward by a distance d in a straight line, and finally rotates pi/2 degrees to the right.
In the practical application process, due to the influence of environmental factors such as illumination intensity, whether the road surface skids or not, and the like, the vehicle license plate can be moved to the central axis of the vehicle license plate at one time to be in an ideal state, and fine adjustment processing is performed in the practical processing flow, so that the practicability of an algorithm is improved.
And the acquisition step is to pass through the bottom of the vehicle along the central axis of the license plate, and acquire an image of the bottom of the vehicle when passing through the bottom of the vehicle so as to perform safety inspection through the image of the bottom of the vehicle.
Alternatively, the vehicle bottom image is acquired by a line camera mounted on top of the robot. Further, a light supplementing lamp can be arranged at the top of the robot and used in dark environment. And recording the image data of the vehicle bottom when the vehicle passes through the vehicle bottom, stopping moving when the vehicle bottom is driven out, generating a vehicle bottom image, displaying the vehicle bottom image at a terminal, and judging that the security inspector is a hidden prohibited article through the vehicle bottom image.
Compared with the prior art, the method has the beneficial effects that the robot is precisely controlled according to the point cloud data of the license plate by identifying the license plate, the robot is controlled to move through the bottom of the vehicle along the central axis of the license plate, and the bottom image is acquired when the robot passes through the bottom of the vehicle, so that more basis is provided for the bottom safety inspection, the bottom safety inspection of ports and customs is assisted, the inspection efficiency is improved, and the personal safety of security inspectors is ensured.
The invention provides a security inspection device 10 based on point cloud processing, which is applied to a robot, as shown in fig. 2.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a security inspection device based on point cloud processing according to the present invention, and as shown in fig. 2, a security inspection device 20 based on point cloud processing includes:
A first acquisition module 201, configured to acquire true color image data and depth image data;
The detection module 202 is configured to detect whether a license plate exists in the true color image data;
the second obtaining module 203 is configured to obtain a detection frame of the license plate when the license plate exists in the true color image data;
The conversion module 204 is configured to perform conversion processing according to pixel points of depth image data of a region corresponding to a detection frame of the license plate, so as to obtain point cloud data of the license plate;
a first calculation module 205, configured to calculate a normal vector of the point cloud data;
the second calculating module 206 is configured to calculate a distance between the robot and a central axis of the license plate;
A judging module 207, configured to judge an azimuth of the robot relative to the license plate;
a third calculation module 208, configured to calculate an included angle between the robot and a central axis of the license plate;
the moving module 209 is configured to move to a central axis of the license plate according to a distance between the robot and the central axis of the license plate, a position of the robot relative to the license plate, and an included angle between the robot and the central axis of the license plate;
The acquisition module 210 is configured to move through the bottom of the vehicle along the central axis of the license plate, and acquire an image of the bottom of the vehicle when passing through the bottom of the vehicle, so as to perform a security check through the image of the bottom of the vehicle.
In one possible implementation, the security inspection device 20 based on the point cloud processing further includes:
and the alignment module is used for aligning the true color image data and the depth image data.
In one possible implementation, the conversion module 204 includes:
the conversion sub-module is used for traversing the pixel points of the depth image data of the corresponding area of the detection frame of the license plate, and converting the pixel points of the depth image data according to a formula 1 to obtain the point cloud data of the license plate:
Wherein cx, cy, fx, fy represents an internal parameter of the true color image data, depth represents the depth image data, and i and j represent column coordinates and row coordinates of the pixel point respectively;
and the counting sub-module is used for counting the number of points in the point cloud data, and ending the flow when the number of points is smaller than the preset number.
In one possible implementation, the first computing module 205 includes:
A first calculation sub-module for calculating a normal vector (α, β, γ) T of the point cloud data by equation 2:
Wherein pointCloud denotes a point cloud data set, C denotes a covariance matrix, P center denotes a license plate center point, n denotes the number of point cloud data, P i denotes three-site information of the ith point cloud data, and λ is a minimum feature value.
In one possible implementation, the second computing module 206 includes:
the second calculation submodule is used for calculating the distance d between the robot and the central axis of the license plate through a formula 3:
wherein, the The z-axis coordinate value representing the license plate center point P center,And the x-axis coordinate value of the license plate center point P center is represented.
In one possible implementation manner, the determining module 207 includes:
the third calculation sub-module is used for calculating an intersection point x0 of the central axis of the license plate and the x axis of the world coordinate axis through a formula 4:
wherein, the The z-axis coordinate value representing the license plate center point P center,An x-axis coordinate value representing a license plate center point P center;
and the judging sub-module is used for judging that the robot is positioned on the right side of the license plate under the condition that the intersection point x0 is more than 0, and judging that the robot is positioned on the left side of the license plate under the condition that the intersection point x0 is less than 0.
In one possible implementation, the third computing module 208 includes:
the fourth calculation sub-module is used for calculating an included angle ang of the robot and the central axis of the license plate through a formula 5:
ang=arctan (αγ) equation 5.
The security inspection device 20 based on the point cloud processing provided by the invention can implement each process implemented in the above method embodiment, and in order to avoid repetition, the description is omitted here.
The virtual device provided by the invention can be a terminal, and can also be a component, an integrated circuit or a chip in the terminal.
Compared with the prior art, the method has the beneficial effects that the robot is precisely controlled according to the point cloud data of the license plate by identifying the license plate, the robot is controlled to move through the bottom of the vehicle along the central axis of the license plate, and the bottom image is acquired when the robot passes through the bottom of the vehicle, so that more basis is provided for the bottom safety inspection, the bottom safety inspection of ports and customs is assisted, the inspection efficiency is improved, and the personal safety of security inspectors is ensured.
Fig. 3 is a schematic view of a robot according to an embodiment of the present invention. As shown in fig. 3, a robot 30 of this embodiment includes a processor 300, a memory 301, and a computer program 302 stored in the memory 301 and executable on the processor 300, such as a security check method program based on point cloud processing. The processor 300, when executing the computer program 302, implements the steps of the various embodiments of the security inspection method based on point cloud processing described above. Or the processor 300, when executing the computer program 302, performs the functions of the units in the above-described device embodiments.
Illustratively, the computer program 302 may be partitioned into one or more units that are stored in the memory 301 and executed by the processor 300 to accomplish the present invention. The one or more units may be a series of computer program instruction segments capable of performing a specific function for describing the execution of the computer program 302 in the one robot 30. For example, the specific functions of the computer program 302 that may be partitioned into modules are as follows:
the first acquisition module is used for acquiring true color image data and depth image data;
The detection module is used for detecting whether a license plate exists in the true color image data;
The second acquisition module is used for acquiring a detection frame of the license plate under the condition that the license plate exists in the true color image data;
the conversion module is used for carrying out conversion processing according to the pixel points of the depth image data of the corresponding area of the detection frame of the license plate to obtain point cloud data of the license plate;
the first calculation module is used for calculating the normal vector of the point cloud data;
The second calculation module is used for calculating the distance between the robot and the central axis of the license plate;
The judging module is used for judging the azimuth of the robot relative to the license plate;
the third calculation module is used for calculating an included angle between the robot and the central axis of the license plate;
The mobile module is used for moving to the central axis of the license plate according to the distance between the robot and the central axis of the license plate, the orientation of the robot relative to the license plate and the included angle between the robot and the central axis of the license plate;
And the acquisition module is used for moving through the bottom of the vehicle along the central axis of the license plate, and acquiring an image of the bottom of the vehicle when passing through the bottom of the vehicle so as to perform safety inspection through the image of the bottom of the vehicle.
Including but not limited to a processor 300 and a memory 301. It will be appreciated by those skilled in the art that fig. 3 is merely an example of one type of robot 30 and is not meant to be limiting of one type of robot 30, and may include more or fewer components than shown, or may combine certain components, or different components, e.g., the one type of robot may also include input and output devices, network access devices, buses, etc.
The Processor 300 may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (DIGITAL SIGNAL Processor, DSP), application SPECIFIC INTEGRATED Circuit (ASIC), off-the-shelf Programmable gate array (Field-Programmable GATE ARRAY, FPGA) or other Programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 301 may be an internal storage unit of the one type of robot 30, for example, a hard disk or a memory of the one type of robot 30. The memory 301 may also be an external storage device of the one type of robot 30, such as a plug-in hard disk, a smart memory card (SMART MEDIA CARD, SMC), a Secure Digital (SD) card, a flash memory card (FLASH CARD) or the like, which are provided on the one type of robot 30. Further, the memory 301 may also include both an internal memory unit and an external memory device of the one type of robot 30. The memory 301 is used to store the computer program and other programs and data required for the one roaming control device. The memory 301 may also be used to temporarily store data that has been output or is to be output.
It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic, and should not limit the implementation process of the embodiment of the present invention.
It should be noted that, because the content of information interaction and execution process between the above devices/units is based on the same concept as the method embodiment of the present invention, specific functions and technical effects thereof may be referred to in the method embodiment section, and will not be described herein.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules, so as to perform all or part of the functions described above. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, the specific names of the functional units and modules are only for distinguishing from each other, and are not used for limiting the protection scope of the present invention. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.
Embodiments of the present invention also provide a computer readable storage medium storing a computer program which, when executed by a processor, implements steps for implementing the various method embodiments described above.
Embodiments of the present invention provide a computer program product which, when run on a mobile terminal, causes the mobile terminal to perform steps that enable the implementation of the method embodiments described above.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present invention may implement all or part of the flow of the method of the above embodiments, and may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium can include at least any entity or device capable of carrying computer program code to a camera device/robot, a recording medium, computer Memory, read-Only Memory (ROM), random access Memory (RandomAccess Memory, RAM), electrical carrier signals, telecommunications signals, and software distribution media. Such as a U-disk, removable hard disk, magnetic or optical disk, etc. In some jurisdictions, computer readable media may not be electrical carrier signals and telecommunications signals in accordance with legislation and patent practice.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/network device and method may be implemented in other manners. For example, the apparatus/network device embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions in actual implementation, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units.
It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should also be understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
As used in the present description and the appended claims, the term "if" may be interpreted as "when..once" or "in response to a determination" or "in response to a detection" depending on the context. Similarly, the phrase "if a determination" or "if a [ described condition or event ] is monitored" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon monitoring a [ described condition or event ]" or "in response to monitoring a [ described condition or event ]".
Furthermore, the terms "first," "second," "third," and the like in the description of the present specification and in the appended claims, are used for distinguishing between descriptions and not necessarily for indicating or implying a relative importance.
Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the invention. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.
The foregoing embodiments are merely illustrative of the technical solutions of the present invention, and not restrictive, and although the present invention has been described in detail with reference to the foregoing embodiments, it should be understood by those skilled in the art that modifications may still be made to the technical solutions described in the foregoing embodiments or equivalent substitutions of some technical features thereof, and that such modifications or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (9)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310811511.0A CN117011839B (en) | 2023-07-04 | 2023-07-04 | Security inspection methods, devices, and robots based on point cloud processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310811511.0A CN117011839B (en) | 2023-07-04 | 2023-07-04 | Security inspection methods, devices, and robots based on point cloud processing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117011839A CN117011839A (en) | 2023-11-07 |
| CN117011839B true CN117011839B (en) | 2025-11-04 |
Family
ID=88571925
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310811511.0A Active CN117011839B (en) | 2023-07-04 | 2023-07-04 | Security inspection methods, devices, and robots based on point cloud processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117011839B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117773956A (en) * | 2023-11-21 | 2024-03-29 | 盛视科技股份有限公司 | Vehicle bottom inspection system and vehicle bottom inspection method |
| CN118226458B (en) * | 2024-05-22 | 2024-08-27 | 盛视科技股份有限公司 | Vehicle bottom centering checking method and vehicle bottom checking system based on laser radar |
| CN118225770B (en) * | 2024-05-22 | 2024-08-27 | 盛视科技股份有限公司 | Vehicle bottom centering checking method and vehicle bottom checking system based on intelligent vision |
| CN119501945A (en) * | 2024-12-09 | 2025-02-25 | 南京索安电子有限公司 | Automatic centering method for underbody inspection robot |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107864310A (en) * | 2017-12-11 | 2018-03-30 | 同方威视技术股份有限公司 | Vehicle chassis scanning system and scan method |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102610104B (en) * | 2012-03-16 | 2014-11-05 | 江苏苏科畅联科技有限公司 | Onboard front vehicle detection method |
| KR101705061B1 (en) * | 2016-12-16 | 2017-02-10 | 주식회사 투윈스컴 | Extracting License Plate for Optical Character Recognition of Vehicle License Plate |
| EP3652721A1 (en) * | 2017-09-04 | 2020-05-20 | NNG Software Developing and Commercial LLC | A method and apparatus for collecting and using sensor data from a vehicle |
| CN109208975A (en) * | 2018-10-23 | 2019-01-15 | 罗永平 | A kind of parking position and its application method with rain shade |
| CN111126397A (en) * | 2019-12-27 | 2020-05-08 | 上海眼控科技股份有限公司 | Dynamic inspection method, system, terminal and medium for vehicle chassis |
| CN115205365A (en) * | 2022-07-14 | 2022-10-18 | 小米汽车科技有限公司 | Vehicle distance detection method and device, vehicle, readable storage medium and chip |
| CN115452400B (en) * | 2022-08-03 | 2025-09-05 | 深圳市优必选科技股份有限公司 | Robot detection method, device and robot |
-
2023
- 2023-07-04 CN CN202310811511.0A patent/CN117011839B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107864310A (en) * | 2017-12-11 | 2018-03-30 | 同方威视技术股份有限公司 | Vehicle chassis scanning system and scan method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117011839A (en) | 2023-11-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN117011839B (en) | Security inspection methods, devices, and robots based on point cloud processing | |
| CN103559791B (en) | A kind of vehicle checking method merging radar and ccd video camera signal | |
| CN107577988B (en) | Method, device, storage medium and program product for realizing side vehicle positioning | |
| CN104700414B (en) | A kind of road ahead pedestrian's fast ranging method based on vehicle-mounted binocular camera | |
| CN105206109B (en) | A kind of vehicle greasy weather identification early warning system and method based on infrared CCD | |
| WO2021120574A1 (en) | Obstacle positioning method and apparatus for autonomous driving system | |
| CN107796373B (en) | Distance measurement method based on monocular vision of front vehicle driven by lane plane geometric model | |
| CN104318548A (en) | Rapid image registration implementation method based on space sparsity and SIFT feature extraction | |
| Kortli et al. | A novel illumination-invariant lane detection system | |
| US20160343143A1 (en) | Edge detection apparatus, edge detection method, and computer readable medium | |
| CN112183485B (en) | Deep learning-based traffic cone detection positioning method, system and storage medium | |
| CN113658272B (en) | Vehicle camera calibration methods, devices, equipment and storage media | |
| CN107688174A (en) | A kind of image distance-finding method, system, storage medium and vehicle-mounted visually-perceptible equipment | |
| CN113129363A (en) | Image distance information extraction method based on characteristic object and perspective transformation | |
| CN120220428B (en) | Berth detection system and method | |
| CN112733678A (en) | Ranging method, ranging device, computer equipment and storage medium | |
| CN110197104B (en) | Distance measurement method and device based on vehicle | |
| CN108460348B (en) | Road target detection method based on three-dimensional model | |
| CN111539279A (en) | Road height limit height detection method, device, equipment and storage medium | |
| CN113345035B (en) | A method, system and computer-readable storage medium for instant slope prediction based on binocular camera | |
| CN119313911B (en) | Occlusion analysis method, device, equipment and storage medium for integrating point cloud and image | |
| CN109443319A (en) | Barrier range-measurement system and its distance measuring method based on monocular vision | |
| Barua et al. | An efficient method of lane detection and tracking for highway safety | |
| JP5587852B2 (en) | Image processing apparatus and image processing method | |
| Yan et al. | Lane line detection based on machine vision |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |