Automatic stacking control system based on visual positioning
Technical Field
The application relates to the technical field of palletizing control systems, in particular to an automatic palletizing control system based on visual positioning.
Background
The current automatic stacking system mostly adopts a preset program to control the operation of a mechanical arm, relies on a basic sensor (such as a single RGB camera or a photoelectric switch) to perform rough positioning, and completes stacking tasks through fixed path planning. Part of schemes introduce a simple visual recognition technology, and cargo positioning is realized through edge detection or template matching, but the data dimension is single (for example, only depends on two-dimensional images), and the motion path of the mechanical arm depends on manual teaching or off-line programming and lacks dynamic adjustment capability.
For example, in the chinese patent application of application number CN202010407384.4, an automatic palletizing system is disclosed, comprising a robot adapted to grasp a logistics package, a package conveyor adapted to convey the logistics package to a predetermined unloading position, a two-dimensional camera for identifying the logistics package located at the predetermined unloading position to guide the robot to grasp the logistics package, a tray conveyor adapted to convey a tray for loading the logistics package to a predetermined loading position, and a three-dimensional camera for identifying the tray located at the predetermined loading position to guide the robot to place the grasped logistics package onto the tray. According to the automatic stacking system, stacking operation of the logistics packaging boxes can be automatically achieved, labor cost is saved, and stacking efficiency of the logistics packaging boxes is greatly improved.
In the face of complex and various field working conditions, the palletizing system in the prior art obviously cannot meet the use requirements of users, and therefore, the application provides an automatic palletizing control system based on visual positioning.
Disclosure of Invention
Therefore, the application provides an automatic stacking control system based on visual positioning to solve the problems existing in the prior art.
In order to achieve the above object, the present application provides the following technical solutions:
In a first aspect, an automatic stacking control system based on visual positioning includes a multi-mode visual positioning module, a model building module, a dynamic path planning module, a mechanical arm executing module, an error correction module and a storage module;
The multi-mode visual positioning module comprises an RGB camera, a sensor and a laser radar and is used for acquiring three-dimensional space information of goods and a stacking area in real time;
The model building module is used for building the stacking area, the goods position and the position of the mechanical arm in a three-dimensional space;
The dynamic path planning module is deployed in a path optimization engine of the industrial controller, and generates a grabbing path and a stacking path which are collision-free and optimal in energy consumption according to the cargo position, the target stacking position and the mechanical arm position;
The mechanical arm execution module comprises a triaxial cooperation mechanical arm, a self-adaptive clamp and a force feedback unit, wherein the triaxial cooperation mechanical arm is used for enabling the mechanical arm to move in the front-back, left-right and up-down directions, the self-adaptive clamp supports the rapid switching of a vacuum chuck and an electric clamping jaw and adapts to the grabbing of cargoes with different materials;
The error correction module is used for comparing the real-time data of the multi-mode visual positioning module with the stacking position on the stacking area and dynamically compensating the joint error of the mechanical arm, the size deviation of goods and the interference of environmental vibration;
the storage module is used for storing the grabbing paths and the stacking paths generated by the dynamic path planning module.
Preferably, the storing module stores the grabbing paths and the stacking paths in a partitioning manner, stores the effective grabbing paths and the ineffective grabbing paths in the grabbing paths in a partitioning manner, stores the effective stacking paths and the ineffective stacking paths in the stacking paths in a partitioning manner, and stores the effective grabbing paths, the cargo position information corresponding to the effective stacking paths, the stacking area position information and the mechanical arm position information synchronously.
Preferably, when planning the grabbing path and stacking path of the goods, the dynamic path planning module compares the goods position information, the stacking area position information and the mechanical arm position information acquired by the multi-mode visual positioning module with the storage information in the storage module, and when the effective grabbing path, the goods position information corresponding to the effective stacking path, the stacking area position information and the mechanical arm position information stored in the storage module are the same as the acquired goods position information, the stacking area position information and the mechanical arm position, the effective grabbing path and/or the effective stacking path are directly acquired.
Preferably, when the invalid grabbing path is stored, the invalid grabbing path which can grab the goods smoothly after calibration is marked as an invalid grabbing path I, the other invalid grabbing paths are invalid grabbing paths II, and the calibration parameters of the invalid grabbing path I, the goods position and the information of the mechanical arm position are stored;
When the invalid stacking path is stored, the invalid stacking path which can smoothly stack the cargoes after the calibration is marked as an invalid stacking path I, the other invalid stacking paths are invalid stacking paths II, and the calibration parameters of the invalid stacking path I, the position of the mechanical arm and the information of the stacking area are stored.
Preferably, when the error correction module corrects the mechanical arm, the position information of the mechanical arm, the cargo position and the stacking area is compared with the position of the mechanical arm, the cargo position and the stacking area in the first invalid grabbing path and the first invalid stacking path in the storage module, and when the compared information is the same, the corresponding correction parameters are directly adjusted.
Preferably, the system further comprises a man-machine interaction module, wherein the man-machine interaction module can display the position of the palletizing area, the information of whether the palletizing area can receive goods, the position information of the mechanical arm, the information of whether the mechanical arm is in a working state and the positions of the goods.
Preferably, the system further comprises a scram module, wherein the scram module is connected with the mechanical arm execution module, and the scram module can stop the mechanical arm execution module.
Compared with the prior art, the application has at least the following beneficial effects:
When the system is used, the position of the stacking area and the information of whether the stacking area can be used for stacking new cargoes or not can be acquired, then the movement of any position in space can be realized through the three-axis cooperation mechanical arm, the application range of the system is enlarged, and cargoes can be accurately conveyed to the position of the stacking area through the dynamic path planning module and the error correction module.
Drawings
In order to more intuitively illustrate the prior art and the application, exemplary drawings are presented below. It should be understood that the specific shapes and configurations shown in the drawings are not generally considered to be limiting conditions in implementing the present application, and that, for example, those skilled in the art will be able to make conventional adjustments or further optimization of the addition/subtraction/attribution division, specific shapes, positional relationships, connection manners, dimensional proportion relationships, etc. of certain units (components) based on the technical concepts and exemplary drawings disclosed in the present application.
FIG. 1 is a block diagram of an automatic palletizing control system based on visual positioning provided by the application;
Fig. 2 is a schematic structural diagram of an automatic stacking control system based on visual positioning.
Detailed Description
The application will be further described in detail by means of specific embodiments with reference to the accompanying drawings.
1-2, An automatic stacking control system based on visual positioning comprises a multi-mode visual positioning module, a model building module, a dynamic path planning module, a mechanical arm executing module, an error correction module and a storage module;
the multi-mode visual positioning module comprises an RGB camera, a sensor and a laser radar and is used for acquiring three-dimensional space information of goods, a mechanical arm and a stacking area in real time, and is arranged on one side of the stacking area, and the positions of the goods, the mechanical arm and the stacking area are different each time, so that the three-dimensional space information of the goods, the mechanical arm and the stacking area needs to be acquired before the goods are stacked, further the follow-up planning of a grabbing path and a stacking path can be facilitated, and the positions of the goods, the mechanical arm and the stacking area can be accurately acquired through the cooperation of the RGB camera, the sensor and the laser radar;
The model building module is used for building the positions of the stacking area, the goods position and the mechanical arm in the same three-dimensional space, namely, the space is equivalent to simulating a real space environment, and building the relative positions of the stacking area, the goods position and the mechanical arm in the three-dimensional space, and when planning the grabbing path and the stacking path, a three-dimensional coordinate system can be built based on the three-dimensional space, so that the grabbing path and the stacking path are more scalar when planned, and the grabbing path and the stacking path are ensured to be more accurate;
The dynamic path planning module is deployed in a path optimization engine of the industrial controller, and generates a grabbing path and a stacking path which are free of collision and optimal in energy consumption according to the position of goods, a target stacking position and the position of the mechanical arm, so that invalid movement of the mechanical arm can be reduced when the mechanical arm moves, and stacking operation can be completed quickly;
The mechanical arm executing module comprises a three-axis cooperative mechanical arm, a self-adaptive clamp and a force feedback unit, wherein the three-axis cooperative mechanical arm is used for enabling the mechanical arm to move in the front-back, left-right and up-down directions and is matched with the dynamic path planning module to generate a grabbing path and a stacking path which are free of collision and optimal in energy consumption, so that the mechanical arm can be ensured to move to any position;
the error correction module is used for comparing real-time data of the multi-mode visual positioning module with stacking positions on a stacking area and dynamically compensating joint errors of the mechanical arm, size deviation of goods and environmental vibration interference so as to ensure that the mechanical arm can accurately grasp and stack the goods;
the storage module is used for storing the grabbing paths and the stacking paths generated by the dynamic path planning module.
When the system is used, the position of the stacking area and the information of whether the stacking area can be used for stacking new cargoes or not can be acquired, then the movement of any position in space can be realized through the three-axis cooperation mechanical arm, the application range of the system is enlarged, and cargoes can be accurately conveyed to the position of the stacking area through the dynamic path planning module and the error correction module.
The grabbing paths and the stacking paths in the storage module are stored in a partitioning mode, the effective grabbing paths and the ineffective grabbing paths in the grabbing paths are stored in a partitioning mode, the effective stacking paths and the ineffective stacking paths in the stacking paths are stored in a partitioning mode, the effective grabbing paths and the effective stacking paths are stored, the effective grabbing paths and the effective stacking paths can be directly called for use when later grabbing operation and stacking operation occur, so that the stacking operation is accelerated, and cargo position information, stacking area position information and mechanical arm position information corresponding to the effective grabbing paths and the effective stacking paths are synchronously stored.
In order to reduce calculation of the dynamic path planning module and accelerate the planning speed of a route, the dynamic path planning module is provided with the following technical scheme that when planning a grabbing path and a stacking path of goods, the dynamic path planning module compares the goods position information, stacking area position information and mechanical arm position information acquired by the multi-mode visual positioning module with storage information in the storage module, and when the goods position information, stacking area position information and mechanical arm position information corresponding to the effective grabbing path and the effective stacking path stored in the storage module are identical to the acquired goods position information, stacking area position information and mechanical arm position, the effective grabbing path and/or the effective stacking path are directly acquired, so that the path generation efficiency can be effectively accelerated, and invalid calculation is avoided.
When the scheme is implemented, when the acquired position information of the goods is consistent with the position information of the mechanical arm and the information in the storage module, the corresponding effective grabbing paths are called, the mechanical arm grabs according to the effective grabbing paths, and when the acquired position information of the stacking area is consistent with the position information of the mechanical arm and the information in the storage module, the corresponding effective stacking paths are called, and the mechanical arm stacks the goods according to the effective stacking paths.
In order to reduce the calculation of the error correction module and accelerate the response time of error calibration, the following technical scheme is provided:
when the invalid grabbing paths are stored, marking the invalid grabbing paths which can grab the goods smoothly after calibration as first invalid grabbing paths, and the other invalid grabbing paths as second invalid grabbing paths, and storing the calibration parameters of the first invalid grabbing paths, the positions of the goods and the positions of the mechanical arms;
When the invalid stacking path is stored, the invalid stacking path which can smoothly stack the cargoes after the calibration is marked as an invalid stacking path I, the other invalid stacking paths are invalid stacking paths II, and the calibration parameters of the invalid stacking path I, the position of the mechanical arm and the information of the stacking area are stored.
When the error correction module corrects the mechanical arm, the position of the goods and the position of the stacking area are compared with the position of the mechanical arm, the position of the goods and the position of the stacking area in the first invalid grabbing path and the position of the mechanical arm in the first invalid stacking path in the storage module, when the compared information is the same, the corresponding calibration parameters are directly adjusted, the mechanical arm is calibrated according to the adjusted calibration parameters, and therefore the accuracy of grabbing and stacking routes is guaranteed.
The system comprises a stacking area, a mechanical arm, a man-machine interaction module, a control module and a control module, wherein the stacking area is provided with a plurality of storage units, the storage units are connected with the storage units, the control module is connected with the control module, and the control module is connected with the control module. When the system is implemented, a worker can grasp the running state (data in all aspects) of the system through the man-machine interaction module so as to grasp the running condition among all the components.
The system comprises a mechanical arm executing module, a mechanical arm stopping module, a stopping module and a stopping module, wherein the stopping module is connected with the mechanical arm executing module, the stopping module can be used for stopping the operation of the system when a dangerous condition occurs (for example, when an obstacle occurs in front of the mechanical arm and the mechanical arm is about to collide with the obstacle or goods are damaged and the stacking operation cannot be continued or the system fails, and the like), and the stopping module can be used for stopping the operation of the system so as to ensure the safety of the device.
Any combination of the features of the above embodiments may be used (as long as there is no contradiction between the combinations of the features), and for brevity of description, all of the possible combinations of the features of the above embodiments are not described, and all of the embodiments not explicitly described are also to be considered as being within the scope of the description.