CN206263418U - A kind of real-time seam tracking system of six degree of freedom welding robot line laser - Google Patents

A kind of real-time seam tracking system of six degree of freedom welding robot line laser Download PDF

Info

Publication number
CN206263418U
CN206263418U CN201621284920.1U CN201621284920U CN206263418U CN 206263418 U CN206263418 U CN 206263418U CN 201621284920 U CN201621284920 U CN 201621284920U CN 206263418 U CN206263418 U CN 206263418U
Authority
CN
China
Prior art keywords
degree
line laser
welding
freedom
real
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201621284920.1U
Other languages
Chinese (zh)
Inventor
邹焱飚
李进超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CN201621284920.1U priority Critical patent/CN206263418U/en
Application granted granted Critical
Publication of CN206263418U publication Critical patent/CN206263418U/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Manipulator (AREA)
  • Laser Beam Processing (AREA)
  • Numerical Control (AREA)

Abstract

本实用新型公开了一种六自由度焊接机器人线激光实时焊缝跟踪系统,包括六自由度机械臂、焊枪、线激光视觉传感器、工作台、自动焊机、送丝机构、嵌入式工业控制器、控制柜,工件放置在工作台上,所述线激光视觉传感器通过安装底座安装在焊枪上,焊枪置于机械臂末端,焊丝存放在容器中,通过导管,经由送丝装置送向焊枪,送丝装置固定于六自由度机械臂U轴上,容器固定于六自由度机械臂的S轴;所述嵌入式工业控制器与自动焊机、线激光视觉传感器、六自由度机械臂、控制柜信号连接。本实用新型解决了当前焊缝跟踪系统中激光条纹和焊接熔池距离过大的问题,具有完全自动化、焊接精度高、实时性好、抗干扰能力强等优点,系统结构简单,易于维护。

The utility model discloses a line laser real-time seam tracking system for a six-degree-of-freedom welding robot, which includes a six-degree-of-freedom mechanical arm, a welding torch, a line laser vision sensor, a workbench, an automatic welding machine, a wire feeding mechanism, and an embedded industrial controller , control cabinet, the workpiece is placed on the workbench, the line laser vision sensor is installed on the welding torch through the installation base, the welding torch is placed at the end of the mechanical arm, the welding wire is stored in the container, and sent to the welding torch through the wire feeding device through the conduit. The wire device is fixed on the U-axis of the six-degree-of-freedom robot arm, and the container is fixed on the S-axis of the six-degree-of-freedom robot arm; the embedded industrial controller is connected with the automatic welding machine, line laser vision sensor, six-degree-of-freedom robot arm, and control cabinet signal connection. The utility model solves the problem that the distance between the laser stripe and the welding molten pool is too large in the current welding seam tracking system, and has the advantages of complete automation, high welding precision, good real-time performance, strong anti-interference ability, etc. The system structure is simple and easy to maintain.

Description

一种六自由度焊接机器人线激光实时焊缝跟踪系统A six-degree-of-freedom welding robot line laser real-time seam tracking system

技术领域technical field

本实用新型涉及机器人线激光实时焊缝跟踪系统,尤其涉及六自由度焊接机器人线激光实时焊缝跟踪系统。The utility model relates to a robot line laser real-time seam tracking system, in particular to a six-degree-of-freedom welding robot line laser real-time seam tracking system.

背景技术Background technique

由于焊接作业存在工作环境恶劣、劳动强度大、效率低下等问题,当前焊接机器人已经逐步在的汽车生产、工程机械、造船以及集装箱生产等许多领域得到应用.焊接机器人通常采用示教再现的工作模式.为确保这种工作模式能在具体的焊接环境中实施,前工序中需通过人工点焊完成焊接工件的定位,这会引起定位误差,使实际轨迹偏离示教轨迹,从而导致示教编程获得的机器人焊接轨迹偏离了再现时的轨迹。Due to the problems of harsh working environment, high labor intensity, and low efficiency in welding operations, welding robots have been gradually applied in many fields such as automobile production, construction machinery, shipbuilding, and container production. Welding robots usually use the teaching and reproduction working mode .In order to ensure that this working mode can be implemented in a specific welding environment, the positioning of the welding workpiece needs to be completed by manual spot welding in the previous process, which will cause positioning errors and make the actual trajectory deviate from the teaching trajectory, resulting in the acquisition of teaching programming. The welding trajectory of the robot deviates from the trajectory at the time of reproduction.

随着机器视觉技术的发展,焊接机器人广泛使用视觉检测技术校正再现轨迹,实现焊缝跟踪。焊缝跟踪系统通常将视觉系统安装在机械手末端,当机器人作业时,视觉系统与焊枪同步工作,实时检测工件在焊接过程中由高温引起的热变形,并调整焊枪与焊缝间的位置。With the development of machine vision technology, welding robots widely use visual inspection technology to correct and reproduce the trajectory to realize weld seam tracking. The welding seam tracking system usually installs the vision system at the end of the manipulator. When the robot is working, the vision system and the welding torch work synchronously to detect the thermal deformation of the workpiece caused by high temperature during the welding process in real time, and adjust the position between the welding torch and the weld seam.

焊缝实时跟踪系统主要技术指标是激光条纹8和焊接熔池5之间的距离d,如附图4。d越小则跟踪精度越高,通常希望d<30mm,但是这会导致视觉系统检测的图像信息中存在强烈的弧光和飞溅,造成测量精度降低和产生大量错误数据,当焊接电流超过300A后,此现象更加明显。为了减小弧光飞溅的干扰,目前大部分焊缝跟踪系统的d都在70mm左右,这大大降低了跟踪实时性与焊接精度。因此如何从含有强烈噪声干扰的图像中识别出焊缝,快速、准确获取其位置是实时焊缝跟踪中重要的问题。The main technical index of the weld seam real-time tracking system is the distance d between the laser stripe 8 and the weld pool 5, as shown in Figure 4. The smaller d is, the higher the tracking accuracy is. Generally, it is expected that d<30mm, but this will cause strong arcs and spatters in the image information detected by the vision system, resulting in reduced measurement accuracy and a large amount of erroneous data. When the welding current exceeds 300A, This phenomenon is more obvious. In order to reduce the interference of arc spatter, the d of most welding seam tracking systems is about 70mm, which greatly reduces the real-time tracking and welding accuracy. Therefore, how to identify the weld seam from the image with strong noise interference and obtain its position quickly and accurately is an important issue in real-time weld seam tracking.

实用新型内容Utility model content

本实用新型的目的在于克服现有技术的不足,提供一种六自由度焊接机器人线激光实时焊缝跟踪系统及方法,旨在解决当前自动焊接技术中视觉图像处理困难以及激光条纹与焊接熔池距离过大的问题The purpose of this utility model is to overcome the deficiencies of the prior art, to provide a six-degree-of-freedom welding robot line laser real-time weld seam tracking system and method, aiming to solve the problems of visual image processing and laser stripes and welding pool in the current automatic welding technology. The problem of too much distance

上述目的是通过以下技术方案实现的:The above-mentioned purpose is achieved through the following technical solutions:

一种六自由度焊接机器人线激光实时焊缝跟踪系统,包括六自由度机械臂,焊枪,线激光视觉传感器,工作台,自动焊机,送丝机构,嵌入式工业控制器、控制柜,工件放置在工作台上,工件的位置和倾斜角度可以手动调节,所述线激光视觉传感器通过安装底座安装在焊枪上,焊枪置于机械臂末端,线激光视觉传感器和焊枪通过六自由度机械臂的运动而改变其在空间的位置,焊丝存放在容器中,通过导管,经由送丝装置送向焊枪,送丝装置固定于六自由度机械臂U轴上,容器固定于六自由度机械臂的S轴;所述控制柜分别与自动焊机、六自由度机械臂、嵌入式工业控制器信号连接,所述嵌入式工业控制器还与线激光视觉传感器信号连接,用于根据线激光视觉传感器获取的图像识别跟踪对象并准确确定其位置,将所得到的位置偏差传输给六自由度机械臂,实时跟踪并修正焊枪运动轨迹,实现精确的在线自动焊接。A six-degree-of-freedom welding robot line laser real-time seam tracking system, including a six-degree-of-freedom mechanical arm, a welding torch, a line laser vision sensor, a workbench, an automatic welding machine, a wire feeding mechanism, an embedded industrial controller, a control cabinet, and a workpiece Placed on the workbench, the position and inclination angle of the workpiece can be adjusted manually. The line laser vision sensor is installed on the welding torch through the mounting base, and the welding torch is placed at the end of the mechanical arm. The line laser vision sensor and welding torch pass through the six-degree-of-freedom mechanical arm. Movement changes its position in space. The welding wire is stored in the container, and sent to the welding torch through the catheter through the wire feeding device. The wire feeding device is fixed on the U axis of the six-degree-of-freedom robot arm, and the container is fixed on the S of the six-degree-of-freedom robot arm. shaft; the control cabinet is respectively connected with the automatic welding machine, the six-degree-of-freedom mechanical arm, and the embedded industrial controller signal, and the embedded industrial controller is also connected with the line laser vision sensor signal, for obtaining according to the line laser vision sensor Image recognition to track the object and accurately determine its position, and transmit the obtained position deviation to the six-degree-of-freedom robotic arm to track and correct the trajectory of the welding torch in real time to achieve accurate online automatic welding.

进一步地,所述线激光视觉传感器包括激光传感器本体、相机、线激光发生器、激光发生器底座,所述的相机竖直固定在激光传感器本体内,所述线激光发生器通过激光发生器底座固定在激光传感器本体内且轴线与相机的轴线呈一定夹角。Further, the line laser vision sensor includes a laser sensor body, a camera, a line laser generator, and a laser generator base. The camera is vertically fixed in the laser sensor body, and the line laser generator passes through the laser generator base. It is fixed in the laser sensor body and the axis forms a certain angle with the axis of the camera.

进一步地,所述线激光发生器的轴线与相机的轴线的夹角为20°。Further, the angle between the axis of the line laser generator and the axis of the camera is 20°.

进一步地,所述的相机采用CMOS相机,所述的CMOS相机高速采集携带焊缝信息的特征条纹图像并实时传输到嵌入式工业控制器。Further, the camera adopts a CMOS camera, and the CMOS camera collects characteristic fringe images carrying weld seam information at high speed and transmits them to the embedded industrial controller in real time.

进一步地,所述送丝机构为YWC-WFRPM42RD。Further, the wire feeding mechanism is YWC-WFRPM42RD.

进一步地,所述嵌入式工业控制器为研华IPC-510,控制柜为JZRCR-YTB21-F380。Further, the embedded industrial controller is Advantech IPC-510, and the control cabinet is JZRCR-YTB21-F380.

进一步地,所述自动焊机为MOTOWELD-RD350。Further, the automatic welding machine is MOTOWELD-RD350.

进一步地,所述六自由度机械臂为由六根轴组成,S轴与机器人架台相连,T轴加装焊枪,轴与轴之间装有伺服电机,允许相互转动。Further, the six-degree-of-freedom mechanical arm is composed of six axes, the S-axis is connected to the robot platform, the T-axis is equipped with a welding torch, and a servo motor is installed between the axes to allow mutual rotation.

相比现有技术,本实用新型有如下优点:Compared with the prior art, the utility model has the following advantages:

(1)通过线激光视觉传感器检测焊缝特征点,精度高。通过嵌入式工业控制器对焊缝图像进行处理,控制送丝与焊接装置以及伺服驱动器,系统结构简单,易于维护;(1) The feature points of the weld seam are detected by the line laser vision sensor with high precision. The embedded industrial controller processes the welding seam image, controls the wire feeding and welding device and the servo drive, and the system structure is simple and easy to maintain;

(2)在能够在含有大量弧光与飞溅的环境下提取焊缝中心点的坐标值,精度高,抗干扰能力强,将激光条纹与焊接熔池的距离缩小至30mm以内,增强了焊缝跟踪的实时性。(2) The coordinate value of the center point of the weld can be extracted in an environment containing a large amount of arc light and spatter, with high precision and strong anti-interference ability, and the distance between the laser stripe and the welding pool is reduced to within 30mm, which enhances weld seam tracking real-time.

附图说明Description of drawings

图1是本实用新型实施例的六自由度焊接机器人线激光实时焊缝跟踪系统总体结构示意图;Fig. 1 is a schematic diagram of the overall structure of a six-degree-of-freedom welding robot line laser real-time seam tracking system according to an embodiment of the present invention;

图2是本实用新型实施例的六自由度焊接机器人线激光实时焊缝跟踪系统中机械臂自由度示意图;Fig. 2 is a schematic diagram of the degree of freedom of the mechanical arm in the real-time weld seam tracking system of the six-degree-of-freedom welding robot line laser in the embodiment of the present invention;

图3是本实用新型实施例的六自由度机械臂与焊枪、线激光视觉传感器安装示意图。Fig. 3 is a schematic diagram of installation of a six-degree-of-freedom mechanical arm, a welding torch, and a line laser vision sensor according to an embodiment of the present invention.

图4是本实用新型实施例的焊缝跟踪系统中激光条纹与焊接熔池距离示意图。Fig. 4 is a schematic diagram of the distance between the laser stripe and the weld pool in the weld seam tracking system according to the embodiment of the present invention.

图5是本实用新型实施例的六自由度焊接机器人线激光实时焊缝跟踪方法整体工作流程图。Fig. 5 is an overall working flow chart of the real-time welding seam tracking method of the six-degree-of-freedom welding robot line laser according to the embodiment of the present invention.

图6是本实用新型实施例的六自由度焊接机器人线激光实时焊缝跟踪方法中特征点检测算法流程图。Fig. 6 is a flow chart of the feature point detection algorithm in the real-time seam tracking method of the six-degree-of-freedom welding robot line laser according to the embodiment of the present invention.

图中所示:1-六自由度机械臂;2-焊枪;3-线激光视觉传感器;4-安装底座;5-焊接熔池;6-相机;7-线激光发生器;8-激光条纹;9-工件;10-嵌入式工业控制器;11-控制柜;12-自动焊机;13-工作台;14-倍福模块。As shown in the figure: 1-six degrees of freedom mechanical arm; 2-welding torch; 3-line laser vision sensor; 4-mounting base; 5-welding pool; 6-camera; 7-line laser generator; 8-laser stripe ; 9-workpiece; 10-embedded industrial controller; 11-control cabinet; 12-automatic welding machine; 13-workbench; 14-Beckhoff module.

具体实施方式detailed description

下面通过具体实施例对本实用新型的目的作进一步详细地描述,实施例不能在此一一赘述,但本实用新型的实施方式并不因此限定于以下实施例。The purpose of the utility model is further described in detail through specific examples below, and the examples cannot be repeated here one by one, but the implementation of the utility model is not therefore limited to the following examples.

实施例Example

如图1至图3所示,一种六自由度焊接机器人线激光实时焊缝跟踪系统,包括六自由度机械臂1、焊枪2、线激光视觉传感器3、工作台13、自动焊机12、送丝机构、嵌入式工业控制器10、倍福模块14、控制柜11,工件9放置在工作台上,工件9的位置和倾斜角度可以手动调节,所述线激光视觉传感器3通过安装底座4安装在焊枪2上,焊枪2置于机械臂末端,线激光视觉传感器3和焊枪通过六自由度机械臂1的运动而改变其在空间的位置,焊丝存放在容器中,通过导管,经由送丝装置送向焊枪2,送丝装置固定于六自由度机械臂1的U轴上,容器固定于六自由度机械臂1的S轴;所述控制柜11分别与自动焊机12、六自由度机械臂1、嵌入式工业控制器10信号连接,其中控制柜11与嵌入式工业控制器10通过倍福模块14相连接;所述嵌入式工业控制器10还通过以太网与线激光视觉传感器3信号连接,用于根据线激光视觉传感器获取的图像识别跟踪对象并准确确定其位置,将所得到的位置偏差传输给六自由度机械臂,实时跟踪并修正焊枪运动轨迹,实现精确的在线自动焊接。As shown in Figures 1 to 3, a six-degree-of-freedom welding robot line laser real-time seam tracking system includes a six-degree-of-freedom mechanical arm 1, a welding torch 2, a line laser vision sensor 3, a workbench 13, an automatic welding machine 12, Wire feeding mechanism, embedded industrial controller 10, Beckhoff module 14, control cabinet 11, the workpiece 9 is placed on the workbench, the position and inclination angle of the workpiece 9 can be adjusted manually, and the line laser vision sensor 3 passes through the installation base 4 Installed on the welding torch 2, the welding torch 2 is placed at the end of the mechanical arm. The line laser vision sensor 3 and the welding torch change their positions in space through the movement of the six-degree-of-freedom mechanical arm 1. The welding wire is stored in the container and passed through the catheter. The device is sent to the welding gun 2, the wire feeding device is fixed on the U-axis of the six-degree-of-freedom mechanical arm 1, and the container is fixed on the S-axis of the six-degree-of-freedom mechanical arm 1; Robotic arm 1, embedded industrial controller 10 signal connection, wherein control cabinet 11 and embedded industrial controller 10 are connected through Beckhoff module 14; Said embedded industrial controller 10 is also connected with line laser vision sensor 3 through Ethernet The signal connection is used to identify and track the object and accurately determine its position according to the image acquired by the line laser vision sensor, and transmit the obtained position deviation to the six-degree-of-freedom mechanical arm to track and correct the trajectory of the welding torch in real time to achieve accurate online automatic welding .

所述线激光视觉传感器2包括激光传感器本体、相机6、线激光发生器7、激光发生器底座,所述的相机竖直固定在激光传感器本体内,所述线激光发生器7通过激光发生器底座固定在激光传感器本体内且轴线与相机6的轴线呈一定夹角。The line laser vision sensor 2 includes a laser sensor body, a camera 6, a line laser generator 7, and a laser generator base, and the camera is vertically fixed in the laser sensor body, and the line laser generator 7 passes through the laser generator. The base is fixed in the laser sensor body and the axis forms a certain angle with the axis of the camera 6 .

所述线激光发生器7的轴线与相机的轴线的夹角为20°。The angle between the axis of the line laser generator 7 and the axis of the camera is 20°.

所述的相机6采用CMOS相机,所述的CMOS相机高速采集携带焊缝信息的特征条纹图像并实时传输到嵌入式工业控制器10。The camera 6 adopts a CMOS camera, and the CMOS camera collects characteristic fringe images carrying weld seam information at high speed and transmits them to the embedded industrial controller 10 in real time.

所述送丝机构为YWC-WFRPM42RD。The wire feeding mechanism is YWC-WFRPM42RD.

所述嵌入式工业控制器10为研华IPC-510,控制柜11为JZRCR-YTB21-F380。The embedded industrial controller 10 is Advantech IPC-510, and the control cabinet 11 is JZRCR-YTB21-F380.

所述自动焊机12为MOTOWELD-RD350。The automatic welding machine 12 is MOTOWELD-RD350.

所述六自由度机械臂1为由六根轴组成,S轴与机器人架台相连,T轴加装焊枪,轴与轴之间装有伺服电机,允许相互转动。The six-degree-of-freedom mechanical arm 1 is composed of six axes, the S-axis is connected with the robot frame, the T-axis is equipped with a welding torch, and a servo motor is installed between the axes to allow mutual rotation.

如图5所示,本实施例提供的六自由度焊接机器人线激光实时焊缝跟踪系统的跟踪方法,包括步骤:As shown in Figure 5, the tracking method of the six-degree-of-freedom welding robot line laser real-time seam tracking system provided by this embodiment includes steps:

(1)焊接时将线激光视觉传感器3中相机6采集到的图像先进行图像预处理;(1) During welding, the image collected by the camera 6 in the line laser vision sensor 3 is first subjected to image preprocessing;

(2)采用基于加权余弦相似度(WLCS)的特征点提取算法,得到预处理后的当前帧图像中焊缝中心特征点的像素坐标值;(2) Using a feature point extraction algorithm based on weighted cosine similarity (WLCS), obtain the pixel coordinate value of the weld center feature point in the preprocessed current frame image;

(3)将所述坐标值转换成相机坐标系下的三维坐标值之后,把该值与初始值的偏差值(Δx,Δy,Δz)通过倍福模块14实时发送给六自由度机器人,从而带动焊枪完成自动焊接过程。(3) After the coordinate values are converted into three-dimensional coordinate values in the camera coordinate system, the deviation values (Δx, Δy, Δz) between the values and the initial values are sent to the six-degree-of-freedom robot in real time through the Beckhoff module 14, thereby Drive the welding torch to complete the automatic welding process.

具体而言,在进行步骤(1)之前,还包括步骤:Specifically, before step (1), steps are also included:

根据线激光视觉传感器中的相机采集的图像获取焊接前初始的焊缝特征点和相邻区域。According to the image collected by the camera in the line laser vision sensor, the initial weld feature points and adjacent areas before welding are obtained.

具体而言,所述的根据线激光视觉传感器中的相机采集的图像获取焊接前初始的焊缝特征点和相邻区域的步骤具体包括:Specifically, the step of obtaining the initial weld feature points and adjacent areas before welding according to the image collected by the camera in the line laser vision sensor specifically includes:

(1)调整六自由度焊接机器人机械臂的位置,使得焊枪末端(即焊丝末端)位于待焊工件焊缝位置的正上方,并使得固定在焊枪上的线激光视觉传感器处于最佳工作位置,即在焊接过程中既能捕捉到清晰地图像,又不会使得线激光视觉传感器和待焊工件发生干涉;(1) Adjust the position of the mechanical arm of the six-degree-of-freedom welding robot so that the end of the welding torch (that is, the end of the welding wire) is located directly above the weld seam of the workpiece to be welded, and the line laser vision sensor fixed on the welding torch is in the best working position, That is to say, a clear image can be captured during the welding process without interference between the line laser vision sensor and the workpiece to be welded;

(2)线激光视觉传感器中的相机采集图像并发送到嵌入式工业控制器,嵌入式工业控制器通过调用Halcon软件的库函数进行初始化,得到初始的焊缝特征点和相邻区域;(2) The camera in the line laser vision sensor collects images and sends them to the embedded industrial controller. The embedded industrial controller initializes by calling the library function of the Halcon software to obtain the initial weld feature points and adjacent areas;

(3)嵌入式工业控制器将得到的焊接前初始特征点像素坐标值转换成基于相机坐标系的三维坐标值。(3) The embedded industrial controller converts the pixel coordinate values of the initial feature points before welding into three-dimensional coordinate values based on the camera coordinate system.

具体而言,如图6所示,所述的步骤(1)具体包括:Specifically, as shown in Figure 6, described step (1) specifically includes:

(11)焊接时线激光视觉传感器的相机连续采集每一帧图像,并发送至嵌入式工业控制器进行处理计算;(11) The camera of the laser vision sensor continuously collects each frame of image during welding, and sends it to the embedded industrial controller for processing and calculation;

(12)嵌入式工业控制器将得到的图像进行用于减小焊接图像中飞溅和弧光噪声、使得图像纯净度变高的预处理,所述的预处理包括阈值处理、二值化和三幅图像相乘处理。(12) The embedded industrial controller performs preprocessing on the obtained image to reduce spatter and arc noise in the welding image, so that the purity of the image becomes higher. The preprocessing includes threshold processing, binarization and three Image multiplication processing.

具体而言,所述步骤(2)具体包括:Specifically, the step (2) specifically includes:

(21)初始化跟踪器,嵌入式工业控制器通过调用Halcon软件的库函数进行初始化,得到初始的焊缝特征点和相邻区域;(21) Initialize the tracker, the embedded industrial controller initializes by calling the library function of the Halcon software, and obtains the initial weld seam feature points and adjacent areas;

(22)利用运动模型p(xt|xt-1)在图像中采集大量目标的候选状态,xt表示为目标物体的状态变量,下标t为当前图像帧数;(22) Use the motion model p(x t |x t-1 ) to collect a large number of target candidate states in the image, x t represents the state variable of the target object, and the subscript t is the current image frame number;

(23)利用测量模型p(yt|xt)来评估候选状态变量,找出与候选状态变量相似度最高的观测向量,yt为对应xt的观测向量,此处观测模型采用加权余弦相似度(WLCS)测量法;(23) Use the measurement model p(y t |x t ) to evaluate the candidate state variables, and find the observation vector with the highest similarity with the candidate state variables, y t is the observation vector corresponding to x t , and the observation model here uses weighted cosine similarity (WLCS) measurement;

(4)通过在傅里叶框架下应用粒子滤波法,算出最佳候选状态位置作为该图像中焊缝特征点的实际位置坐标,计算方法是:(4) By applying the particle filter method under the Fourier framework, the best candidate state position is calculated as the actual position coordinates of the weld feature points in the image. The calculation method is:

p(xt|y1:t-1)=∫p(xt|xt-1)p(xt-1|y1:t-1)dxt-1 p(x t |y 1:t-1 )=∫p(x t |x t-1 )p(x t-1 |y 1:t-1 )dx t-1

p(xt|y1:t)=p(yt|xt)p(xt|y1:t-1)/p(yt|xt)p(xt|y1:t-1)p(x t |y 1:t )=p(y t |x t )p(x t |y 1:t-1 )/p(y t |x t )p(x t |y 1:t- 1 )

式中y1:t表示从时刻1到时刻t的所有观测向量,第一个公式是预测公式,通过时刻1到时刻t-1的观测向量y1:t-1预测时刻t的状态变量xt;第二个公式是更新公式,在第一个公式中加入时刻t的观测向量yt更正状态变量xtIn the formula, y 1:t represents all observation vectors from time 1 to time t, and the first formula is a prediction formula, which predicts the state variable x at time t through the observation vector y 1:t-1 from time 1 to time t-1 t ; the second formula is an update formula, and the observation vector y t at time t is added to the first formula to correct the state variable x t .

具体而言,所述步骤(23)的加权余弦相似度(WLCS)测量法的具体为:Specifically, the Weighted Cosine Similarity (WLCS) measurement method of the step (23) is specifically:

(231)计算出余弦相似度:(231) Calculate the cosine similarity:

式中y为观测向量,t为目标模块,下标j为第j个子区域向量,w为对应子区域向量的权重;In the formula, y is the observation vector, t is the target module, the subscript j is the jth sub-region vector, and w is the weight of the corresponding sub-region vector;

(232)计算出余弦相似度后进入在线更新,包括权重与目标模块的更新;模块更新公式为:(232) Enter the online update after calculating the cosine similarity, including the update of the weight and the target module; the module update formula is:

式中ε是预先设定的阈值,η是更新率;where ε is a preset threshold, and η is the update rate;

(233)完成目标模块t的更新后,采集该图像模块的正样本和负样本,并通过解决下列最优化问题更新权重:(233) After completing the update of the target module t, collect the positive and negative samples of the image module, and update the weights by solving the following optimization problem:

其中Ω+与Ω-分别表示焊缝特征点的正样本与负样本,w′等于上一时刻的权重值,即w′=wt-1in Ω + and Ω - represent positive and negative samples of weld feature points respectively, and w' is equal to the weight value at the previous moment, that is, w'=w t-1 .

具体而言,所述步骤(3)具体包括:Specifically, the step (3) specifically includes:

(31)将获得的图像中焊缝中心特征点的像素坐标值转换成相机坐标系下的三维坐标值之后与当前焊枪位置三维坐标进行比较,得到偏差值(Δx,Δy,Δz);(31) Convert the pixel coordinate value of the weld center feature point in the obtained image into the three-dimensional coordinate value under the camera coordinate system and compare it with the three-dimensional coordinate value of the current welding torch position to obtain the deviation value (Δx, Δy, Δz);

(32)嵌入式工业控制器通过倍福模块14实时地将所述偏差值(Δx,Δy,Δz)发送给伺服驱动器,伺服驱动器驱动伺服电机并带动六自由度机械臂运动,从而使得焊枪末端的焊丝沿着工件的焊缝中点运动,完成六自由度机器人的实时焊缝跟踪过程。(32) The embedded industrial controller sends the deviation value (Δx, Δy, Δz) to the servo driver in real time through the Beckhoff module 14, and the servo driver drives the servo motor and drives the six-degree-of-freedom mechanical arm to move, so that the end of the welding torch The welding wire moves along the midpoint of the weld seam of the workpiece to complete the real-time seam tracking process of the six-degree-of-freedom robot.

本实施例所述的各零部件可选型如下,但选型不限于此:嵌入式工业控制器:研华IPC-510,可选用其他同类型的嵌入式工业控制器;工件:角钢,可选用其它形状规则的同类型工件。The optional parts of the parts described in this embodiment are as follows, but the selection is not limited to this: Embedded industrial controller: Advantech IPC-510, other embedded industrial controllers of the same type can be used; workpiece: angle steel, optional Other regular shaped workpieces of the same type.

本实用新型的上述实施例仅仅是为清楚地说明本实用新型所作的举例,而并非是对本实用新型的实施方式的限定。对于所属领域的普通技术人员来说,在上述说明的基础上还可以做出其它不同形式的变化或变动。这里无需也无法对所有的实施方式予以穷举。凡在本实用新型的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本实用新型权利要求的保护范围之内。The above-mentioned embodiments of the present utility model are only examples for clearly illustrating the present utility model, and are not intended to limit the implementation of the present utility model. For those of ordinary skill in the art, other changes or changes in different forms can be made on the basis of the above description. It is not necessary and impossible to exhaustively list all the implementation manners here. All modifications, equivalent replacements and improvements made within the spirit and principles of the utility model shall be included in the protection scope of the claims of the utility model.

Claims (8)

1.一种六自由度焊接机器人线激光实时焊缝跟踪系统,其特征在于:包括六自由度机械臂、焊枪、线激光视觉传感器、工作台、自动焊机、送丝机构、嵌入式工业控制器、控制柜,工件放置在工作台上,工件的位置和倾斜角度可以手动调节,所述线激光视觉传感器通过安装底座安装在焊枪上,焊枪置于机械臂末端,线激光视觉传感器和焊枪通过六自由度机械臂的运动而改变其在空间的位置,焊丝存放在容器中,通过导管,经由送丝装置送向焊枪,送丝装置固定于六自由度机械臂U轴上,容器固定于六自由度机械臂的S轴;所述控制柜分别与自动焊机、六自由度机械臂、嵌入式工业控制器信号连接,所述嵌入式工业控制器还与线激光视觉传感器信号连接,用于根据线激光视觉传感器获取的图像识别跟踪对象并准确确定其位置,将所得到的位置偏差传输给六自由度机械臂,实时跟踪并修正焊枪运动轨迹,实现精确的在线自动焊接。1. A line laser real-time seam tracking system for a six-degree-of-freedom welding robot, characterized in that it includes a six-degree-of-freedom mechanical arm, a welding torch, a line laser vision sensor, a workbench, an automatic welding machine, a wire feeding mechanism, and an embedded industrial control The workpiece is placed on the workbench, and the position and inclination angle of the workpiece can be adjusted manually. The line laser vision sensor is installed on the welding torch through the installation base, and the welding torch is placed at the end of the mechanical arm. The line laser vision sensor and welding torch pass through The movement of the six-degree-of-freedom mechanical arm changes its position in space. The welding wire is stored in the container, passed through the catheter, and sent to the welding torch through the wire feeding device. The S axis of the mechanical arm of the degree of freedom; the control cabinet is respectively connected with the automatic welding machine, the six-degree-of-freedom mechanical arm, and the embedded industrial controller signal, and the embedded industrial controller is also connected with the line laser vision sensor signal for According to the image acquired by the line laser vision sensor, the tracking object is recognized and its position is accurately determined, and the obtained position deviation is transmitted to the six-degree-of-freedom mechanical arm, which tracks and corrects the trajectory of the welding torch in real time to achieve accurate online automatic welding. 2.根据权利要求1所述的六自由度焊接机器人线激光实时焊缝跟踪系统,其特征在于:所述线激光视觉传感器包括激光传感器本体、相机、线激光发生器、激光发生器底座,所述的相机竖直固定在激光传感器本体内,所述线激光发生器通过激光发生器底座固定在激光传感器本体内且轴线与相机的轴线呈一定夹角。2. The line laser real-time seam tracking system of a six-degree-of-freedom welding robot according to claim 1, wherein the line laser visual sensor includes a laser sensor body, a camera, a line laser generator, and a laser generator base, and The above camera is vertically fixed in the laser sensor body, the line laser generator is fixed in the laser sensor body through the base of the laser generator and the axis forms a certain angle with the axis of the camera. 3.根据权利要求2所述的六自由度焊接机器人线激光实时焊缝跟踪系统,其特征在于:所述线激光发生器的轴线与相机的轴线的夹角为20o3. The line laser real-time seam tracking system of a six-degree-of-freedom welding robot according to claim 2, wherein the angle between the axis of the line laser generator and the axis of the camera is 20 ° . 4.根据权利要求2所述的六自由度焊接机器人线激光实时焊缝跟踪系统,其特征在于:所述的相机采用CMOS相机,所述的CMOS相机高速采集携带焊缝信息的特征条纹图像并实时传输到嵌入式工业控制器。4. The six-degree-of-freedom welding robot line laser real-time weld seam tracking system according to claim 2, characterized in that: the camera adopts a CMOS camera, and the CMOS camera collects the characteristic fringe image carrying weld seam information at a high speed and Real-time transmission to embedded industrial controllers. 5.根据权利要求1所述的六自由度焊接机器人线激光实时焊缝跟踪系统,其特征在于:所述送丝机构为YWC-WFRPM42RD。5. The six-degree-of-freedom welding robot line laser real-time seam tracking system according to claim 1, characterized in that: the wire feeding mechanism is YWC-WFRPM42RD. 6.根据权利要求1所述的六自由度焊接机器人线激光实时焊缝跟踪系统,其特征在于:所述嵌入式工业控制器为研华IPC-510,控制柜为JZRCR-YTB21-F380。6. The six-degree-of-freedom welding robot line laser real-time seam tracking system according to claim 1, characterized in that: the embedded industrial controller is Advantech IPC-510, and the control cabinet is JZRCR-YTB21-F380. 7.根据权利要求1所述的六自由度焊接机器人线激光实时焊缝跟踪系统,其特征在于:所述自动焊机为MOTOWELD-RD350。7. The six-degree-of-freedom welding robot line laser real-time seam tracking system according to claim 1, characterized in that: the automatic welding machine is MOTOWELD-RD350. 8.根据权利要求1所述的六自由度焊接机器人线激光实时焊缝跟踪系统,其特征在于:所述六自由度机械臂为由六根轴组成,S轴与机器人架台相连,T轴加装焊枪,轴与轴之间装有伺服电机,允许相互转动。8. The six-degree-of-freedom welding robot line laser real-time weld seam tracking system according to claim 1, characterized in that: the six-degree-of-freedom mechanical arm is composed of six axes, the S axis is connected to the robot stand, and the T axis is additionally installed Welding torch, with servo motors installed between the shafts, allowing mutual rotation.
CN201621284920.1U 2016-11-28 2016-11-28 A kind of real-time seam tracking system of six degree of freedom welding robot line laser Expired - Fee Related CN206263418U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201621284920.1U CN206263418U (en) 2016-11-28 2016-11-28 A kind of real-time seam tracking system of six degree of freedom welding robot line laser

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201621284920.1U CN206263418U (en) 2016-11-28 2016-11-28 A kind of real-time seam tracking system of six degree of freedom welding robot line laser

Publications (1)

Publication Number Publication Date
CN206263418U true CN206263418U (en) 2017-06-20

Family

ID=59042869

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201621284920.1U Expired - Fee Related CN206263418U (en) 2016-11-28 2016-11-28 A kind of real-time seam tracking system of six degree of freedom welding robot line laser

Country Status (1)

Country Link
CN (1) CN206263418U (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107813085A (en) * 2017-10-31 2018-03-20 湘潭大学 A kind of pipe pipe welding welding-gun rotates axial rake self-adaption regulation system
CN107931787A (en) * 2018-01-16 2018-04-20 无锡信捷电气股份有限公司 A kind of vision closed loop welding system and implementation method
CN108262586A (en) * 2018-03-02 2018-07-10 广州市盘古机器人科技有限公司 6 joint Manipulator welding application technology of vision
CN108971709A (en) * 2018-07-24 2018-12-11 上海第机床厂有限公司 Hard alloy bare wire automatic soldering device and automatic soldering method
CN109530906A (en) * 2018-12-28 2019-03-29 北京工业大学 A kind of friction stir welding machine device people configuration and motion algorithm
CN109746545A (en) * 2019-03-21 2019-05-14 杭州凯尔达机器人科技股份有限公司 Welding robot mounting structure and welding system
CN109822194A (en) * 2019-01-24 2019-05-31 江苏理工学院 A kind of weld tracker and welding method
CN109986255A (en) * 2017-12-29 2019-07-09 深圳中集智能科技有限公司 Mix visual servo parallel robot and operational method
CN110640737A (en) * 2018-11-07 2020-01-03 宁波赛朗科技有限公司 Industrial robot for measuring data fusion attitude
CN110653460A (en) * 2019-11-12 2020-01-07 吉林大学 New TIG welding device and welding method based on laser vision
WO2020010844A1 (en) * 2018-07-11 2020-01-16 成都熊谷加世电器有限公司 Laser-tracking-based welding system
CN111299735A (en) * 2019-12-17 2020-06-19 无锡砺成智能装备有限公司 An impeller-guided welding system
CN111299915A (en) * 2019-12-17 2020-06-19 无锡砺成智能装备有限公司 A six-axis welding system and welding method based on fan impeller
CN112222608A (en) * 2020-09-30 2021-01-15 山东理工职业学院 Welding seam tracking system based on automobile assembly line
CN112518126A (en) * 2020-12-14 2021-03-19 航天智造(上海)科技有限责任公司 Intelligent welding system based on large depth of field laser profiler
CN113510412A (en) * 2021-04-28 2021-10-19 湖北云眸科技有限公司 A detection system, detection method and storage medium for identifying weld status
CN114193034A (en) * 2021-12-17 2022-03-18 北京石油化工学院 Multi-gun efficient welding control method and system for precast slab steel bars
CN114789447A (en) * 2022-05-31 2022-07-26 杭州固建机器人科技有限公司 Intelligent welding structure and welding method for welding seam
CN114937388A (en) * 2022-04-08 2022-08-23 郑州科慧科技股份有限公司 High-imitation welding simulation teaching device and simulation welding method for industrial robot
CN116275395A (en) * 2023-04-06 2023-06-23 南京和邦能源科技有限公司 Tube welding robot for tube bundle type heat exchanger
CN116748742A (en) * 2023-05-16 2023-09-15 湖北纽睿德防务科技有限公司 An adaptive welding system
CN116810106A (en) * 2023-06-16 2023-09-29 中核检修有限公司 An automatic control system and working method for plasma arc welding of the outer end cover of spent fuel storage tank with uneven gap structure
CN118162830A (en) * 2024-05-15 2024-06-11 中油(新疆)石油工程有限公司 Welding system and control method for automatic seam-seeking welding in sealed cabin of storage tank buoyancy cabin
CN119077247A (en) * 2024-09-10 2024-12-06 自贡东方气体设备有限公司 Automatic welding device for large workpieces

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107813085B (en) * 2017-10-31 2019-05-07 湘潭大学 A system for self-adaptive adjustment of the inclination angle of the rotating shaft of the welding torch
CN107813085A (en) * 2017-10-31 2018-03-20 湘潭大学 A kind of pipe pipe welding welding-gun rotates axial rake self-adaption regulation system
CN109986255B (en) * 2017-12-29 2021-11-30 深圳中集智能科技有限公司 Hybrid vision servo parallel robot and operation method
CN109986255A (en) * 2017-12-29 2019-07-09 深圳中集智能科技有限公司 Mix visual servo parallel robot and operational method
CN107931787A (en) * 2018-01-16 2018-04-20 无锡信捷电气股份有限公司 A kind of vision closed loop welding system and implementation method
CN108262586A (en) * 2018-03-02 2018-07-10 广州市盘古机器人科技有限公司 6 joint Manipulator welding application technology of vision
WO2020010844A1 (en) * 2018-07-11 2020-01-16 成都熊谷加世电器有限公司 Laser-tracking-based welding system
CN108971709A (en) * 2018-07-24 2018-12-11 上海第机床厂有限公司 Hard alloy bare wire automatic soldering device and automatic soldering method
CN110640737A (en) * 2018-11-07 2020-01-03 宁波赛朗科技有限公司 Industrial robot for measuring data fusion attitude
CN109530906A (en) * 2018-12-28 2019-03-29 北京工业大学 A kind of friction stir welding machine device people configuration and motion algorithm
CN109822194A (en) * 2019-01-24 2019-05-31 江苏理工学院 A kind of weld tracker and welding method
CN109746545A (en) * 2019-03-21 2019-05-14 杭州凯尔达机器人科技股份有限公司 Welding robot mounting structure and welding system
CN110653460A (en) * 2019-11-12 2020-01-07 吉林大学 New TIG welding device and welding method based on laser vision
CN110653460B (en) * 2019-11-12 2023-04-25 吉林大学 Novel TIG welding device and welding method based on laser vision
CN111299735A (en) * 2019-12-17 2020-06-19 无锡砺成智能装备有限公司 An impeller-guided welding system
CN111299915A (en) * 2019-12-17 2020-06-19 无锡砺成智能装备有限公司 A six-axis welding system and welding method based on fan impeller
CN112222608A (en) * 2020-09-30 2021-01-15 山东理工职业学院 Welding seam tracking system based on automobile assembly line
CN112518126A (en) * 2020-12-14 2021-03-19 航天智造(上海)科技有限责任公司 Intelligent welding system based on large depth of field laser profiler
CN113510412A (en) * 2021-04-28 2021-10-19 湖北云眸科技有限公司 A detection system, detection method and storage medium for identifying weld status
CN114193034A (en) * 2021-12-17 2022-03-18 北京石油化工学院 Multi-gun efficient welding control method and system for precast slab steel bars
CN114193034B (en) * 2021-12-17 2023-05-09 北京石油化工学院 Multi-gun high-efficiency welding control method and system for prefabricated steel bars
CN114937388A (en) * 2022-04-08 2022-08-23 郑州科慧科技股份有限公司 High-imitation welding simulation teaching device and simulation welding method for industrial robot
CN114937388B (en) * 2022-04-08 2023-03-24 郑州科慧科技股份有限公司 High-imitation welding simulation teaching device and simulation welding method for industrial robot
CN114789447A (en) * 2022-05-31 2022-07-26 杭州固建机器人科技有限公司 Intelligent welding structure and welding method for welding seam
CN116275395A (en) * 2023-04-06 2023-06-23 南京和邦能源科技有限公司 Tube welding robot for tube bundle type heat exchanger
CN116748742A (en) * 2023-05-16 2023-09-15 湖北纽睿德防务科技有限公司 An adaptive welding system
CN116748742B (en) * 2023-05-16 2024-05-17 湖北纽睿德防务科技有限公司 An adaptive welding system
CN116810106A (en) * 2023-06-16 2023-09-29 中核检修有限公司 An automatic control system and working method for plasma arc welding of the outer end cover of spent fuel storage tank with uneven gap structure
CN118162830A (en) * 2024-05-15 2024-06-11 中油(新疆)石油工程有限公司 Welding system and control method for automatic seam-seeking welding in sealed cabin of storage tank buoyancy cabin
CN119077247A (en) * 2024-09-10 2024-12-06 自贡东方气体设备有限公司 Automatic welding device for large workpieces

Similar Documents

Publication Publication Date Title
CN206263418U (en) A kind of real-time seam tracking system of six degree of freedom welding robot line laser
CN106392267B (en) A kind of real-time welding seam tracking method of six degree of freedom welding robot line laser
CN116175035B (en) Intelligent welding method for steel structure high-altitude welding robot based on deep learning
CN110480128A (en) A real-time welding seam tracking method for a six-degree-of-freedom welding robot line laser
Baeten et al. Hybrid vision/force control at corners in planar robotic-contour following
CN113146620B (en) Dual-arm collaborative robot system and control method based on binocular vision
CN116872216B (en) Robot vision servo operation method based on finite time control
CN114378827B (en) Dynamic target tracking and grabbing method based on overall control of mobile mechanical arm
CN104384765B (en) Based on the automatic soldering method of threedimensional model and machine vision
CN104400279B (en) Pipeline space weld seam based on CCD identifies the method with trajectory planning automatically
CN107883929B (en) Monocular vision positioning device and method based on multi-joint mechanical arm
CN112589232B (en) A welding seam tracking method and device based on independent rectification deep learning
Hou et al. A teaching-free welding method based on laser visual sensing system in robotic GMAW
CN107999955A (en) A kind of six-shaft industrial robot line laser automatic tracking system and an automatic tracking method
CN114770461B (en) Mobile robot based on monocular vision and automatic grabbing method thereof
CN108607819A (en) Material sorting system and method
SE449313B (en) MANIPULATOR WELDING AND MANUFACTURING MANUAL
Chen et al. A robust visual servo control system for narrow seam double head welding robot
CN105643062B (en) Complex-curved shape recognition and welding gun posture control method based on rotating the arc
CN107433573A (en) Intelligent binocular captures mechanical arm automatically
CN111036863B (en) Device for positioning ladle drain by machine vision and application method thereof
CN114536346A (en) Mechanical arm accurate path planning method based on man-machine cooperation and visual detection
CN109465829A (en) A Geometric Parameter Identification Method of Industrial Robot Based on Transformation Matrix Error Model
CN107932502A (en) A kind of SCARA method for planning track of robot based on binocular stereo vision
Han et al. Grasping control method of manipulator based on binocular vision combining target detection and trajectory planning

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20170620

Termination date: 20191128

CF01 Termination of patent right due to non-payment of annual fee