CN103506756B - Laser lap welding gap detection system and method based on molten pool image vision sensing - Google Patents

Laser lap welding gap detection system and method based on molten pool image vision sensing Download PDF

Info

Publication number
CN103506756B
CN103506756B CN201310413452.8A CN201310413452A CN103506756B CN 103506756 B CN103506756 B CN 103506756B CN 201310413452 A CN201310413452 A CN 201310413452A CN 103506756 B CN103506756 B CN 103506756B
Authority
CN
China
Prior art keywords
molten pool
image
orifice
gap
welding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310413452.8A
Other languages
Chinese (zh)
Other versions
CN103506756A (en
Inventor
李铸国
孟威
吴毅雄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiao Tong University
Original Assignee
Shanghai Jiao Tong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Jiao Tong University filed Critical Shanghai Jiao Tong University
Priority to CN201310413452.8A priority Critical patent/CN103506756B/en
Publication of CN103506756A publication Critical patent/CN103506756A/en
Application granted granted Critical
Publication of CN103506756B publication Critical patent/CN103506756B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B23MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
    • B23KSOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
    • B23K26/00Working by laser beam, e.g. welding, cutting or boring
    • B23K26/02Positioning or observing the workpiece, e.g. with respect to the point of impact; Aligning, aiming or focusing the laser beam
    • B23K26/03Observing, e.g. monitoring, the workpiece
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B23MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
    • B23KSOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
    • B23K26/00Working by laser beam, e.g. welding, cutting or boring
    • B23K26/20Bonding
    • B23K26/21Bonding by welding
    • B23K26/24Seam welding
    • B23K26/244Overlap seam welding
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B23MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
    • B23KSOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
    • B23K26/00Working by laser beam, e.g. welding, cutting or boring
    • B23K26/70Auxiliary operations or equipment
    • B23K26/702Auxiliary equipment

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Plasma & Fusion (AREA)
  • Mechanical Engineering (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Laser Beam Processing (AREA)

Abstract

The invention discloses a laser lap welding gap detecting system and a laser lap welding gap detecting method based on molten pool image visual sensing. The detecting system is a visual sensing system and comprises a CMOS camera, a light filtering system, a secondary light source, an image capture card, a computer, a display and the like, wherein the CMOS camera has a LinLog photosensory technology. According to the detecting method, the secondary light source and emitted light of molten pools are used as light sources; plasma is filtered out by utilizing the light filtering system, and light intensity is adjusted; the computer is used for collecting and displaying molten pool images in real time, wherein the molten pool images are obtained by the CMOS camera; molten pool image edges and areas and orifice image edges and areas are extracted and calculated by utilizing a Labview image processing platform, and the quantitative relations between molten pool sizes and orifice areas and between the molten pool sizes and orifice gaps are obtained. The detecting system is simple in structure, clear in monitoring image, high in light signal detecting accuracy, strong in anti-jamming capacity, good in engineering practicability and capable of monitoring laser welding of T-type overlap joint gaps in real time.

Description

基于熔池图像视觉传感的激光搭接焊间隙检测系统及方法Laser lap welding gap detection system and method based on molten pool image vision sensing

技术领域 technical field

本发明涉及焊接技术领域,特别涉及一种基于熔池图像视觉传感的激光搭接焊间隙检测系统及方法。 The invention relates to the field of welding technology, in particular to a laser lap welding gap detection system and method based on molten pool image visual sensing.

背景技术 Background technique

激光焊接具有深宽比大、热影响区和热变形小以及生产效率高等优点,近年随着激光器件的发展,激光束品质和功率都有很大提高,因此激光焊接已经被越来越多地被应用于工业生产中。在激光焊接过程中伴随着多种光、声、热、电辐射现象,这些信号包含着与焊接过程和焊接质量相关的许多信息。其中,激光焊熔池的动态变化与焊接过程稳定性和缺陷的产生有相当大的关系,同时,熔池和小孔动态变化紧密联系,彼此影响,共同决定了焊接过程稳定性和焊接质量。实时观测熔池在焊接过程的动态变化和物理过程特征,能够揭示焊接过程的物理机制,指导焊接生产并改善焊接质量。 Laser welding has the advantages of large aspect ratio, small heat-affected zone and thermal deformation, and high production efficiency. In recent years, with the development of laser devices, the quality and power of laser beams have been greatly improved. Therefore, laser welding has been increasingly used used in industrial production. The laser welding process is accompanied by a variety of light, sound, heat, and electric radiation phenomena, and these signals contain a lot of information related to the welding process and welding quality. Among them, the dynamic change of the laser welding molten pool has a considerable relationship with the stability of the welding process and the occurrence of defects. At the same time, the dynamic changes of the molten pool and the small hole are closely related and affect each other, which jointly determine the stability of the welding process and welding quality. Real-time observation of the dynamic changes and physical process characteristics of the molten pool during the welding process can reveal the physical mechanism of the welding process, guide welding production and improve welding quality.

激光焊T型搭接接头是一种新型的搭接结构型式,此类结构焊接需要穿透上面板与下部板相连接,采用激光焊接具有独特的优势,目前对其相关的研究较少。在深熔搭接焊中受工件加工精度、夹具和焊接变形的影响,上下板间隙是很难避免。而间隙的存在必将影响焊接过程的稳定性, 引起焊接缺陷的产生。因此,如果能对间隙进行实时监控,就能控制激光搭接焊接过程的稳定性。而焊接过程中熔池的稳定性和间隙直接相关,其动态变化特征与间隙变化密切联系。因此,开发基于熔池图像视觉传感的激光搭接焊间隙的检测技术,已成为保证激光焊T型搭接接头质量的关键。 Laser welding T-shaped lap joint is a new type of lap joint structure. The welding of this type of structure needs to penetrate the upper plate and connect the lower plate. Laser welding has unique advantages, and there are few related researches on it at present. In the deep penetration lap welding, it is difficult to avoid the gap between the upper and lower plates due to the influence of workpiece machining accuracy, fixture and welding deformation. The existence of gaps will definitely affect the stability of the welding process and cause welding defects. Therefore, if the gap can be monitored in real time, the stability of the laser lap welding process can be controlled. The stability of the molten pool during the welding process is directly related to the gap, and its dynamic change characteristics are closely related to the gap change. Therefore, the development of laser lap welding gap detection technology based on molten pool image vision sensing has become the key to ensure the quality of laser welded T-shaped lap joints.

视觉传感监测系统在不同的工业领域中已经广泛应用了很长一段时间。焊接过程稳定性监测和跟踪传感方法一般有接触式、电弧式、电磁式、光电式、视觉式等多种。其中,视觉传感器因其具有与工件不接触、信息量大(可兼作监控)、抗电磁干扰能力强、灵敏度高、适用坡口形式多等优点,被认为是一种最有发展前景的传感方法。目前,常用的视觉传感器分为电荷耦合器件(CCD)式和互补金属氧化物半导体(CMOS)式两种,可将不同强度的光线信号转换为不同幅度的图像信息。与CCD式相比,CMOS传感器具有芯片集成度高、功耗低、响应速度快、动态范围广等优点,可采用“线性+对数”的图像信号放大模式,能对低亮度信号线性放大而对高亮度信号则进行对数放大,在保证低亮度区域图像对比度的同时尽可能地扩展动态范围,因此特别适合在像焊接这种明暗对比程度高的环境中工作。LinLog技术是一种特殊的感光技术,常用于拍摄高对比度的图像,该技术的基本原理就是利用对数压缩技术压缩图像中的超高亮区域,减小图像对比度。LinLog技术使传感器仅在接近饱和及饱和区域为对数压缩响应,而保留其在低照度区域的线性响应和灵敏度,所以既扩展了整个传感器的动态范围,又保证了低照度区域成像的质量。因而,利用机器视觉直接观察激光与工件的相互作用区域,通过图像处理获取熔池和小孔的特征信息,建立焊接过程实时监测系统,实现焊接质量的闭环控制,已成为重要的研究方向。 Vision sensing monitoring systems have been widely used in different industrial fields for a long time. The welding process stability monitoring and tracking sensing methods generally include contact type, arc type, electromagnetic type, photoelectric type, visual type and so on. Among them, the visual sensor is considered to be the most promising sensor due to its advantages of no contact with the workpiece, large amount of information (can also be used as monitoring), strong anti-electromagnetic interference ability, high sensitivity, and many applicable groove forms. method. At present, commonly used visual sensors are divided into charge-coupled device (CCD) type and complementary metal-oxide-semiconductor (CMOS) type, which can convert light signals of different intensities into image information of different amplitudes. Compared with the CCD type, the CMOS sensor has the advantages of high chip integration, low power consumption, fast response speed, and wide dynamic range. Logarithmic amplification is performed on high-brightness signals to extend the dynamic range as much as possible while ensuring the image contrast in low-brightness areas, so it is especially suitable for working in environments with high contrast between light and dark like welding. LinLog technology is a special photosensitive technology, which is often used to shoot high-contrast images. The basic principle of this technology is to use logarithmic compression technology to compress the super bright areas in the image and reduce the image contrast. LinLog technology enables the sensor to compress the response logarithmically only in areas close to saturation and saturation, while retaining its linear response and sensitivity in low-illumination areas, so it not only expands the dynamic range of the entire sensor, but also ensures the quality of imaging in low-illumination areas. Therefore, it has become an important research direction to use machine vision to directly observe the interaction area between the laser and the workpiece, obtain the characteristic information of the molten pool and small holes through image processing, establish a real-time monitoring system for the welding process, and realize the closed-loop control of welding quality.

目前,关于激光焊接的视觉传感技术研究较多,而采用视觉传感技术监测和跟踪激光搭接焊间隙相关研究还没有发现。经文献检索,在名为“激光搭接焊过程间隙的检测”(宫本勇等,激光工程,1996年,第24卷,第9期,67-69页)一文中,Isamu MIYAMOTO等人利用光电二极管监测了激光搭接焊汽车板过程中孔内等离子体和孔外等离子体信号强度与间隙量的关系。研究发现等离子体光发射交流信号的频率大约达到了10kHz,而当间隙大于0.3mm,频率为4-6 kHz时交流的均方值发生突变。该方法通过信号强度的计算和傅里叶变换发现孔内等离子体的信号强度和峰值频率与间隙量都有很好的对应关系。此文中采用光电二极管采集的等离子体信号不能实时反馈间隙的变化,且作者也没有对等离子体和熔池图像特征与间隙的关系做进一步的研究。 At present, there are many researches on the visual sensing technology of laser welding, but there is no research on the use of visual sensing technology to monitor and track the laser lap welding gap. After literature search, in the article titled "Detection of gaps in laser lap welding process" (Isamu Miyamoto et al., Laser Engineering, 1996, Vol. 24, No. 9, pp. 67-69), Isamu MIYAMOTO et al. used The photodiode monitors the relationship between the signal intensity of the plasma in the hole and the plasma outside the hole and the gap during the laser lap welding process. The study found that the frequency of the AC signal emitted by the plasma light reaches about 10kHz, and when the gap is greater than 0.3mm and the frequency is 4-6 kHz, the mean square value of the AC changes suddenly. This method finds that the signal intensity and peak frequency of the plasma in the hole have a good correspondence with the gap through the calculation of the signal intensity and Fourier transform. In this paper, the plasma signal collected by the photodiode cannot feed back the change of the gap in real time, and the author has not done further research on the relationship between the image characteristics of the plasma and the molten pool and the gap.

专利申请号为03116161.8,发明名称为“弧焊熔池动态特征视觉传感方法”的专利公开了一种弧焊熔池动态特征视觉传感方法,该方法以焊接电弧光照明焊接熔池,采用滤光片截取反射电弧光中的特定波长范围的光线作为成像光源,并用减光片调节光强,通过平面镜反射作用改变光线传播方向,采用CCD摄像机和普通光学镜头将同时刻的焊接熔池正面和反面信息成像在同一个CCD摄像机靶面,该方法可以获得清晰的焊接过程中焊接熔池正面和背面的图像本,实现对焊接过程的有效监测和控制,此专利方法在弧焊熔池动态特征监控中取得了较好的效果,但没有用于激光焊接。 The patent application number is 03116161.8, and the patent titled "Visual Sensing Method for Dynamic Features of Arc Welding Pool" discloses a visual sensing method for dynamic features of arc welding pool. The method uses welding arc light to illuminate the welding pool, and uses The filter intercepts the light of a specific wavelength range in the reflected arc light as the imaging light source, and adjusts the light intensity with a light-reducing film, changes the direction of light propagation through the reflection of the plane mirror, and uses a CCD camera and an ordinary optical lens to capture the front of the welding pool at the same time. It is imaged on the same CCD camera target surface as the information on the reverse side. This method can obtain clear images of the front and back sides of the welding pool during the welding process, and realize effective monitoring and control of the welding process. This patented method is dynamic in the arc welding pool. Good results have been achieved in feature monitoring, but not for laser welding.

专利申请号为201210325926.9、发明名称为“基于红外视觉传感的窄间隙焊接监控及焊缝偏差检测方法”公开了一种基于红外视觉传感的窄间隙焊接监控及焊缝偏差检测方法,该方法使用的红外视觉传感系统包括红外CMOS摄像机、滤光系统、图像采集卡、计算机和显示器等,该方法以窄间隙焊接电弧光和熔池自身辐射光作为光源,利用红外窄带滤光系统滤除干扰信号并调节光强,计算机实时采集并显示红外CMOS摄像机获取的焊接图像。通过图像截取窗口截取远离电弧侧的图像进行处理,并通过提取坡口单侧边缘来获取焊缝偏差信息,可在有效避免运动电弧干扰的同时,提高焊缝偏差检测的实时性,该专利申请针对的是窄间隙电弧焊熔池的检测,但没有考虑激光焊接情况。 The patent application number is 201210325926.9, and the title of the invention is "Narrow Gap Welding Monitoring and Weld Deviation Detection Method Based on Infrared Vision Sensing", which discloses a narrow gap welding monitoring and welding seam deviation detection method based on infrared vision sensing. The infrared vision sensing system used includes an infrared CMOS camera, a filter system, an image acquisition card, a computer, and a display. The signal is interfered and the light intensity is adjusted, and the computer collects and displays the welding images captured by the infrared CMOS camera in real time. The image on the side away from the arc is intercepted through the image interception window for processing, and the weld deviation information is obtained by extracting the single-side edge of the groove, which can effectively avoid the interference of the moving arc and improve the real-time performance of the weld deviation detection. The patent application It is aimed at the detection of the narrow gap arc welding molten pool, but does not consider the laser welding situation.

发明内容 Contents of the invention

针对以上简析的检测系统及方法没有考虑激光焊接情况的缺陷,本发明提出一种基于具有LinLog感光技术CMOS视觉传感的激光焊接T型搭接接头间隙的检测系统及方法,能实时监视焊接过程中不同间隙量下的熔池和孔口的动态行为,并能提取出熔池和孔口边缘和面积及周期性变化的信息,通过此方法能够达到焊接过程间隙的监测及跟踪的目的。 In view of the defect that the detection system and method briefly analyzed above do not consider the laser welding situation, the present invention proposes a detection system and method based on CMOS visual sensing of laser welding T-shaped lap joints with LinLog photosensitive technology, which can monitor welding in real time The dynamic behavior of the molten pool and the orifice under different gaps in the process can extract the edge and area of the molten pool and the orifice and the periodic change information. This method can achieve the purpose of monitoring and tracking the gap in the welding process.

本发明提供一种基于熔池图像视觉传感的激光焊T型搭接接头间隙的检测方法,包括如下步骤: The invention provides a method for detecting the gap of a laser welded T-shaped lap joint based on visual sensing of molten pool images, comprising the following steps:

(1)将工件(3)放置在工作台上,随工作台一起移动,激光头(1)固定不动;采用包含具有LinLog感光技术CMOS摄像机(5)、滤光系统(11)、辅助光源(9)、图像采集卡(6)、计算机(7)、显示器(8)的视觉传感系统,焊接图像信号经图像采集卡(6)送入计算机(7),经显示器(8)显示;将摄像机(5)放置在工作台侧面500-1000mm并与工件(3)表面呈75-85°的夹角,调整辅助光源(9)位于激光头(1)的前方300-500mm并与工件(3)表面呈25-35°;调整LinLog感光技术CMOS摄像机(5)图像大小及焦距; (1) Place the workpiece (3) on the workbench and move with the workbench, while the laser head (1) is fixed; it adopts a CMOS camera (5) with LinLog photosensitive technology, a filter system (11), and an auxiliary light source (9), image acquisition card (6), computer (7), visual sensing system of display (8), the welding image signal is sent to computer (7) through image acquisition card (6), and displayed by display (8); Place the camera (5) on the side of the workbench at 500-1000mm and form an included angle of 75-85 ° with the surface of the workpiece (3), adjust the auxiliary light source (9) to be 300-500mm in front of the laser head (1) and be in line with the workpiece ( 3) The surface is 25-35 ° ; adjust the image size and focal length of the LinLog photosensitive technology CMOS camera (5);

(2)调整具有LinLog感光技术CMOS摄像机(5)使其能够采集工件(3)表面整个熔池的图像,如熔池的图像不居中或无法采集完整熔池图像则调整具有LinLog感光技术CMOS摄像机(5)的位置;依据焊接速度和焊缝长度,适当调整曝光度并控制采集时间和帧数,并记录采集频率; (2) Adjust the CMOS camera with LinLog photosensitive technology (5) so that it can collect the image of the entire molten pool on the surface of the workpiece (3). If the image of the molten pool is not centered or the complete molten pool image cannot be collected, adjust the CMOS camera with LinLog photosensitive technology (5) position; according to the welding speed and weld length, properly adjust the exposure and control the acquisition time and frame number, and record the acquisition frequency;

(3)激光焊接过程中观察熔池体动态变化,实时分析熔池和孔口大小、形状、亮度及下塌缺陷的变化; (3) Observe the dynamic changes of the molten pool body during laser welding, and analyze the changes in the size, shape, brightness and slump defects of the molten pool and orifice in real time;

(4)将采集到的熔池图像导入另一台装有Labview图像处理平台的计算机,对孔口进行边缘提出和面积计算,分析等孔口面积与间隙量的对应关系;利用Photoshop软件对熔池的宽度和长度进行测定,分析其与间隙量的对应关系; (4) Import the collected melt pool image into another computer equipped with the Labview image processing platform, carry out edge extraction and area calculation of the orifice, and analyze the corresponding relationship between the orifice area and the gap; use Photoshop software to Measure the width and length of the pool, and analyze the corresponding relationship with the gap;

(5)根据上述孔口面积与间隙量的对应关系和熔池的宽度和长度与间隙量的对应关系,通过对焊接过程中熔池图像的实时观察和孔口面积和熔池宽度、长度和面积的计算实时检测焊接过程中的间隙量。 (5) According to the corresponding relationship between the above-mentioned orifice area and the gap amount and the corresponding relationship between the width and length of the molten pool and the gap amount, through the real-time observation of the molten pool image during the welding process and the orifice area and the molten pool width, length and The calculation of the area detects the amount of gap in the welding process in real time.

本发明同时提供一种基于熔池图像视觉传感的激光焊T型搭接接头间隙的视觉传感系统,包含具有LinLog感光技术CMOS摄像机、滤光系统、辅助光源、图像采集卡、计算机、显示器,所述滤光系统与所述摄像机同轴相连;图像采集卡置于计算机的卡槽内并通过视频线与LinLog感光技术CMOS摄像机相连,LinLog感光技术CMOS摄像机采集的焊接图像信号经图像采集卡送入计算机;显示器与计算机相接,实时显示采集到的焊接区域图像。 The present invention also provides a visual sensing system for laser welding T-shaped lap joint gaps based on molten pool image visual sensing, including a CMOS camera with LinLog photosensitive technology, a filter system, an auxiliary light source, an image acquisition card, a computer, and a display , the filter system is coaxially connected with the camera; the image acquisition card is placed in the card slot of the computer and connected with the LinLog photosensitive technology CMOS camera through the video line, and the welding image signal collected by the LinLog photosensitive technology CMOS camera is passed through the image acquisition card Send it to the computer; the monitor is connected to the computer to display the collected images of the welding area in real time.

利用此视觉传感系统进行焊接过程间隙监控可具有三种工作模式:工作模式一是实现激光焊T型搭接接头熔池图像监控功能,工作模式二是实现孔口和熔池边缘和面积提取功能,工作模式三是实现熔池和孔口图像监测与边缘和面积提取的双重功能;对于工作模式一,计算机为一台计算机;对于工作模式二,计算机为一台计算机及Labview图像处理平台;对于工作模式三,计算机是由主计算机图像采集和从计算机图像处理构成的双机系统,主计算机采集焊接区域图像信息并送显示器实时显示,从计算机进行图像处理和计算,及时反馈给主计算机进行图像对比分析,找出熔池和孔口图像变化与间隙量的对应关系。本发明上述的基于熔池图像视觉传感的激光焊T型搭接接头间隙的检测方法主要用到了该视觉传感系统的工作模式三。 Using this visual sensing system to monitor the welding process gap can have three working modes: the first working mode is to realize the laser welding T-shaped lap joint molten pool image monitoring function, and the second working mode is to realize the edge and area extraction of the orifice and the molten pool Function, working mode three is to realize the dual functions of melt pool and orifice image monitoring and edge and area extraction; for working mode one, the computer is a computer; for working mode two, the computer is a computer and Labview image processing platform; For working mode 3, the computer is a dual-computer system composed of the image acquisition of the main computer and the image processing of the slave computer. The main computer collects the image information of the welding area and sends it to the monitor for real-time display. Image comparative analysis, to find out the corresponding relationship between the change of molten pool and orifice image and the amount of gap. The above-mentioned method for detecting the gap of the laser welded T-shaped lap joint based on the visual sensing of the molten pool image of the present invention mainly uses the third working mode of the visual sensing system.

与现有技术相比,本发明的有益效果如下: Compared with the prior art, the beneficial effects of the present invention are as follows:

第一.本发明建立了检测激光搭接焊间隙的监控和检测方法,提出了熔池动态变化与间隙量对应的量化性表征方法,并进行了多次试验验证,检测精度完全能够达到焊缝跟踪的要求; First. The invention establishes a monitoring and detection method for detecting laser lap welding gaps, proposes a quantitative characterization method corresponding to the dynamic change of molten pool and the gap amount, and has carried out multiple experiments to verify that the detection accuracy can fully meet the requirements of weld seam tracking ;

第二.本发明采用具有LinLog感光技术CMOS摄像机实时监测激光搭接焊T型接头过程熔池和孔口的动态变化,获取不同间隙量下熔池和孔口的大小、形状和波动信息;采用Labview的图像处理平台和Photoshop软件对熔池图像进行后续处理,定量分析间隙与熔池大小和孔口面积的对应关系,为实时监测提供依据;经采用本发明的检测系统和方法进行现场焊接和监测,间隙量跟踪效果达到了预期的目标,能够准确判别间隙的存在,并能定量分析间隙的大小,精度能达到0.1mm,提高了激光焊T型搭接接头的焊接质量和焊接效率; second. The present invention adopts the CMOS camera with LinLog photosensitive technology to monitor the dynamic changes of the molten pool and the orifice in the laser lap welding T-joint process in real time, and obtains the size, shape and fluctuation information of the molten pool and the orifice under different gaps; the image of Labview is used The processing platform and Photoshop software carry out follow-up processing on the molten pool image, quantitatively analyze the corresponding relationship between the gap and the size of the molten pool and the area of the orifice, and provide a basis for real-time monitoring; through on-site welding and monitoring using the detection system and method of the present invention, the gap The volume tracking effect has reached the expected goal, can accurately determine the existence of the gap, and can quantitatively analyze the size of the gap, the accuracy can reach 0.1mm, which improves the welding quality and welding efficiency of laser welding T-shaped lap joints;

第三.本检测系统和方法采用的CMOS摄像机体积小、功耗低、响应速度快、动态范围广,并配用滤光系统,采集到的焊接区域熔池图像质量高且边缘易于提取,实时监控效果好,工程实用性强。 third. The CMOS camera used in the detection system and method is small in size, low in power consumption, fast in response, and wide in dynamic range, and is equipped with a filter system. The image quality of the molten pool in the welding area collected is high and the edges are easy to extract, and the real-time monitoring effect is good. , Strong engineering practicability.

当然,实施本发明的任一产品并不一定需要同时达到以上所述的所有优点。 Of course, any product implementing the present invention does not necessarily need to achieve all the above-mentioned advantages at the same time.

附图说明 Description of drawings

图1为本发明实施例1和实施例2的T型搭接接头激光焊接视觉传感系统示意图; Fig. 1 is the schematic diagram of the visual sensing system for laser welding of T-shaped lap joints in Embodiment 1 and Embodiment 2 of the present invention;

图2为本发明实施例1和实施例2的光学成像结构示意图; Figure 2 is a schematic diagram of the optical imaging structure of Embodiment 1 and Embodiment 2 of the present invention;

图3为本发明实施例1不同间隙量下激光焊接T型搭接接头熔池和孔口图像实时监控效果实例图; Fig. 3 is an example diagram of the real-time monitoring effect of laser welding T-shaped lap joint molten pool and orifice images under different gaps in Example 1 of the present invention;

图4为本发明实施例1不同间隙量下激光焊接T型搭接接头熔池完整图像实时监控效果实例图; Fig. 4 is an example diagram of the real-time monitoring effect of the complete image of the laser welded T-shaped lap joint molten pool under different gaps in Example 1 of the present invention;

图5为本发明实施例1熔池长度和宽度测量方法示意图; Fig. 5 is a schematic diagram of the method for measuring the length and width of the molten pool in Embodiment 1 of the present invention;

图6为本发明实施例1无间隙和存在间隙情况下的T型搭接接头照片; Fig. 6 is the photograph of the T-shaped lap joint under the condition of no gap and the presence of gap in Embodiment 1 of the present invention;

图7为本发明实施例1提取熔池和孔口特征参数流程图; Fig. 7 is a flow chart of extracting molten pool and orifice characteristic parameters in Embodiment 1 of the present invention;

图8为本发明实施例1熔池和孔口图像处理示例; Fig. 8 is an example of image processing of molten pool and orifice in Embodiment 1 of the present invention;

图9为本发明实施例1熔池和孔口图像轮廓提取前和提取后示意图; Fig. 9 is a schematic diagram before and after extraction of molten pool and orifice image contours in Embodiment 1 of the present invention;

图10为本发明实施例1熔池的长度和宽度随间隙量的变化; Fig. 10 is the change of the length and the width of the molten pool with the amount of the gap in Example 1 of the present invention;

图11为本发明实施例1不同间隙量下的熔池面积的变化曲线; Fig. 11 is the variation curve of the molten pool area under different gap amounts in Example 1 of the present invention;

图12为本发明实施例1孔口平均面积与间隙量的对应关系; Fig. 12 is the corresponding relationship between the average area of the orifice and the gap amount in Example 1 of the present invention;

图13为本发明实施例2间隙量实际检测过程的熔池图像。 Fig. 13 is an image of the molten pool during the actual detection process of the gap amount in Embodiment 2 of the present invention.

具体实施方式 Detailed ways

本发明适用于激光搭接非穿透焊间隙的检测。在实际生产中进行间隙量检测之前,需要先测试一组或几组有确切间隙量数值的样品确定间隙与熔池参数之间的对应关系,然后根据这些对应关系图,再对间隙量未知的样品进行焊接间隙的实时监测。下面结合附图,对本发明的实施方式和实施过程做详细说明。 The invention is applicable to the detection of laser lap joint non-penetrating welding gaps. Before carrying out gap detection in actual production, it is necessary to test one or several groups of samples with exact gap values to determine the corresponding relationship between the gap and the molten pool parameters, and then according to these corresponding relationship diagrams, the gap value is unknown. The samples were subjected to real-time monitoring of the welding gap. Below in conjunction with the accompanying drawings, the embodiment and implementation process of the present invention will be described in detail.

实施例1    间隙量与熔池参数之间关系的检测 Embodiment 1 The detection of the relationship between the gap amount and the molten pool parameters

本实施例和实施例2的基于熔池图像视觉传感的激光焊T型搭接接头间隙的检测方法采用如图1和图2所示的视觉传感系统,该系统包括:具有LinLog感光技术CMOS摄像机(5)、滤光系统(11)、图像采集卡(6)、计算机(7)、显示器(8),其中,计算机(7)是由主计算机图像采集和装有Labview图像处理平台的从计算机图像处理构成的双机系统,主计算机采集焊接区域图像信息并送显示器(8)实时显示,从计算机进行图像处理和计算,并及时反馈给主计算机进行图像对比分析,找出熔池和孔口图像变化与间隙量的对应关系。 The detection method of the laser welded T-shaped lap joint gap based on molten pool image visual sensing in this embodiment and embodiment 2 adopts the visual sensing system as shown in Figure 1 and Figure 2, and the system includes: LinLog photosensitive technology CMOS camera (5), filter system (11), image acquisition card (6), computer (7), display (8), wherein, computer (7) is a slave computer equipped with a Labview image processing platform for image acquisition by the main computer A dual-machine system composed of computer image processing, the main computer collects the image information of the welding area and sends it to the monitor (8) for real-time display, the computer performs image processing and calculation, and feeds back to the main computer for image comparison and analysis in time to find out the molten pool and holes The corresponding relationship between the mouth image change and the gap amount.

上述视觉传感系统使用时,工件(3)放置在工作台上,随工作台一起移动,激光头(1)固定不动,摄像机(5)固定后放置在工作台侧面并与工件(3)底面呈750的夹角,调整辅助光源(9)位于激光头(1)的前方300mm并与工件(3)表面呈30°;调整摄像头位置、图像大小和焦距,以采集焊接过程熔池和孔口动态图像,焊前,设置CMOS摄像机(5),调整镜头焦距和角度,使工件上部激光焦点位置图像清晰地显示在显示器(8)上,采集的焊接图像信号经图像采集卡(6)送入计算机(7),经显示器(8)显示;依据焊接速度和焊缝长度,适当调整曝光度并控制采集时间和帧数,并记录采集频率;其中,CMOS摄像机(5)变焦范围为18-45mm、光圈值为5.6-32、曝光度为1-10ms;如图2所示,滤光系统(11)与摄像机(5)同轴相连,该滤光系统(11)包括窄带滤光片(13)、中性减光片(12)、防护玻璃(14)(即UV镜),窄带滤光片(13)的中心波长为808nm,中性减光片(12)的透过率为25%,防护玻璃用于防飞溅,利用辅助光源(9)和熔池(10)自身辐射光作为光源,通过滤光系统(11)能有效地消除弧光、烟尘、飞溅等干扰,并用中性减光片调节光强,以便能采集到清晰的焊接区域图像,包括光圈(15)、变焦镜头(16)、中性减光片(12)、窄带滤光片(13)和UV片(14)(即防护玻璃)的光学成像系统与摄像机(5)同轴相连;图像采集卡(6)置于计算机(7)的卡槽内并通过视频线与摄像机(5)相连,将摄像机(5)采集的焊接图像信号经图像采集卡(6)送入计算机(7);显示器(8)与计算机(7)相接,实时显示采集到的焊接区域图像。 When the above-mentioned visual sensing system is in use, the workpiece (3) is placed on the workbench and moves with the workbench, the laser head (1) is fixed, and the camera (5) is fixed and placed on the side of the workbench and aligned with the workpiece (3) The bottom surface is at an included angle of 75 ° , and the auxiliary light source (9) is adjusted to be 300mm in front of the laser head (1) and at 30 ° to the surface of the workpiece (3); adjust the camera position, image size and focal length to collect the weld pool and The dynamic image of the orifice, before welding, set the CMOS camera (5), adjust the focal length and angle of the lens, so that the image of the laser focus position on the upper part of the workpiece is clearly displayed on the monitor (8), and the collected welding image signals are passed through the image acquisition card (6) Send it to the computer (7) and display it on the monitor (8); according to the welding speed and weld length, adjust the exposure appropriately and control the acquisition time and frame number, and record the acquisition frequency; among them, the zoom range of the CMOS camera (5) is 18 -45mm, the aperture value is 5.6-32, and the exposure is 1-10ms; as shown in Figure 2, the filter system (11) is coaxially connected with the camera (5), and the filter system (11) includes a narrow-band filter (13), neutral light reduction film (12), protective glass (14) (i.e. UV mirror), the central wavelength of the narrow band filter (13) is 808nm, and the transmittance of the neutral light reduction film (12) is 25%, the protective glass is used for anti-splash, using the auxiliary light source (9) and the radiated light of the molten pool (10) as the light source, the filter system (11) can effectively eliminate interference such as arc light, smoke, and splash, and use neutral The light reduction film adjusts the light intensity so that a clear image of the welding area can be collected, including an aperture (15), a zoom lens (16), a neutral light reduction film (12), a narrow-band filter (13) and a UV film (14 ) (that is, the protective glass) optical imaging system is coaxially connected with the camera (5); the image acquisition card (6) is placed in the card slot of the computer (7) and connected with the camera (5) through a video cable, and the camera (5) ) and the welding image signal collected by the image acquisition card (6) is sent to the computer (7); the monitor (8) is connected to the computer (7) to display the collected welding area image in real time.

采用上述视觉图像传感系统和方法进行激光焊T型搭接接头熔池图像采集,试验条件如下: The above-mentioned visual image sensing system and method are used to collect images of the molten pool of laser welded T-shaped lap joints. The test conditions are as follows:

焊接方法:高功率CO2激光焊; Welding method: high power CO2 laser welding;

试验材料:低合金高强钢; Test material: low-alloy high-strength steel;

激光焊接设备型号为德国TRUMPF公司生产的TLF15000 turbo CO2快速轴流型激光器,最大输出功率为15 kW,焦距357 mm,光斑半径为0.43 mm,连续输出; The laser welding equipment model is TLF15000 turbo CO 2 fast axial-flow laser produced by TRUMPF in Germany, with a maximum output power of 15 kW, a focal length of 357 mm, a spot radius of 0.43 mm, and continuous output;

高速摄像机采用瑞士Photonfocus公司的MV-D1024-TrackCam,最高采样频率10000 fps; The high-speed camera adopts the MV-D1024-TrackCam of Swiss Photonfocus Company, with a maximum sampling frequency of 10000 fps;

图像采集卡:VIEDEO-PCI-XR;减光片参数:减光度25%; Image acquisition card: VIEDEO-PCI-XR; light reduction film parameters: light reduction 25%;

通过调整高速摄像机及其辅助元器件的相关参数拍摄等离子体图像,优化拍摄效果。 The plasma image is captured by adjusting the relevant parameters of the high-speed camera and its auxiliary components to optimize the shooting effect.

采用4mm厚低合金高强钢进行焊接试验,选取的焊接工艺参数为: 激光功率P = 8kW,扫描速度v = 1.5m/min,离焦量 -2,焊接过程中保护气体采用纯He,流量为30L/min。 4mm thick low-alloy high-strength steel was used for welding experiments, and the selected welding process parameters were: laser power P = 8kW, scanning speed v = 1.5m/min, defocus -2, the shielding gas used in the welding process was pure He, and the flow rate was 30L/min.

激光焊接过程中观察熔池体动态变化,实时分析熔池和孔口大小、形状、亮度及下塌缺陷的变化;将采集到的熔池图像导入另一台装有Labview图像处理平台的计算机,对孔口进行边缘提出和面积计算,边缘提出具体为:先采用中值法平滑滤波,再进行灰度分析和阈值分割,最后利用将高斯滤波和拉普拉斯边缘检测算法结合在一起的Log边缘算子对阈值化后的图像进行平滑和积分处理滤除干扰信息,提取边缘线;分析孔口面积与间隙量的对应关系;用Photoshop软件对熔池的宽度和长度进行测定,分析其与间隙量的对应关系。计算熔池和孔口的面积的方法为:通过高速摄影获取到原始熔池图像后,对该熔池图像进行预处理,提高该熔池图像的信噪比;然后对图像进行二值化处理,得到光路方向上和整个熔池和孔口的像素点的个数,获得熔池和孔口面积。 During the laser welding process, observe the dynamic changes of the molten pool body, and analyze the changes in the size, shape, brightness and slump defects of the molten pool and orifice in real time; import the collected molten pool images into another computer equipped with the Labview image processing platform, Edge extraction and area calculation are carried out on the orifice. The edge extraction is specifically: first use the median method for smoothing and filtering, then perform grayscale analysis and threshold segmentation, and finally use the Log The edge operator performs smoothing and integral processing on the thresholded image to filter out the interference information and extract the edge line; analyze the corresponding relationship between the area of the orifice and the amount of the gap; use Photoshop software to measure the width and length of the molten pool, and analyze its relationship with Corresponding relation of clearance amount. The method of calculating the area of the molten pool and the orifice is: after the original molten pool image is obtained by high-speed photography, the molten pool image is preprocessed to improve the signal-to-noise ratio of the molten pool image; and then the image is binarized , get the number of pixels in the optical path direction and the entire melt pool and orifice, and obtain the area of the melt pool and orifice.

图3为基于上述视觉传感系统监测到的激光搭接焊T型接头不同间隙量下熔池的动态图像,图4为不同间隙量下激光焊接T型搭接接头熔池完整图像实时监控效果实例图,图5 熔池长度和宽度测量方法示意图。从图3、图4和图5可看到不同时刻的熔池和孔口(熔池前端白色区域)具有波动性和一定的周期性。当无间隙(间隙为0mm)时,熔池表面熔化金属呈波浪形态,孔口随其波动,无下塌现象;当存在间隙时,且随着间隙量的增加,熔池逐渐变小,下塌越来越严重,孔口明暗交替变换,逐渐发生倾斜。 Figure 3 is the dynamic image of the molten pool under different gaps of the laser lap welded T-joint monitored by the above-mentioned visual sensing system, and Figure 4 is the real-time monitoring effect of the complete image of the molten pool of the laser welded T-shaped lap joint under different gaps Example diagram, Fig. 5 Schematic diagram of the method for measuring the length and width of the molten pool. From Figure 3, Figure 4 and Figure 5, it can be seen that the molten pool and the orifice (the white area at the front of the molten pool) at different times have fluctuations and certain periodicity. When there is no gap (the gap is 0mm), the molten metal on the surface of the molten pool is in a wave shape, and the orifice fluctuates with it, and there is no sinking phenomenon; when there is a gap, and with the increase of the gap, the molten pool gradually becomes smaller and lower. The collapse became more and more serious, the light and dark of the orifice alternated, and gradually tilted.

图6为无间隙和存在间隙情况下的T型搭接接头照片,从图6中T型搭接接头形貌可见间隙对焊缝成型影响较大,间隙较大时下塌严重。 Figure 6 is a photo of the T-shaped lap joint with no gap and with a gap. From the appearance of the T-shaped lap joint in Figure 6, it can be seen that the gap has a great influence on the weld shape, and the collapse is serious when the gap is large.

采用基于Labview的图像处理平台技术进行图像处理,熔池和孔口处理流程示意图如图7所示,处理示例如图8所示。采用基于Labview的图像处理平台从拍摄的熔池图像中提取熔池和孔口的边缘和面积,具体包括:通过高速摄影获取原始图像后,对图像进行预处理,提高信噪比,然后对图片进行二值化处理,得到光路方向上和整个熔池或孔口的像素点的个数,计算得到面积。图9为熔池和孔口图像提取前和提取后对比,可知,通过图像处理能较好的提取孔口和熔池边缘,外界干扰因素基本滤除,所得图像能够最大程度的反应熔池和孔口的可视面积。 The image processing platform technology based on Labview is used for image processing. The schematic diagram of the melt pool and orifice processing flow is shown in Figure 7, and the processing example is shown in Figure 8. The image processing platform based on Labview is used to extract the edge and area of the molten pool and the orifice from the captured molten pool image, specifically including: after the original image is obtained by high-speed photography, the image is preprocessed to improve the signal-to-noise ratio, and then the image is processed Perform binarization processing to obtain the number of pixels in the direction of the optical path and the entire molten pool or orifice, and calculate the area. Figure 9 is a comparison of the images of the molten pool and the orifice before and after extraction. It can be seen that the edge of the orifice and the molten pool can be better extracted through image processing, and the external interference factors are basically filtered out. The obtained image can reflect the molten pool and the to the greatest extent. The viewing area of the orifice.

图10示出熔池的长度和宽度随间隙量的变化。可见,随间隙量的增加,熔池的长度逐渐减小,而宽度变化不大。当间隙为0mm、0.2mm、0.4mm、0.6mm、0.8mm时,对应的熔池长度分别为12.4mm、9.8mm、9.6mm、8.5mm、8mm、7.5mm。 Figure 10 shows the variation of the length and width of the molten pool with the amount of gap. It can be seen that with the increase of the gap, the length of the molten pool gradually decreases, while the width does not change much. When the gaps are 0mm, 0.2mm, 0.4mm, 0.6mm, and 0.8mm, the corresponding molten pool lengths are 12.4mm, 9.8mm, 9.6mm, 8.5mm, 8mm, and 7.5mm, respectively.

图11为不同间隙量下的熔池面积变化曲线。可见,随间隙量的增加,熔池面积逐渐减小,当间隙大于0.2mm时,熔池面积突然减小。当间隙为0mm、0.2mm、0.4mm、0.6mm、0.8mm时,对应的熔池面积分别为50525、43439、29928、25872、23465、22642(Pixel)。 Figure 11 is the change curve of molten pool area under different gaps. It can be seen that with the increase of the gap, the area of the molten pool gradually decreases, and when the gap is greater than 0.2mm, the area of the molten pool decreases suddenly. When the gap is 0mm, 0.2mm, 0.4mm, 0.6mm, 0.8mm, the corresponding melt pool area is 50525, 43439, 29928, 25872, 23465, 22642 (Pixel).

图12示出孔口平均面积与间隙量的对应关系。可见随间隙量增加,孔口的平均面积逐渐减小,基本呈线性变化。当间隙为0mm、0.2mm、0.4mm、0.6mm、0.8mm、1.0mm时,对应的孔口的平均面积大小分别为2859、2521、2053、1962、1824、1334(单位pixel)。 Figure 12 shows the correspondence between the average area of the orifice and the amount of gap. It can be seen that with the increase of the gap, the average area of the orifice gradually decreases, and basically changes linearly. When the gaps are 0mm, 0.2mm, 0.4mm, 0.6mm, 0.8mm, and 1.0mm, the average area sizes of the corresponding orifices are 2859, 2521, 2053, 1962, 1824, and 1334 (unit pixel).

实施例2     激光焊T型搭接接头间隙量的实际检测 Example 2 The actual detection of the gap amount of the laser welded T-shaped lap joint

采用实施例1的检测系统和方法,并利用其得到的激光焊T型搭接接头间隙与熔池参数之间的关系,通过对焊接过程中熔池图像的实时观察和孔口面积和熔池宽度、长度和面积的计算,对以下两组激光焊T型搭接接头间隙量进行间隙检测,检测结果如图13所示。 Adopt the detection system and method of embodiment 1, and utilize the relation between the laser welded T-type lap joint gap and molten pool parameter that it obtains, through to the real-time observation of molten pool image in welding process and orifice area and molten pool For the calculation of width, length and area, gap testing is performed on the following two sets of laser welded T-shaped lap joints. The testing results are shown in Figure 13.

第一组a的监测结果如下: 熔池长度为9.6mm,熔池面积为44323 Pixel,孔口面积为2665。则通过以上数据和熔池和孔口动态特征综合分析可知此次焊接过程间隙量约为0.2mm。从图13所对应的焊接接头的横截面可知,间隙量为0.21mm,与所测的间隙量相差0.01mm。 The monitoring results of the first group a are as follows: the length of the molten pool is 9.6mm, the area of the molten pool is 44323 Pixel, and the area of the orifice is 2665. Through the comprehensive analysis of the above data and the dynamic characteristics of the molten pool and the orifice, it can be known that the gap in the welding process is about 0.2mm. It can be seen from the cross-section of the welded joint corresponding to Figure 13 that the gap is 0.21 mm, which is 0.01 mm different from the measured gap.

第二组b的监测结果如下: 熔池长度为7.8mm,熔池面积为22053 Pixel,孔口面积为2063。则通过以上数据和熔池和孔口动态特征综合分析可知此次焊接过程间隙量约为0.26mm。从图13所对应的焊接接头的横截面可知,间隙量为0.23mm,与所测的间隙量相差0.03mm。 The monitoring results of the second group b are as follows: the length of the molten pool is 7.8mm, the area of the molten pool is 22053 Pixel, and the orifice area is 2063. Through the comprehensive analysis of the above data and the dynamic characteristics of the molten pool and the orifice, it can be known that the gap in the welding process is about 0.26mm. It can be seen from the cross-section of the welded joint corresponding to Figure 13 that the gap is 0.23 mm, which is 0.03 mm different from the measured gap.

可见,采用上述检测方法及检测系统,可以获得焊接过程中清晰的熔池和孔口动态图像,通过观察和计算熔池和孔口面积及其波动情况,可以快速准确的判断焊接过程间隙的产生及其大小,为后续焊接质量的分析和检测提供判据。 It can be seen that by using the above detection method and detection system, a clear dynamic image of the molten pool and the orifice during the welding process can be obtained. By observing and calculating the area of the molten pool and the orifice and their fluctuations, the generation of the gap in the welding process can be quickly and accurately judged. And its size provides a criterion for the analysis and detection of subsequent welding quality.

以上公开的本发明优选实施例只是用于帮助阐述本发明。优选实施例并没有详尽叙述所有的细节,也不限制该发明仅为所述的具体实施方式。显然,根据本说明书的内容,可作很多的修改和变化。本说明书选取并具体描述这些实施例,是为了更好地解释本发明的原理和实际应用,从而使所属技术领域技术人员能很好地理解和利用本发明。本发明仅受权利要求书及其全部范围和等效物的限制。 The preferred embodiments of the invention disclosed above are only to help illustrate the invention. The preferred embodiments are not exhaustive in all detail, nor are the inventions limited to specific embodiments described. Obviously, many modifications and variations can be made based on the contents of this specification. This description selects and specifically describes these embodiments in order to better explain the principle and practical application of the present invention, so that those skilled in the art can well understand and utilize the present invention. The invention is to be limited only by the claims, along with their full scope and equivalents.

Claims (4)

1.一种基于熔池图像视觉传感的激光焊T型搭接接头间隙的检测方法,其特征在于,包括如下步骤: 1. a detection method based on the laser welding T-type lap joint gap of molten pool image visual sensing, is characterized in that, comprises the steps: (1)将工件(3)放置在工作台上,随工作台一起移动,激光头(1)固定不动;采用包含具有LinLog感光技术的CMOS摄像机(5)、滤光系统(11)、辅助光源(9)、图像采集卡(6)、计算机(7)、显示器(8)的视觉传感系统,焊接图像信号经图像采集卡(6)送入计算机(7),经显示器(8)显示;将摄像机(5)放置在工作台侧面500-1000mm并与工件(3)表面呈75-85°的夹角,调整辅助光源(9)使其位于激光头(1)的前方300-500mm并与工件(3)表面呈25-35°的夹角;调整具有LinLog感光技术的CMOS摄像机(5)的图像大小及焦距; (1) Place the workpiece (3) on the workbench and move with the workbench, while the laser head (1) is fixed; a CMOS camera (5) with LinLog photosensitive technology, filter system (11), auxiliary Light source (9), image acquisition card (6), computer (7), visual sensing system of display (8), welding image signal is sent to computer (7) through image acquisition card (6), and displayed on display (8) ;Place the camera (5) on the side of the table at 500-1000mm and form an angle of 75-85 ° with the surface of the workpiece (3), adjust the auxiliary light source (9) so that it is 300-500mm in front of the laser head (1) and Form an included angle of 25-35 ° with the surface of the workpiece (3); adjust the image size and focal length of the CMOS camera (5) with LinLog photosensitive technology; (2)调整具有LinLog感光技术的CMOS摄像机(5)使其能够采集工件(3)表面整个熔池的图像,当熔池的图像不居中或无法采集完整熔池图像时则调整具有LinLog感光技术CMOS摄像机(5)的位置;依据焊接速度和焊缝长度,适当调整曝光度并控制采集时间和帧数,并记录采集频率; (2) Adjust the CMOS camera (5) with LinLog photosensitive technology so that it can collect the image of the entire molten pool on the surface of the workpiece (3). When the image of the molten pool is not centered or the complete molten pool image cannot be collected, adjust the LinLog photosensitive technology The position of the CMOS camera (5); according to the welding speed and the length of the weld, properly adjust the exposure and control the acquisition time and frame number, and record the acquisition frequency; (3)激光焊接过程中观察熔池动态变化,实时分析熔池和孔口大小、形状、亮度及下塌缺陷的变化; (3) Observe the dynamic changes of the molten pool during the laser welding process, and analyze the changes in the size, shape, brightness and slump defects of the molten pool and orifice in real time; (4)将采集到的熔池图像导入另一台装有Labview图像处理平台的计算机,对孔口进行边缘提出和面积计算,分析孔口面积与间隙量的对应关系;利用Photoshop软件对熔池的宽度和长度进行测定,分析其与间隙量的对应关系; (4) Import the collected melt pool image into another computer equipped with the Labview image processing platform, carry out edge extraction and area calculation for the orifice, and analyze the corresponding relationship between the orifice area and the gap; use Photoshop software to analyze the melt pool Measure the width and length of the gap, and analyze its corresponding relationship with the gap; (5)根据上述孔口面积与间隙量的对应关系和熔池的宽度和长度与间隙量的对应关系,通过对焊接过程中熔池图像的实时观察和孔口面积和熔池宽度、长度和面积的计算实时监测焊接过程中的间隙量。 (5) According to the corresponding relationship between the above-mentioned orifice area and the gap amount and the corresponding relationship between the width and length of the molten pool and the gap amount, through the real-time observation of the molten pool image during the welding process and the orifice area and the molten pool width, length and The calculation of the area monitors the gap amount during the welding process in real time. 2.根据权利要求1所述的基于熔池图像视觉传感的激光焊T型搭接接头间隙的检测方法,其特征在于,所述步骤(4)中,对所述获取的熔池图像进行处理时,先采用中值法平滑滤波,再进行灰度分析和阈值分割,最后利用将高斯滤波和拉普拉斯边缘检测算法结合在一起的Log边缘算子对阈值化后的图像进行平滑和积分处理滤除干扰信息,提取边缘线。 2. The detection method for the gap of the laser welded T-shaped lap joint based on the visual sensing of the molten pool image according to claim 1, characterized in that, in the step (4), the acquired molten pool image is When processing, the median method is used to smooth filter first, then the gray level analysis and threshold segmentation are performed, and finally the Log edge operator combining Gaussian filter and Laplacian edge detection algorithm is used to smooth and integrate the thresholded image. Integral processing filters out interference information and extracts edge lines. 3.根据权利要求1所述的基于熔池图像视觉传感的激光焊T型搭接接头间隙的检测方法,其特征在于,所述步骤(4)和步骤(5)中,计算熔池和孔口的面积的方法为:通过高速摄影获取到原始熔池图像后,对该熔池图像进行预处理,提高该熔池图像的信噪比;然后对图像进行二值化处理,得到光路方向上和整个熔池和孔口的像素点的个数,获得熔池和孔口面积。 3. The method for detecting gaps of laser welded T-shaped lap joints based on molten pool image visual sensing according to claim 1, characterized in that, in the steps (4) and (5), the calculated molten pool and The method of the area of the orifice is: after obtaining the original molten pool image through high-speed photography, preprocessing the molten pool image to improve the signal-to-noise ratio of the molten pool image; and then binarizing the image to obtain the optical path direction Sum the number of pixels of the entire melt pool and orifice to obtain the area of the melt pool and orifice. 4.根据权利要求1所述的基于熔池图像视觉传感的激光焊T型搭接接头间隙的检测方法,其特征在于,所述具有LinLog感光技术CMOS摄像机(5)的变焦范围为18-45mm、光圈值为5.6-32,曝光值为4-10ms,帧频为800fps;所述滤光系统(11)与所述摄像机(5)同轴相连;所述滤光系统(11)包括一块波长为808nm的滤光片(13),两块透过率为25%的中性减光片(12)和一防护玻璃(14);所用的辅助光源(9)为功率为2W,波长为 808 nm的半导体激光器。 4. The method for detecting gaps in laser welded T-shaped lap joints based on molten pool image visual sensing according to claim 1, characterized in that the zoom range of the CMOS camera (5) with LinLog photosensitive technology is 18- 45mm, aperture value 5.6-32, exposure value 4-10ms, frame rate 800fps; the filter system (11) is coaxially connected with the camera (5); the filter system (11) includes a A filter (13) with a wavelength of 808nm, two neutral light-reducing filters (12) with a transmittance of 25% and a protective glass (14); the auxiliary light source (9) used is a power of 2W and a wavelength of 808 nm semiconductor laser.
CN201310413452.8A 2013-09-11 2013-09-11 Laser lap welding gap detection system and method based on molten pool image vision sensing Active CN103506756B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310413452.8A CN103506756B (en) 2013-09-11 2013-09-11 Laser lap welding gap detection system and method based on molten pool image vision sensing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310413452.8A CN103506756B (en) 2013-09-11 2013-09-11 Laser lap welding gap detection system and method based on molten pool image vision sensing

Publications (2)

Publication Number Publication Date
CN103506756A CN103506756A (en) 2014-01-15
CN103506756B true CN103506756B (en) 2015-07-08

Family

ID=49890469

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310413452.8A Active CN103506756B (en) 2013-09-11 2013-09-11 Laser lap welding gap detection system and method based on molten pool image vision sensing

Country Status (1)

Country Link
CN (1) CN103506756B (en)

Families Citing this family (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103878479B (en) * 2014-03-06 2016-02-10 上海交通大学 The online test method in the T-shaped lap joint gap of the Laser Welding based on spectrum analysis
CN103909348B (en) * 2014-03-19 2015-11-25 上海交通大学 A kind of ONLINE RECOGNITION incident laser departs from the method for state
CN104002044B (en) * 2014-06-03 2015-10-28 湖南大学 A kind of non-penetration laser welding equipment carries out the method for welding
CN104942439B (en) * 2015-03-26 2017-04-19 上海工程技术大学 907A high-strength steel T-shaped joint laser welding and machining method
CN106141426A (en) * 2015-04-28 2016-11-23 大族激光科技产业集团股份有限公司 A kind of optical imaging system followed the trail of for laser welded seam
CN104889536A (en) * 2015-05-15 2015-09-09 无锡阳工机械制造有限公司 Argon arc welding based intelligent welding method with safety protection
CN105033478A (en) * 2015-05-15 2015-11-11 无锡阳工机械制造有限公司 Welding method
CN104889547A (en) * 2015-05-15 2015-09-09 无锡阳工机械制造有限公司 Argon arc welding based welding method
CN104889548A (en) * 2015-05-15 2015-09-09 无锡阳工机械制造有限公司 Argon arc welding based welding process
CN104889535A (en) * 2015-05-15 2015-09-09 无锡阳工机械制造有限公司 Argon arc welding based intelligent welding process
CN104977305A (en) * 2015-06-29 2015-10-14 华中科技大学 Welding quality analysis device based on infrared vision and analysis method thereof
CN107105564B (en) * 2015-10-14 2019-03-26 天津大学 Laser welding small hole plasma electric properties detection method
CN105458490A (en) * 2015-12-30 2016-04-06 哈尔滨工业大学 Real-time monitoring system and monitoring method for judging welding type of laser deep penetration welding by using high-speed camera
CN106296648B (en) * 2016-07-21 2019-02-05 中国科学院力学研究所 Method for evaluating the relationship between plasma and final modification effect during laser modification
CN108406117A (en) * 2016-08-25 2018-08-17 长沙拓扑陆川新材料科技有限公司 A kind of welding control system of AZ systems magnesium alloy welding material
CN107962278A (en) * 2016-10-19 2018-04-27 南京理工大学 A kind of arc welding weld crater image harvester based on saturating infrared fileter
CN106513937B (en) * 2016-12-27 2019-02-19 广东省智能制造研究所 A Stable and Precise Vision Weld Seam Tracking Method
CN106735897B (en) * 2016-12-28 2018-06-29 西南交通大学 Simulation slab narrow gap laser filling wire welding and the device and method monitored in real time
CN106825953B (en) * 2017-01-22 2018-09-04 大连理工大学 A real-time control system and control method for laser-arc hybrid welding
CN106825914B (en) * 2017-03-13 2019-08-02 湘潭大学 An integrated laser welding torch with seam tracking function
CN108941939B (en) * 2017-07-12 2020-04-07 温州大学激光与光电智能制造研究院 Closed-loop laser processing quality control method based on molten pool splash detection
CN107688028B (en) * 2017-08-08 2020-07-14 大连理工大学 Laser additive manufacturing lap joint rate online monitoring method
CN107378281A (en) * 2017-08-23 2017-11-24 华中科技大学 A kind of laser weld pools and the monitoring method of keyhole internal dynamic behavioural characteristic
CN108152291B (en) * 2017-11-30 2020-02-28 清华大学 End seam welding unfused defect real-time detection method based on dynamic characteristics of molten pool
CN109175689B (en) * 2018-09-27 2024-02-23 同高先进制造科技(太仓)有限公司 Self-adaptive fillet welding system based on visual detection and working method
CN109909502B (en) * 2019-03-18 2021-04-27 中国科学院合肥物质科学研究院 Online monitoring method for laser additive manufacturing process based on multi-source heterogeneous data
JP6984988B1 (en) 2019-06-28 2021-12-22 清華大学Tsinghua University Weld bead forming control device and method
CN110193679B (en) * 2019-06-28 2020-05-15 清华大学 A welding seam forming control device and method based on frontal visual sensing of molten pool
DE102020205638A1 (en) * 2020-05-05 2021-11-11 Robert Bosch Gesellschaft mit beschränkter Haftung Monitoring device for a laser beam welding system, laser beam welding system and method for monitoring
CN112025090B (en) * 2020-07-22 2025-01-28 上海市激光技术研究所有限公司 An online detection method and detection device for laser deep penetration welding defects
CN112222620B (en) * 2020-09-29 2022-04-22 哈尔滨工业大学 Ultra-narrow gap laser wire filling welding pool image real-time monitoring device
CN112548321A (en) * 2020-12-04 2021-03-26 哈尔滨工业大学 Coaxial monitoring-based vacuum laser welding seam defect identification method
CN112894206A (en) * 2021-01-16 2021-06-04 佛山市广凡机器人有限公司 Intelligent control system of automatic welding robot
CN113343996B (en) * 2021-05-11 2022-10-11 武汉大学 A calculation method of plasma directional energy deposition area based on deep convolutional network
CN113567433A (en) * 2021-06-09 2021-10-29 中车青岛四方机车车辆股份有限公司 Method and device for detecting bonded joint
CN113478082B (en) * 2021-07-15 2022-05-20 南京航空航天大学 Flexible laser welding method and device for skin-stringer
CN113916175B (en) * 2021-08-27 2022-07-26 蓝箭航天空间科技股份有限公司 Rocket engine nozzle inner and outer wall gap measuring method
CN116408575B (en) * 2021-12-31 2024-06-04 广东美的白色家电技术创新中心有限公司 Method, device and system for locally scanning and eliminating workpiece reflection interference
CN114523203B (en) * 2022-03-13 2022-11-29 扬州沃盛车业制造有限公司 Intelligent laser welding method and system
CN114749799B (en) * 2022-06-14 2022-08-26 山东亚泰机械有限公司 Automatic composite welding device of monitoring
CN114952067B (en) * 2022-06-23 2023-08-11 中广核研究院有限公司 A welding quality detection method and system for underwater welding
CN115018816A (en) * 2022-06-29 2022-09-06 创想智控科技(深圳)有限公司 Image processing method, device and equipment for detecting width of molten pool in real time and storage medium
CN115365658B (en) * 2022-09-22 2024-06-21 武汉大学 Laser welding method and system suitable for dynamic spatiotemporal energy distribution of special-shaped joints
CN116021151A (en) * 2022-11-16 2023-04-28 广东工业大学 A method and system for detecting local sag defects in laser arc hybrid welding
CN115847833B (en) * 2023-03-02 2023-06-16 苏州富润泽激光科技有限公司 Plastic laser welding system based on machine vision
CN116673596A (en) * 2023-06-26 2023-09-01 西安中科原子精密制造科技有限公司 A real-time monitoring system for laser welding
CN116511652B (en) * 2023-06-30 2023-09-08 江苏永大化工设备有限公司 Gas shielded welding process parameter optimization system and method
CN117340459B (en) * 2023-12-04 2024-01-30 武汉纺织大学 A method and system for monitoring the entire process of ultra-high power laser welding

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5681490A (en) * 1995-09-18 1997-10-28 Chang; Dale U. Laser weld quality monitoring system
US6311099B1 (en) * 1997-04-18 2001-10-30 Daimlerchrysler Ag Apparatus for regulating welding parameters during laser beam welding
CN1448239A (en) * 2003-04-03 2003-10-15 上海交通大学 Arc-welding furnace hearth dynamic characteristic vision sensing method
CN101214574A (en) * 2007-12-27 2008-07-09 天津工业大学 A self-adaptive vision sensor system for arc welding molten pool image
CN101349551A (en) * 2007-07-20 2009-01-21 通用电气公司 Profile measurement device and method of operation
CN102519387A (en) * 2011-10-27 2012-06-27 哈尔滨工业大学 Visual inspection method of electron beam welding pool shape parameter
CN102780845A (en) * 2012-06-14 2012-11-14 清华大学 Light source alternate strobe synchronous camera shooting method and vision detection system
CN102814574A (en) * 2012-09-06 2012-12-12 江苏科技大学 Narrow gap welding monitoring and welding line deviation detecting method based on infrared vision sensing

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000210781A (en) * 1999-01-20 2000-08-02 Nissan Motor Co Ltd Laser welding method and apparatus
JP5263051B2 (en) * 2009-07-21 2013-08-14 Jfeスチール株式会社 Laser irradiation point detection device and seam position detection device in laser welding machine

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5681490A (en) * 1995-09-18 1997-10-28 Chang; Dale U. Laser weld quality monitoring system
US6311099B1 (en) * 1997-04-18 2001-10-30 Daimlerchrysler Ag Apparatus for regulating welding parameters during laser beam welding
CN1448239A (en) * 2003-04-03 2003-10-15 上海交通大学 Arc-welding furnace hearth dynamic characteristic vision sensing method
CN101349551A (en) * 2007-07-20 2009-01-21 通用电气公司 Profile measurement device and method of operation
CN101214574A (en) * 2007-12-27 2008-07-09 天津工业大学 A self-adaptive vision sensor system for arc welding molten pool image
CN102519387A (en) * 2011-10-27 2012-06-27 哈尔滨工业大学 Visual inspection method of electron beam welding pool shape parameter
CN102780845A (en) * 2012-06-14 2012-11-14 清华大学 Light source alternate strobe synchronous camera shooting method and vision detection system
CN102814574A (en) * 2012-09-06 2012-12-12 江苏科技大学 Narrow gap welding monitoring and welding line deviation detecting method based on infrared vision sensing

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
基于LinLog感光技术的熔池图像采集系统研究;李梦醒;《焊接》;20120131;第53-57页 *
基于实验铝合金激光小孔焊熔池表面速度计算;高志国;《上海交通大学学报》;20081130;第42卷;第152-154页 *

Also Published As

Publication number Publication date
CN103506756A (en) 2014-01-15

Similar Documents

Publication Publication Date Title
CN103506756B (en) Laser lap welding gap detection system and method based on molten pool image vision sensing
CN103537797B (en) Laser lap welding gap detection method and system based on plasma image
CN102814574B (en) Narrow gap welding monitoring and welding line deviation detecting method based on infrared vision sensing
CN103464869B (en) The rotating the arc narrow gap MAG welding line deviation recognition device of view-based access control model sensing and method
CN112326685B (en) Online detection device and detection method for laser-induced damage of optical element
Zhang et al. Deep-learning-based porosity monitoring of laser welding process
Luo et al. Vision-based weld pool boundary extraction and width measurement during keyhole fiber laser welding
You et al. Visual-based spatter detection during high-power disk laser welding
JP5338890B2 (en) Laser welding welding position detection apparatus and welding position detection method
US8946595B2 (en) Apparatus and method for determining shape of end of welding bead
Wang et al. Obtaining weld pool vision information during aluminium alloy TIG welding
You et al. Multiple-optics sensing of high-brightness disk laser welding process
Zhang et al. Coaxial monitoring of the fibre laser lap welding of Zn-coated steel sheets using an auxiliary illuminant
Kang et al. Weld-penetration-depth estimation using deep learning models and multisensor signals in Al/Cu laser overlap welding
CN104551347A (en) Infrared vision sensing detection method and device for narrow-gap weld seam deviation
CN105458490A (en) Real-time monitoring system and monitoring method for judging welding type of laser deep penetration welding by using high-speed camera
CN111591716A (en) Photoelectric integrated intelligent detection device for conveyor belt damage
CN102990225A (en) Method for detecting laser welding quality in real time
Zeng et al. A visual weld edge recognition method based on light and shadow feature construction using directional lighting
You et al. A novel stability quantification for disk laser welding by using frequency correlation coefficient between multiple-optics signals
CN108067714A (en) A kind of thin-walled circumferential weld termination quality on-line monitoring and defect positioning system and method
Hao et al. Molten pool image processing and quality monitoring of laser cladding process based on coaxial vision
Elefante et al. Detecting beam offsets in laser welding of closed-square-butt joints by wavelet analysis of an optical process signal
CN103149134B (en) A kind of weld fumes monitoring method based on backlight image
JP2014032109A (en) Apparatus and method for detecting defect of wood

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant