CN119299332A - A safety monitoring system and monitoring method based on machine vision - Google Patents
A safety monitoring system and monitoring method based on machine vision Download PDFInfo
- Publication number
- CN119299332A CN119299332A CN202411404721.9A CN202411404721A CN119299332A CN 119299332 A CN119299332 A CN 119299332A CN 202411404721 A CN202411404721 A CN 202411404721A CN 119299332 A CN119299332 A CN 119299332A
- Authority
- CN
- China
- Prior art keywords
- feature representation
- data
- space
- carrying
- machine vision
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
- H04L43/045—Processing captured monitoring data, e.g. for logfile generation for graphical visualisation of monitoring data
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/25—Fusion techniques
- G06F18/253—Fusion techniques of extracted features
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0464—Convolutional networks [CNN, ConvNet]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
- G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
- G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
- G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
- G06V10/806—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of extracted features
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/182—Level alarms, e.g. alarms responsive to variables exceeding a threshold
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Molecular Biology (AREA)
- General Engineering & Computer Science (AREA)
- Biomedical Technology (AREA)
- Medical Informatics (AREA)
- Databases & Information Systems (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computational Linguistics (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Mathematical Physics (AREA)
- Biophysics (AREA)
- Biodiversity & Conservation Biology (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
Description
技术领域Technical Field
本发明涉及网络安全监测及图像处理领域,尤其涉及一种基于机器视觉的安全监测系统及监测方法。The present invention relates to the field of network security monitoring and image processing, and in particular to a machine vision-based security monitoring system and a monitoring method.
背景技术Background Art
随着数据中心和云计算技术的快速发展,服务器硬件的安全监测变得日益重要。在数据中心中,服务器硬件的监控是确保系统稳定运行的重要环节。以前服务器硬件的监控主要依赖于人工检查和基本的硬件监控工具,存在监控不及时、误报率高等问题。随着技术的发展,一些基于机器视觉的服务器硬件安全监测系统被应用于实际场景。With the rapid development of data centers and cloud computing technologies, server hardware security monitoring has become increasingly important. In data centers, server hardware monitoring is an important part of ensuring the stable operation of the system. In the past, server hardware monitoring mainly relied on manual inspection and basic hardware monitoring tools, which had problems such as untimely monitoring and high false alarm rates. With the development of technology, some server hardware security monitoring systems based on machine vision have been applied to actual scenarios.
然而,现有的基于机器视觉的服务器硬件安全监测系统仍存在一些不足之处。首先,这些系统在处理服务器机柜内部复杂环境下的图像时,往往难以有效地分离和抑制来自服务器设备运作、机柜内部光线变化等多种噪声源的干扰,导致硬件状态检测结果易受噪声影响,产生误报或漏报。其次,在服务器硬件异常检测和维护操作分析方面,现有系统难以有效识别出复杂的硬件故障模式或潜在的危险维护操作,特别是在多服务器、高密度部署的场景中,系统的性能往往无法满足实际需求。再者,许多系统未能充分利用来自服务器内部不同传感器的数据进行多模态融合,导致对服务器运行状态的风险评估不够全面,可能忽略某些潜在的硬件故障或安全隐患。现有系统的预警机制往往缺乏灵活性,导致在实际应用中对服务器异常状态的响应速度滞后或响应措施不够精准,最终影响数据中心的安全运营效果。However, the existing server hardware security monitoring systems based on machine vision still have some shortcomings. First, when processing images in the complex environment inside the server cabinet, these systems often find it difficult to effectively separate and suppress interference from multiple noise sources such as server equipment operation and light changes inside the cabinet, resulting in hardware status detection results being easily affected by noise, resulting in false positives or missed positives. Second, in terms of server hardware anomaly detection and maintenance operation analysis, existing systems find it difficult to effectively identify complex hardware failure modes or potentially dangerous maintenance operations, especially in multi-server, high-density deployment scenarios, where the system performance often fails to meet actual needs. Furthermore, many systems fail to fully utilize data from different sensors inside the server for multi-modal fusion, resulting in an incomplete risk assessment of the server's operating status, which may ignore some potential hardware failures or safety hazards. The early warning mechanism of existing systems often lacks flexibility, resulting in a delayed response speed to server abnormalities or inaccurate response measures in actual applications, ultimately affecting the safety operation of the data center.
发明内容Summary of the invention
本发明提供一种基于机器视觉的安全监测系统及监测方法,以解决无法有效地分离和抑制来自设备运作、环境光变化等多种噪声源的干扰,导致检测结果易受噪声影响,产生误报或漏报;难以有效识别出复杂的异常行为或危险操作,未能充分利用来自不同传感器的数据进行多模态融合,导致风险评估不够全面,可能忽略环境中的潜在危险因素;预警机制缺乏灵活性,可能导致在实际应用中响应速度滞后或响应措施不够精准,最终影响安全保障的问题。The present invention provides a safety monitoring system and a monitoring method based on machine vision to solve the problems that the interference from various noise sources such as equipment operation and ambient light changes cannot be effectively separated and suppressed, resulting in the detection results being easily affected by noise, causing false alarms or missed alarms; it is difficult to effectively identify complex abnormal behaviors or dangerous operations, and the data from different sensors cannot be fully utilized for multimodal fusion, resulting in incomplete risk assessment and possible neglect of potential dangerous factors in the environment; the early warning mechanism lacks flexibility, which may lead to delayed response speed or inaccurate response measures in actual applications, ultimately affecting safety assurance.
本发明的一种基于机器视觉的安全监测系统及监测方法,具体包括以下技术方案:A machine vision-based safety monitoring system and monitoring method of the present invention specifically include the following technical solutions:
一种基于机器视觉的安全监测方法,包括以下步骤:A safety monitoring method based on machine vision comprises the following steps:
S1、实时采集服务器硬件的视觉图像数据,通过广义傅里叶-贝塞尔变换对视觉图像数据进行多频域分解,得到不同频域的信号;对不同频域的信号进行自适应非线性滤波处理,得到滤波处理后的频域信号;基于滤波处理后的频域信号,生成去噪后的重构图像;S1. Collect visual image data of server hardware in real time, perform multi-frequency domain decomposition on the visual image data through generalized Fourier-Bessel transform to obtain signals in different frequency domains; perform adaptive nonlinear filtering on the signals in different frequency domains to obtain frequency domain signals after filtering; generate a denoised reconstructed image based on the frequency domain signals after filtering;
S2、基于去噪后的重构图像,通过高阶多项式非线性叠加的深度网络,得到全局特征表示;基于全局特征表示构建时空图,并进行行为分析,得到综合时空特征表示;将综合时空特征表示与传感器数据进行融合处理,得到融合后的模糊决策数据;基于融合后的模糊决策数据,进行风险评估,生成预警策略。S2. Based on the denoised reconstructed image, a global feature representation is obtained through a deep network of high-order polynomial nonlinear superposition; based on the global feature representation, a spatiotemporal graph is constructed, and behavioral analysis is performed to obtain a comprehensive spatiotemporal feature representation; the comprehensive spatiotemporal feature representation is fused with the sensor data to obtain fused fuzzy decision data; based on the fused fuzzy decision data, risk assessment is performed to generate an early warning strategy.
优选的,所述S1,具体包括:Preferably, the S1 specifically includes:
通过引入非线性变换,对不同频域的信号进行自适应非线性滤波处理,得到滤波处理后的频域信号。By introducing nonlinear transformation, adaptive nonlinear filtering is performed on signals in different frequency domains to obtain frequency domain signals after filtering.
优选的,所述S1,具体包括:Preferably, the S1 specifically includes:
将滤波处理后的频域信号通过加权融合进行重新组合,得到去噪后的重构图像。The filtered frequency domain signals are recombined through weighted fusion to obtain the denoised reconstructed image.
优选的,所述S2,具体包括:Preferably, the S2 specifically includes:
基于去噪后的重构图像,引入高阶多项式非线性叠加的深度网络,提取深度网络的每一层特征表示,并对深度网络所有层的特征表示进行加权融合,得到全局特征表示。Based on the denoised reconstructed image, a deep network with high-order polynomial nonlinear superposition is introduced to extract the feature representation of each layer of the deep network, and the feature representation of all layers of the deep network is weightedly fused to obtain the global feature representation.
优选的,所述S2,具体包括:Preferably, the S2 specifically includes:
基于全局特征表示,构建时空图;引入高阶贝塞尔函数和拉普拉斯算子联合变换,对时空图进行分析,得到时空特征表示;基于时空特征表示,进行卷积操作,聚合不同时刻的时空特征信息,得到综合时空特征表示。Based on the global feature representation, a space-time graph is constructed; the high-order Bessel function and Laplace operator joint transformation are introduced to analyze the space-time graph and obtain the space-time feature representation; based on the space-time feature representation, a convolution operation is performed to aggregate the space-time feature information at different times and obtain a comprehensive space-time feature representation.
优选的,所述S2,具体包括:Preferably, the S2 specifically includes:
通过模糊逻辑和卷积积分,对综合时空特征表示和传感器数据进行融合处理,得到融合后的模糊决策数据。Through fuzzy logic and convolution integral, the comprehensive spatiotemporal feature representation and sensor data are fused to obtain the fused fuzzy decision data.
优选的,所述S2,具体包括:Preferably, the S2 specifically includes:
基于融合后的模糊决策数据进行风险评估,得到风险评估结果;基于风险评估结果,通过非线性映射和模糊推理模型生成预警策略。Based on the fused fuzzy decision data, risk assessment is performed to obtain risk assessment results; based on the risk assessment results, an early warning strategy is generated through nonlinear mapping and fuzzy reasoning models.
一种基于机器视觉的安全监测系统,包括以下部分:A safety monitoring system based on machine vision includes the following parts:
图像采集模块、数据预处理模块、目标检测模块、行为分析模块、预警响应模块、数据库;Image acquisition module, data preprocessing module, target detection module, behavior analysis module, early warning response module, database;
图像采集模块,实时捕获服务器硬件的视觉图像数据,并将采集到的视觉图像数据传输至数据预处理模块;An image acquisition module captures the visual image data of the server hardware in real time and transmits the collected visual image data to the data preprocessing module;
数据预处理模块,通过广义傅里叶-贝塞尔变换对视觉图像数据进行多频域分解,得到不同频域的信号;对不同频域的信号进行自适应非线性滤波处理,得到滤波处理后的频域信号;基于滤波处理后的频域信号,通过加权融合重构图像,生成去噪后的重构图像;将去噪后的重构图像传输至目标检测模块、数据库;The data preprocessing module performs multi-frequency domain decomposition of visual image data through generalized Fourier-Bessel transform to obtain signals in different frequency domains; performs adaptive nonlinear filtering on the signals in different frequency domains to obtain frequency domain signals after filtering; reconstructs the image through weighted fusion based on the frequency domain signals after filtering to generate a denoised reconstructed image; and transmits the denoised reconstructed image to the target detection module and database;
目标检测模块,基于高阶多项式非线性叠加的深度网络,从去噪后的重构图像中提取深度网络的每一层特征表示,并对深度网络所有层的特征表示进行加权融合,得到全局特征表示;将全局特征表示传输至行为分析模块、数据库;The target detection module is based on a deep network with high-order polynomial nonlinear superposition. It extracts the feature representation of each layer of the deep network from the denoised reconstructed image, and performs weighted fusion on the feature representation of all layers of the deep network to obtain the global feature representation; the global feature representation is transmitted to the behavior analysis module and the database;
行为分析模块,基于全局特征表示,利用高阶贝塞尔变换网络构建时空图,并提取时空特征表示,通过卷积操作聚合时空特征,形成综合时空特征表示;将综合时空特征表示传输至预警响应模块、数据库;The behavior analysis module uses a high-order Bessel transform network to construct a spatiotemporal graph based on the global feature representation, extracts the spatiotemporal feature representation, aggregates the spatiotemporal features through convolution operations, and forms a comprehensive spatiotemporal feature representation; the comprehensive spatiotemporal feature representation is transmitted to the early warning response module and the database;
预警响应模块,将综合时空特征表示与传感器数据进行融合处理,得到融合后的模糊决策数据;基于融合后的模糊决策数据,进行风险评估,得到风险评估结果;基于风险评估结果,通过非线性映射和模糊推理模型,生成预警策略;The early warning response module fuses the comprehensive spatiotemporal feature representation with the sensor data to obtain the fused fuzzy decision data; based on the fused fuzzy decision data, it conducts risk assessment to obtain the risk assessment results; based on the risk assessment results, it generates early warning strategies through nonlinear mapping and fuzzy reasoning models;
数据库,用于存储数据预处理模块、目标检测模块、行为分析模块传递的数据。The database is used to store data transmitted by the data preprocessing module, target detection module, and behavior analysis module.
本发明的技术方案的有益效果是:The beneficial effects of the technical solution of the present invention are:
1、通过广义傅里叶-贝塞尔变换和自适应非线性滤波的结合,有效地分离和抑制环境噪声,同时保留了关键的视觉图像特征,自适应非线性滤波过程不仅考虑了局部噪声的特性,还通过非线性变换增强了视觉图像信号的对比度,从而提高了视觉图像处理的准确性和鲁棒性,确保后续目标检测的可靠性;1. Through the combination of generalized Fourier-Bessel transform and adaptive nonlinear filtering, the environmental noise is effectively separated and suppressed, while retaining the key visual image features. The adaptive nonlinear filtering process not only takes into account the characteristics of local noise, but also enhances the contrast of visual image signals through nonlinear transformation, thereby improving the accuracy and robustness of visual image processing and ensuring the reliability of subsequent target detection;
2、利用高阶多项式非线性叠加的深度网络对去噪后的重构图像进行多层次的特征提取和融合,有效捕捉去噪后的重构图像中的复杂特征,特别是高阶特征;多层特征的叠加和全局特征的生成,使得机器视觉系统能够准确地检测出潜在的危险目标或异常设备状态;2. Use a deep network with high-order polynomial nonlinear superposition to perform multi-level feature extraction and fusion on the denoised reconstructed image, effectively capturing the complex features in the denoised reconstructed image, especially the high-order features; the superposition of multiple layers of features and the generation of global features enable the machine vision system to accurately detect potential dangerous targets or abnormal equipment status;
3、通过构建时空图,并结合高阶贝塞尔函数和拉普拉斯算子联合变换,机器视觉系统能够在时空维度上准确捕捉目标对象的行为模式和相互关系;时空特征的聚合进一步增强了机器视觉系统在分析目标行为和识别异常操作方面的能力,能够有效地检测出潜在的安全风险;3. By constructing a spatiotemporal graph and combining high-order Bessel functions and Laplace operator joint transforms, the machine vision system can accurately capture the behavior patterns and relationships of target objects in the spatiotemporal dimension; the aggregation of spatiotemporal features further enhances the ability of the machine vision system to analyze target behaviors and identify abnormal operations, and can effectively detect potential security risks;
4、本发明不仅依赖于机器视觉系统的数据,还结合了来自多种传感器(如温度、压力、振动等)的数据,通过模糊逻辑和卷积积分的方式将这些多模态数据进行融合处理,形成统一的风险评估数据;提高了机器视觉系统对环境状态的综合判断能力,使得风险评估更加全面和准确;4. The present invention not only relies on the data of the machine vision system, but also combines the data from various sensors (such as temperature, pressure, vibration, etc.), and fuses these multimodal data through fuzzy logic and convolution integration to form unified risk assessment data; it improves the comprehensive judgment ability of the machine vision system on the environmental status, making the risk assessment more comprehensive and accurate;
5、基于融合后的模糊决策数据,机器视觉系统通过二阶导数分析实现了对风险的动态评估,并根据风险评估结果触发不同级别的预警响应机制。机器视觉系统设定了多个预警阈值,能够灵活地控制不同的预警级别,从低级预警(如声音报警)到高级预警(如自动停机),确保机器视觉系统在各种风险情况下都能做出及时、准确的响应。5. Based on the fused fuzzy decision data, the machine vision system realizes dynamic risk assessment through second-order derivative analysis, and triggers different levels of early warning response mechanisms according to the risk assessment results. The machine vision system sets multiple early warning thresholds and can flexibly control different early warning levels, from low-level early warnings (such as sound alarms) to high-level early warnings (such as automatic shutdowns), ensuring that the machine vision system can respond promptly and accurately in various risk situations.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本发明所述的一种基于机器视觉的安全监测系统结构图;FIG1 is a structural diagram of a safety monitoring system based on machine vision according to the present invention;
图2为本发明所述的一种基于机器视觉的安全监测方法流程图;FIG2 is a flow chart of a safety monitoring method based on machine vision according to the present invention;
图3为本发明所述的服务器视觉监控场景拓扑图;FIG3 is a topological diagram of a server visual monitoring scenario according to the present invention;
图4为本发明所述的一种基于机器视觉的安全监测系统架构设计图。FIG4 is a design diagram of a machine vision-based security monitoring system architecture according to the present invention.
具体实施方式DETAILED DESCRIPTION
为了更进一步阐述本发明为达成预定发明目的所采取的技术手段及功效,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to further explain the technical means and effects adopted by the present invention to achieve the predetermined invention purpose, the technical scheme in the embodiment of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiment of the present invention. Obviously, the described embodiment is only a part of the embodiment of the present invention, not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
除非另有定义,本文所使用的所有的技术和科学术语与属于本发明的技术领域的技术人员通常理解的含义相同。Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
下面结合附图具体的说明本发明所提供的一种基于机器视觉的安全监测系统及监测方法的具体方案。The following is a detailed description of a specific scheme of a machine vision-based safety monitoring system and monitoring method provided by the present invention in conjunction with the accompanying drawings.
参照附图1,其示出了本发明一个实施例所提供的一种基于机器视觉的安全监测系统结构图,该系统包括以下部分:Referring to FIG. 1 , a structure diagram of a machine vision-based safety monitoring system provided by an embodiment of the present invention is shown. The system includes the following parts:
图像采集模块、数据预处理模块、目标检测模块、行为分析模块、预警响应模块、数据库;Image acquisition module, data preprocessing module, target detection module, behavior analysis module, early warning response module, database;
图像采集模块,通过摄像头实时捕获服务器硬件的视觉图像数据,并将捕获到的图像数据传输至数据预处理模块;The image acquisition module captures the visual image data of the server hardware in real time through the camera and transmits the captured image data to the data preprocessing module;
数据预处理模块,采用广义傅里叶-贝塞尔变换对视觉图像数据进行多频域分解,得到不同频域的信号;通过自适应非线性滤波器对不同频域的信号进行噪声抑制和特征增强,最后通过加权融合重构图像数据,得到去噪后的重构图像;将去噪后的重构图像传输至目标检测模块、数据库;The data preprocessing module uses the generalized Fourier-Bessel transform to perform multi-frequency domain decomposition on the visual image data to obtain signals in different frequency domains; the signals in different frequency domains are subjected to noise suppression and feature enhancement through adaptive nonlinear filters, and finally the image data is reconstructed through weighted fusion to obtain a denoised reconstructed image; the denoised reconstructed image is transmitted to the target detection module and database;
目标检测模块,基于高阶多项式非线性叠加的深度网络,从去噪后的重构图像中提取多层特征,生成全局特征表示,用于识别潜在的危险目标或异常设备状态;将全局特征表示传输至行为分析模块、数据库;The target detection module, based on a deep network of high-order polynomial nonlinear superposition, extracts multi-layer features from the denoised reconstructed image and generates a global feature representation for identifying potential dangerous targets or abnormal equipment status; the global feature representation is transmitted to the behavior analysis module and database;
行为分析模块,基于全局特征表示,利用高阶贝塞尔变换网络构建时空图,并提取时空特征表示,通过卷积操作聚合时空特征,形成综合时空特征表示,用于分析目标的行为模式,识别危险行为或异常操作;将综合时空特征表示传输至预警响应模块、数据库;The behavior analysis module uses a high-order Bessel transform network to construct a spatiotemporal graph based on global feature representation, extracts spatiotemporal feature representation, aggregates spatiotemporal features through convolution operations, and forms a comprehensive spatiotemporal feature representation, which is used to analyze the target's behavior pattern and identify dangerous behaviors or abnormal operations; the comprehensive spatiotemporal feature representation is transmitted to the early warning response module and database;
预警响应模块,将综合时空特征表示与其他传感器数据进行融合处理,得到融合后的模糊决策数据;基于融合后的模糊决策数据,进行风险评估,得到风险评估结果;基于风险评估结果,通过非线性映射和模糊推理模型生成预警信号,用于触发相应的安全响应措施,机器视觉系统设定多个预警阈值,每个预警阈值对应不同级别的预警或响应机制。The early warning response module fuses the comprehensive spatiotemporal feature representation with other sensor data to obtain fused fuzzy decision data; based on the fused fuzzy decision data, it performs risk assessment to obtain risk assessment results; based on the risk assessment results, it generates early warning signals through nonlinear mapping and fuzzy reasoning models to trigger corresponding safety response measures. The machine vision system sets multiple early warning thresholds, and each early warning threshold corresponds to a different level of early warning or response mechanism.
数据库,用于存储数据预处理模块、目标检测模块、行为分析模块传递的数据。The database is used to store data transmitted by the data preprocessing module, target detection module, and behavior analysis module.
参照附图2,其示出了本发明一个实施例所提供的一种基于机器视觉的安全监测方法流程图,该方法包括以下步骤:Referring to FIG. 2 , a flow chart of a safety monitoring method based on machine vision provided by an embodiment of the present invention is shown. The method comprises the following steps:
S1、实时采集服务器硬件的视觉图像数据,通过广义傅里叶-贝塞尔变换对视觉图像数据进行多频域分解,得到不同频域的信号;对不同频域的信号进行自适应非线性滤波处理,得到滤波处理后的频域信号;基于滤波处理后的频域信号,生成去噪后的重构图像;S1. Collect visual image data of server hardware in real time, perform multi-frequency domain decomposition on the visual image data through generalized Fourier-Bessel transform to obtain signals in different frequency domains; perform adaptive nonlinear filtering on the signals in different frequency domains to obtain frequency domain signals after filtering; generate a denoised reconstructed image based on the frequency domain signals after filtering;
参照附图3和附图4,客户端通过图像采集模块捕获服务器硬件的视觉图像数据,并传输到服务端,服务端包括数据预处理模块、目标检测模块、行为分析模块、预警响应模块,将捕获到的视觉图像数据以标准格式存储,并通过高速数据传输接口(如GigE或USB3.0)实时传送至数据预处理模块,并在服务器机柜中进行存储管理,以确保数据的完整性和随时可用性。Referring to Figures 3 and 4, the client captures the visual image data of the server hardware through the image acquisition module and transmits it to the server. The server includes a data preprocessing module, a target detection module, a behavior analysis module, and an early warning response module. The captured visual image data is stored in a standard format and transmitted to the data preprocessing module in real time through a high-speed data transmission interface (such as GigE or USB3.0), and is stored and managed in the server cabinet to ensure the integrity and availability of the data at all times.
采集的视觉图像数据包含丰富的环境信息,但同时也包含了大量复杂噪声,所述噪声可能来自设备运作、环境光变化以及其他不确定因素,因此需要进行预处理以提升后续分析的准确性,服务端弹性计算设备中的数据预处理模块采用了广义傅里叶-贝塞尔变换对视觉图像数据进行多频域分解。广义傅里叶-贝塞尔变换公式为:The collected visual image data contains rich environmental information, but also contains a lot of complex noise, which may come from equipment operation, ambient light changes and other uncertain factors. Therefore, preprocessing is required to improve the accuracy of subsequent analysis. The data preprocessing module in the server-side elastic computing device uses the generalized Fourier-Bessel transform to decompose the visual image data in multiple frequency domains. The generalized Fourier-Bessel transform formula is:
其中,Fi(x,y)表示视觉图像信号在第i个频域上的值,作为输入的视觉图像数据经过广义傅里叶-贝塞尔变换后的频域分量,即第i个频域上的信号;I(x,y)是输入的视觉图像数据在空间坐标(x,y)上的灰度值;m、n是视觉图像数据的空间位置偏移量;ψi(m,n)表示第i个频域的基函数;是复指数项,表示傅里叶变换中不同频率成分的贡献,ωm,n是角频率,j是序数单位;Jv(ar)是贝塞尔函数,表示在频域中的幅度分布,v为贝塞尔函数的阶数,α为调节频率幅度的参数,r为空间距离 Wherein, F i (x, y) represents the value of the visual image signal in the i-th frequency domain, which is the frequency domain component of the input visual image data after the generalized Fourier-Bessel transform, that is, the signal in the i-th frequency domain; I (x, y) is the gray value of the input visual image data at the spatial coordinates (x, y); m and n are the spatial position offsets of the visual image data; ψi (m, n) represents the basis function of the i-th frequency domain; is a complex exponential term, which indicates the contribution of different frequency components in Fourier transform, ωm, n is the angular frequency, j is the ordinal unit; Jv (ar) is the Bessel function, which indicates the amplitude distribution in the frequency domain, v is the order of the Bessel function, α is the parameter for adjusting the frequency amplitude, and r is the spatial distance
在对视觉图像数据进行多频域分解完成后,数据预处理模块还对不同频域的信号Fi(x,y)进行自适应非线性滤波处理,以抑制噪声并增强关键特征,自适应非线性滤波器不仅考虑了局部噪声的特性,还引入了非线性变换来进一步优化处理效果。自适应非线性滤波的具体公式为:After completing the multi-frequency domain decomposition of the visual image data, the data preprocessing module also performs adaptive nonlinear filtering on the signals F i (x, y) in different frequency domains to suppress noise and enhance key features. The adaptive nonlinear filter not only considers the characteristics of local noise, but also introduces nonlinear transformation to further optimize the processing effect. The specific formula of adaptive nonlinear filtering is:
其中,F′i(x,y)表示经过自适应非线性滤波处理后在第i个频域上的视觉图像信号,即滤波处理后的频域信号;表示第i个频域中视觉图像信号在位置(x,y)处的噪声的估计值,通过统计分析视觉图像信号局部区域的灰度变化得出;λi是自适应非线性滤波器的调节参数,用于控制滤波的强度,确保在抑制噪声的同时保留有用的信号;非线性函数tanh(γ·Fi(x,y))进一步增强第i个频域上的视觉图像信号的对比度,其中γ为非线性系数,用于调节第i个频域上的视觉图像信号增强的力度;ω是频域中的频率分量,用于描述第i个频域上的视觉图像信号在频域中的分布情况。Wherein, F′ i (x, y) represents the visual image signal in the i-th frequency domain after the adaptive nonlinear filtering process, that is, the frequency domain signal after the filtering process; represents the estimated value of the noise of the visual image signal at the position (x, y) in the ith frequency domain, which is obtained by statistically analyzing the grayscale changes in the local area of the visual image signal; λ i is the adjustment parameter of the adaptive nonlinear filter, which is used to control the intensity of the filtering to ensure that the useful signal is retained while suppressing the noise; the nonlinear function tanh(γ·F i (x, y)) further enhances the contrast of the visual image signal in the ith frequency domain, where γ is the nonlinear coefficient, which is used to adjust the intensity of the enhancement of the visual image signal in the ith frequency domain; ω is the frequency component in the frequency domain, which is used to describe the distribution of the visual image signal in the ith frequency domain in the frequency domain.
将滤波处理后的频域信号重新组合,通过加权融合不同频域的结果,以形成去噪后的重构图像。其公式为:The frequency domain signals after filtering are recombined, and the results of different frequency domains are weighted and fused to form a denoised reconstructed image. The formula is:
其中,I′(x,y)为去噪后的重构图像在空间坐标(x,y)处的值;αi是第i个频域的加权系数,表示第i个频域在最终图像重构中的重要性;表示频域总数;cos(βω)是用于频域融合的余弦函数,β为调节余弦函数频率的参数,控制频域成分在重构图像中的作用,ω为频域中的频率分量。上述得到去噪后的重构图像I′(x,y),其中的噪声已经被有效抑制,同时保留了重要的图像特征。Where I′(x, y) is the value of the reconstructed image after denoising at the spatial coordinate (x, y); α i is the weighting coefficient of the i-th frequency domain, indicating the importance of the i-th frequency domain in the final image reconstruction; Represents the total number of frequency domains; cos(βω) is the cosine function used for frequency domain fusion, β is the parameter for adjusting the frequency of the cosine function, controlling the role of the frequency domain components in the reconstructed image, and ω is the frequency component in the frequency domain. The above-mentioned denoised reconstructed image I′(x, y) is obtained, in which the noise has been effectively suppressed while retaining important image features.
S2、基于去噪后的重构图像,通过高阶多项式非线性叠加的深度网络,得到全局特征表示;基于全局特征表示构建时空图,并进行行为分析,得到综合时空特征表示;将综合时空特征表示与传感器数据进行融合处理,得到融合后的模糊决策数据;基于融合后的模糊决策数据,进行风险评估,生成预警策略。S2. Based on the denoised reconstructed image, a global feature representation is obtained through a deep network of high-order polynomial nonlinear superposition; based on the global feature representation, a spatiotemporal graph is constructed, and behavioral analysis is performed to obtain a comprehensive spatiotemporal feature representation; the comprehensive spatiotemporal feature representation is fused with the sensor data to obtain fused fuzzy decision data; based on the fused fuzzy decision data, risk assessment is performed to generate an early warning strategy.
目标检测模块将去噪后的重构图像作为输入,利用高阶多项式非线性叠加的深度网络进行目标检测,从去噪后的重构图像中精确识别出潜在的危险目标或异常设备状态。The target detection module takes the denoised reconstructed image as input and uses a deep network with high-order polynomial nonlinear superposition to perform target detection, accurately identifying potential dangerous targets or abnormal equipment status from the denoised reconstructed image.
具体的,通过高阶多项式非线性叠加的深度网络提取多层特征表示,其公式如下:Specifically, a multi-layer feature representation is extracted through a deep network with high-order polynomial nonlinear superposition. The formula is as follows:
其中,Gl是第l层深度网络的特征表示;Yl表示第l层深度网络的输入特征;Y1=I′(x,y)表示输入的去噪后的重构图像,是第1层深度网络的输入特征;经过多层非线性变换生成的特征表示,将作为第l+1层深度网络的输入特征;是第l层深度网络的输入特征的q次幂,Vl是第l层深度网络的权重矩阵,bl是第l层深度网络的偏置项,q代表多项式的阶数,通过对第l层深度网络的输入特征中的特定维度进行q阶导数的计算,可以进一步捕捉去噪后的重构图像中的高阶特征,z是第l层深度网络的输入特征中的特定维度(例如空间坐标);p是最高阶的多项式阶数,即提取特征的深度,决定深度网络的非线性表达能力;是叠加系数,控制前一层深度网络的特征表示对当前层深度网络的特征表示的影响。深度网络的每一层特征表示Gl将在多个层级中逐步叠加,形成更具表达力的全局特征表示。Among them, G l is the feature representation of the l-th layer deep network; Y l represents the input feature of the l-th layer deep network; Y 1 = I′(x, y) represents the input denoised reconstructed image, which is the input feature of the 1st layer deep network; after multiple layers of nonlinear transformation The generated feature representation will be used as the input feature of the l+1th layer deep network; is the qth power of the input feature of the lth layer deep network, V l is the weight matrix of the lth layer deep network, b l is the bias term of the lth layer deep network, q represents the order of the polynomial, and the qth order derivative is taken on a specific dimension in the input feature of the lth layer deep network. The calculation of can further capture the high-order features in the reconstructed image after denoising. z is a specific dimension (such as spatial coordinates) in the input feature of the l-th layer of the deep network; p is the highest order of the polynomial, that is, the depth of the extracted features, which determines the nonlinear expression ability of the deep network; is the superposition coefficient, which controls the influence of the feature representation of the previous layer of the deep network on the feature representation of the current layer of the deep network. The feature representation G l of each layer of the deep network will be gradually superimposed in multiple levels to form a more expressive global feature representation.
全局特征表示的生成通过如下公式实现:The generation of global feature representation is achieved through the following formula:
其中,Gglobal是全局特征表示;δl为每层深度网络的特征表示的融合权重;L表示高阶多项式非线性叠加的深度网络的总层数。通过对深度网络所有层的特征表示进行加权融合,并在时间维度r上进行积分,得到一个综合了深度网络各层信息的全局特征表示。Among them, G global is the global feature representation; δ l is the fusion weight of the feature representation of each layer of the deep network; L represents the total number of layers of the deep network with high-order polynomial nonlinear superposition. By weighted fusion of the feature representations of all layers of the deep network and integrating them over the time dimension r, a global feature representation that integrates the information of each layer of the deep network is obtained.
行为分析模块基于全局特征表示Gglobal来构建时空图G,时空图的构建目的是通过图的结构化表示来捕捉目标对象在时间和空间上的相互关系和行为模式,识别出危险行为或异常操作。具体实现步骤如下:The behavior analysis module constructs a spatiotemporal graph G based on the global feature representation G global . The purpose of constructing the spatiotemporal graph is to capture the temporal and spatial relationships and behavior patterns of the target objects through the structured representation of the graph, and to identify dangerous behaviors or abnormal operations. The specific implementation steps are as follows:
全局特征表示Gglobal中的每一个检测目标,即深度网络每一层的特征表示,作为时空图的一个节点,节点的特征向量来自于全局特征表示中的具体子集,用于表示检测目标的空间位置、速度、外形特征等;节点之间的边表示不同检测目标之间的时空关系,边的特征由两个节点的特征向量计算得到,常见的计算方法包括欧氏距离、余弦相似度等。边的权重取决于检测目标之间的物理距离和相对速度,即以自然对数为底数,指数是用两个节点之间的欧氏距离除以用来控制边权重的衰减速度的调节参数;通过时间维度将不同时刻的时空图进行连接,形成一个时间序列图。每个时刻的节点与其在下一时刻的节点通过边进行连接,确保时空上的连续性。Each detection target in the global feature representation G global , that is, the feature representation of each layer of the deep network, is a node in the spatiotemporal graph. The feature vector of the node comes from a specific subset in the global feature representation, which is used to represent the spatial position, speed, and appearance characteristics of the detection target; the edge between nodes represents the spatiotemporal relationship between different detection targets. The edge features are calculated by the feature vectors of two nodes. Common calculation methods include Euclidean distance, cosine similarity, etc. The weight of the edge depends on the physical distance and relative speed between the detection targets, that is, the natural logarithm is used as the base, and the exponent is the Euclidean distance between the two nodes divided by the adjustment parameter used to control the decay speed of the edge weight; the spatiotemporal graphs at different times are connected through the time dimension to form a time series graph. The node at each time is connected to its node at the next time through an edge to ensure continuity in time and space.
在构建好时空图G之后,对时空图进行分析,为了更好地捕捉时空特征,引入了高阶贝塞尔函数和拉普拉斯算子联合变换,公式如下:After constructing the space-time graph G, the space-time graph is analyzed. In order to better capture the space-time characteristics, a joint transformation of high-order Bessel function and Laplace operator is introduced. The formula is as follows:
H0=σ(W0·Gglobal+b0)H 0 =σ(W 0 ·G global +b 0 )
其中,Ht+1是下一时刻的时空特征表示,结合了时空图的二阶导数特征和当前时刻的时空特征表示Ht;H0是初始时空特征表示;是拉普拉斯算子,用于提取时空图的局部二阶导数特征,增强时空依赖关系的表示;Jk是第k阶贝塞尔函数;表示贝塞尔函数的最高阶;为第k阶贝塞尔函数对应的权重,控制不同阶时空特征在时空图中的贡献;λ和分别是调节系数和频率参数,用于调节时间维度上时空特征变化的幅度和频率;cosh是双曲余弦函数,进一步增强时空特征的表达能力;W0是权重矩阵,用于对全局特征表示表示进行线性变换;b0是偏置向量,增加到线性变换的结果中,用于调整时空特征表示的中心位置,避免过度依赖零值。Among them, H t+1 is the spatiotemporal feature representation of the next moment, which combines the second-order derivative features of the spatiotemporal graph and the spatiotemporal feature representation H t of the current moment; H 0 is the initial spatiotemporal feature representation; is the Laplace operator, which is used to extract the local second-order derivative features of the space-time graph and enhance the representation of space-time dependencies; J k is the k-th order Bessel function; represents the highest order of Bessel function; is the weight corresponding to the k-th order Bessel function, which controls the contribution of different order spatiotemporal features in the spatiotemporal graph; λ and are the adjustment coefficient and frequency parameter, which are used to adjust the amplitude and frequency of the changes in the spatiotemporal features in the time dimension; cosh is the hyperbolic cosine function, which further enhances the expressiveness of the spatiotemporal features; W0 is the weight matrix, which is used to perform a linear transformation on the global feature representation; b0 is the bias vector, which is added to the result of the linear transformation and is used to adjust the center position of the spatiotemporal feature representation to avoid over-reliance on zero values.
提取出的时空特征表示通过卷积操作聚合后,形成综合时空特征表示,其公式为:The extracted spatiotemporal feature representations are aggregated through convolution operations to form a comprehensive spatiotemporal feature representation, whose formula is:
其中,Hfinal是综合时空特征表示;是时间维度的加权系数;Wc是卷积核,通过对时空特征表示进行卷积操作,聚合不同时刻的时空特征信息,最终形成一个综合的时空特征表示;T是时间序列的长度,即总时间步数。Among them, H final is the comprehensive spatiotemporal feature representation; is the weighting coefficient of the time dimension; Wc is the convolution kernel, which aggregates the spatiotemporal feature information at different times by performing convolution operations on the spatiotemporal feature representation, and finally forms a comprehensive spatiotemporal feature representation; T is the length of the time series, that is, the total number of time steps.
综合时空特征表示作为一个综合的、能够反映当前风险状态的视频流,服务端将处理后的视频流通过前端展示,操作人员可以通过配置页面查看实时数据、调整安全监测系统参数,并查看历史报警记录。The comprehensive spatiotemporal features are represented as a comprehensive video stream that can reflect the current risk status. The server displays the processed video stream through the front end. Operators can view real-time data, adjust security monitoring system parameters, and view historical alarm records through the configuration page.
预警响应模块将行为分析模块生成的综合时空特征表示作为输入,与其他传感器(如温度传感器、压力传感器、振动传感器、湿度传感器等)所采集的数据进行融合处理,其他传感器数据用于补充机器视觉系统的图像数据,提供更多维度的数据,以帮助安全监测系统更准确地评估环境状态和潜在的安全风险。融合处理通过模糊逻辑和卷积积分实现,其公式为:The early warning response module takes the comprehensive spatiotemporal feature representation generated by the behavior analysis module as input and performs fusion processing with the data collected by other sensors (such as temperature sensors, pressure sensors, vibration sensors, humidity sensors, etc.). Other sensor data are used to supplement the image data of the machine vision system and provide more dimensional data to help the security monitoring system more accurately assess the environmental status and potential safety risks. The fusion processing is achieved through fuzzy logic and convolution integral, and its formula is:
其中,Df是融合后的模糊决策数据,作为风险评估的基础数据;u是其他传感器数据的索引;N是其他传感器数据的总数量;是模糊集的隶属度函数,表示根据计算的隶属度,是从Su中提取出的特征值,Su是第u个传感器数据矩阵,通过卷积操作与综合时空特征融合得到;dω是频率变量的积分,表示对传感器数据在频域内进行全面处理,积分操作确保传感器数据中所有频域成分得到有效处理。Among them, Df is the fused fuzzy decision data, which is used as the basic data for risk assessment; u is the index of other sensor data; N is the total number of other sensor data; is the membership function of the fuzzy set, indicating that The calculated membership degree, is the eigenvalue extracted from Su , where Su is the u-th sensor data matrix, obtained by convolution operation and fusion of comprehensive spatiotemporal features; dω is the integral of the frequency variable, indicating that the sensor data is fully processed in the frequency domain. The integration operation ensures that all frequency domain components in the sensor data are effectively processed.
对融合后的模糊决策数据进行风险评估,其公式如下:The risk assessment of the fused fuzzy decision data is performed as follows:
其中,R(t)是当前时刻t的风险等级,表示根据当前时刻的输入数据评估得到的风险值,即风险评估结果;M是风险评估因素的总数量;c是风险评估因素的索引;表示对融合后的模糊决策数据在时间维度上的二阶导数,反映融合后的模糊决策数据随时间的动态变化;为模糊推理中的权重参数;R(t-1)是前一时刻的风险等级。Where R(t) is the risk level at the current time t, which represents the risk value obtained by evaluating the input data at the current time, that is, the risk assessment result; M is the total number of risk assessment factors; c is the index of the risk assessment factor; It represents the second-order derivative of the fused fuzzy decision data in the time dimension, reflecting the dynamic changes of the fused fuzzy decision data over time; is the weight parameter in fuzzy reasoning; R(t-1) is the risk level at the previous moment.
根据风险评估结果,通过非线性映射和模糊推理模型确定预警策略,公式如下:According to the risk assessment results, the early warning strategy is determined through nonlinear mapping and fuzzy reasoning model. The formula is as follows:
其中,Doutput(t)是在t时刻的决策输出信号;θ是决策权重,表示风险评估结果在预警决策中的影响力;τ是标准化系数,用于调整风险等级R(t)的尺度,确保决策输出信号的平滑性。最终输出的Doutput(t)是报警系统的预警信号,用于触发相应的安全措施,如警报、通知或自动停机。Among them, D output (t) is the decision output signal at time t; θ is the decision weight, which indicates the influence of the risk assessment result in the early warning decision; τ is the normalization coefficient, which is used to adjust the scale of the risk level R(t) to ensure the smoothness of the decision output signal. The final output D output (t) is the early warning signal of the alarm system, which is used to trigger corresponding safety measures, such as alarm, notification or automatic shutdown.
报警系统设定多个预警阈值,每个预警阈值对应不同级别的预警或响应机制,当D。utput(t)达到或超过某个预警阈值时,报警系统将触发对应的预警机制。根据触发的预警机制,报警系统决定启动何种预警措施。例如,预警级别分为低、中、高三级,分别对应不同的风险程度,低级预警:可能触发一个声音报警或在监控屏幕上显示警告信息,提示操作人员注意;中级预警:报警系统可能会发送短信或电子邮件通知安全管理人员,要求进一步调查潜在的风险;高级预警:报警系统可能会立即执行自动停机、安全隔离等紧急措施,以防止可能发生的重大事故。The alarm system sets multiple warning thresholds, each of which corresponds to a different level of warning or response mechanism. When D.utput (t) reaches or exceeds a certain warning threshold, the alarm system will trigger the corresponding warning mechanism. According to the triggered warning mechanism, the alarm system decides what kind of warning measures to start. For example, the warning level is divided into three levels: low, medium, and high, corresponding to different risk levels. Low-level warning: may trigger a sound alarm or display a warning message on the monitoring screen to prompt the operator to pay attention; medium-level warning: the alarm system may send a text message or email to notify the safety manager to further investigate the potential risk; high-level warning: the alarm system may immediately execute emergency measures such as automatic shutdown and safety isolation to prevent possible major accidents.
从而实现了对不同预警级别的灵活控制,确保机器视觉系统在各种风险情况下都能做出及时、准确的响应,从而保障网络环境的安全性。This enables flexible control of different warning levels, ensuring that the machine vision system can make timely and accurate responses in various risk situations, thereby ensuring the security of the network environment.
综上所述,完成了一种基于机器视觉的安全监测系统及监测方法。In summary, a safety monitoring system and monitoring method based on machine vision have been completed.
发明实施例先后顺序仅仅为了描述,不代表实施例的优劣。在附图中描绘的过程不一定要求示出的特定顺序或者连续顺序才能实现期望的结果。在某些实施方式中,多任务处理和并行处理也是可以的或者可能是有利的。The order of the embodiments of the invention is for description only and does not represent the advantages and disadvantages of the embodiments. The processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
本说明书中的各个实施例均采用递进的方式描述,各个实施例之间相同或相似的部分互相参见即可,每个实施例重点说明的都是与其他实施例的不同之处。The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referenced to each other, and each embodiment focuses on the differences from other embodiments.
上述实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围,均应包含在本发明的保护范围之内。The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that the technical solutions described in the above embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention.
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411404721.9A CN119299332B (en) | 2024-10-09 | 2024-10-09 | A safety monitoring system and monitoring method based on machine vision |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411404721.9A CN119299332B (en) | 2024-10-09 | 2024-10-09 | A safety monitoring system and monitoring method based on machine vision |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN119299332A true CN119299332A (en) | 2025-01-10 |
| CN119299332B CN119299332B (en) | 2025-06-17 |
Family
ID=94148131
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202411404721.9A Active CN119299332B (en) | 2024-10-09 | 2024-10-09 | A safety monitoring system and monitoring method based on machine vision |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN119299332B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN120031388A (en) * | 2025-04-02 | 2025-05-23 | 广东省建设工程质量安全检测总站有限公司 | Method, device and equipment for evaluating the hazard factor of static load single pile test platform operation |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109522793A (en) * | 2018-10-10 | 2019-03-26 | 华南理工大学 | More people's unusual checkings and recognition methods based on machine vision |
| CN110044405A (en) * | 2019-05-16 | 2019-07-23 | 吉林大学 | A kind of automobile instrument automatic detection device and method based on machine vision |
| EP4322060A1 (en) * | 2022-08-09 | 2024-02-14 | Zhejiang Lab | Method and system for predicting spatio-temporal perception information based on graph neural network |
| WO2024119360A1 (en) * | 2022-12-06 | 2024-06-13 | 山东科技大学 | Elevator safety fault diagnosis method based on multi-source information fusion |
-
2024
- 2024-10-09 CN CN202411404721.9A patent/CN119299332B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109522793A (en) * | 2018-10-10 | 2019-03-26 | 华南理工大学 | More people's unusual checkings and recognition methods based on machine vision |
| CN110044405A (en) * | 2019-05-16 | 2019-07-23 | 吉林大学 | A kind of automobile instrument automatic detection device and method based on machine vision |
| EP4322060A1 (en) * | 2022-08-09 | 2024-02-14 | Zhejiang Lab | Method and system for predicting spatio-temporal perception information based on graph neural network |
| WO2024119360A1 (en) * | 2022-12-06 | 2024-06-13 | 山东科技大学 | Elevator safety fault diagnosis method based on multi-source information fusion |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN120031388A (en) * | 2025-04-02 | 2025-05-23 | 广东省建设工程质量安全检测总站有限公司 | Method, device and equipment for evaluating the hazard factor of static load single pile test platform operation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN119299332B (en) | 2025-06-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11145174B2 (en) | Methods and system for monitoring an environment | |
| CN119474996A (en) | Multi-modal communication and expert collaborative causal thinking chain reasoning power anomaly detection method and system | |
| CN118952253B (en) | Intelligent inspection robot system based on Internet of things | |
| CN120031878A (en) | A conveyor belt abnormality detection method and system based on multimodal fusion technology | |
| Pan et al. | Cognitive acoustic analytics service for Internet of Things | |
| CN120561741B (en) | Main power distribution network detection classification method for double-channel time-frequency fusion drive Mamba | |
| CN118817271A (en) | A wide-area acoustic visualization detection method and system for GIS equipment defects | |
| CN119299332B (en) | A safety monitoring system and monitoring method based on machine vision | |
| CN119714411A (en) | Intelligent aircraft inspection system based on multi-mode large model | |
| CN120561674A (en) | Converter station fault identification method, device, computer equipment and readable storage medium | |
| CN120954100A (en) | A method and device for human motion recognition | |
| CN121167487A (en) | Intelligent metering laboratory environment monitoring and evaluating method and system | |
| CN120849469A (en) | Real-time data stream processing method, device, equipment and medium | |
| CN121094526A (en) | Multi-mode data fusion-based power cross operation dynamic risk prediction and early warning method, system, equipment and medium | |
| CN118175065A (en) | A device port security alarm system | |
| CN111598007A (en) | Automatic monitoring method for substation equipment | |
| CN119179309A (en) | Industrial field automatic monitoring method and system based on cloud edge cooperative detection | |
| CN119206613A (en) | A method, system, device, medium and product for centralized monitoring of dynamic environment | |
| CN111541877A (en) | An automatic monitoring system for substation equipment | |
| Kuzmanić et al. | Reliability and availability of quality control based on wavelet computer vision | |
| CN116822929A (en) | Alarm method, alarm device, electronic equipment and storage medium | |
| KR102861768B1 (en) | Method for detecting laser welding defect and apparatus thereof | |
| CN118736683B (en) | Method and system for monitoring operator rule violation based on distributed control ball | |
| CN119992450B (en) | Electronic evidence identification method and system | |
| CN118758497B (en) | Optical device for online monitoring of equipment gas leakage and monitoring method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |