CN119152745B - Comprehensive puncture simulation system based on automatic injector - Google Patents
Comprehensive puncture simulation system based on automatic injector Download PDFInfo
- Publication number
- CN119152745B CN119152745B CN202411597848.7A CN202411597848A CN119152745B CN 119152745 B CN119152745 B CN 119152745B CN 202411597848 A CN202411597848 A CN 202411597848A CN 119152745 B CN119152745 B CN 119152745B
- Authority
- CN
- China
- Prior art keywords
- puncture
- gyroscope
- simulation
- scene
- calibration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/048—Activation functions
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/09—Supervised learning
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/50—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/10—Internal combustion engine [ICE] based vehicles
- Y02T10/40—Engine management systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Medical Informatics (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Public Health (AREA)
- Evolutionary Computation (AREA)
- Pathology (AREA)
- Databases & Information Systems (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Instructional Devices (AREA)
Abstract
Description
技术领域Technical Field
本发明涉及医疗培训技术领域,尤其涉及一种基于自动注射器的综合穿刺模拟系统。The invention relates to the technical field of medical training, and in particular to a comprehensive puncture simulation system based on an automatic injector.
背景技术Background Art
穿刺模拟系统作为现代医疗培训领域的创新先锋,集成了高度仿真的物理模型与尖端智能技术,为医疗领域的学生、护士及医生打造了一个零风险、高效率的实操演练平台,该系统通过精细模拟人体各部位的真实组织结构与穿刺过程中的动态力学反馈,让训练者仿佛置身于真实的手术场景之中,从而显著提升其穿刺操作的精准度、技能熟练度及手眼协调能力,这不仅广泛覆盖胸腔、腹腔、腰椎等多种常见穿刺类型,还集成了演示、实战训练与考核评估等多重功能模式,以满足不同水平学习者的个性化需求。此外,模拟系统还具备可视化教学功能,通过实时显示穿刺路径与周围组织结构,帮助训练者直观理解操作细节,提高教学效果。As an innovative pioneer in the field of modern medical training, the puncture simulation system integrates highly simulated physical models and cutting-edge intelligent technology to create a zero-risk, high-efficiency practical exercise platform for students, nurses and doctors in the medical field. The system simulates the real tissue structure of various parts of the human body and the dynamic mechanical feedback during the puncture process, so that the trainees can feel as if they are in a real surgical scene, thereby significantly improving their puncture operation accuracy, skill proficiency and hand-eye coordination ability. This not only covers a wide range of common puncture types such as the chest, abdomen, and lumbar spine, but also integrates multiple functional modes such as demonstration, actual training, and assessment and evaluation to meet the personalized needs of learners at different levels. In addition, the simulation system also has a visual teaching function, which helps trainees intuitively understand the operation details and improve the teaching effect by displaying the puncture path and surrounding tissue structure in real time.
尤为重要的是,本发明的穿刺模拟系统还采用了陀螺仪传感器作为核心技术之一,陀螺仪负责识别自动注射器在操作过程中的角度旋转,为训练者提供实时的、精准的操作反馈。然而,尽管陀螺仪传感器在此应用中发挥了举足轻重的作用,但其在实际运行中的精度在很大程度上取决于其惯性测量单元的性能,容易造成陀螺仪测量误差项大且具有噪声特性,从而影响了穿刺路径识别模拟的精确度。More importantly, the puncture simulation system of the present invention also uses a gyroscope sensor as one of the core technologies. The gyroscope is responsible for identifying the angular rotation of the automatic syringe during operation and providing real-time and accurate operation feedback to the trainee. However, although the gyroscope sensor plays a pivotal role in this application, its accuracy in actual operation depends largely on the performance of its inertial measurement unit, which easily causes the gyroscope measurement error term to be large and has noise characteristics, thereby affecting the accuracy of the puncture path recognition simulation.
发明内容Summary of the invention
基于此,本发明有必要提供一种基于自动注射器的综合穿刺模拟系统,以解决至少一个上述技术问题。Based on this, it is necessary for the present invention to provide a comprehensive puncture simulation system based on an automatic syringe to solve at least one of the above technical problems.
为实现上述目的,一种基于自动注射器的综合穿刺模拟系统,包括以下模块:To achieve the above purpose, a comprehensive puncture simulation system based on an automatic syringe includes the following modules:
用户训练穿刺模拟操作选择模块,用于通过训练者用户界面选择需要模拟的穿刺场景,并根据所选模拟的穿刺场景为自动注射器配置对应的穿刺针以及穿刺注射深度操作器械,以得到所选模拟穿刺自动注射器;利用所选模拟穿刺自动注射器对相对应所选模拟的穿刺场景进行穿刺综合模拟操作,以生成所选穿刺场景模拟过程;The user training puncture simulation operation selection module is used to select the puncture scene to be simulated through the trainer user interface, and configure the corresponding puncture needle and puncture injection depth operation instrument for the automatic injector according to the selected simulated puncture scene to obtain the selected simulated puncture automatic injector; use the selected simulated puncture automatic injector to perform a comprehensive puncture simulation operation on the corresponding selected simulated puncture scene to generate a simulation process of the selected puncture scene;
穿刺陀螺仪偏差校准模块,用于利用所选模拟穿刺自动注射器内的陀螺仪传感器对所选穿刺场景模拟过程进行穿刺陀螺仪测量处理并上传至计算机处理单元,以得到穿刺模拟过程陀螺仪测量值;利用计算机处理单元对穿刺模拟过程陀螺仪测量值进行神经网络回归偏差估算,得到陀螺仪回归偏差确定性部分;基于陀螺仪回归偏差确定性部分对穿刺模拟过程陀螺仪测量值进行静态偏差校准计算,以得到穿刺过程陀螺仪偏差校准值;The puncture gyroscope deviation calibration module is used to use the gyroscope sensor in the selected simulated puncture automatic syringe to perform puncture gyroscope measurement processing on the selected puncture scene simulation process and upload it to the computer processing unit to obtain the gyroscope measurement value of the puncture simulation process; use the computer processing unit to perform neural network regression deviation estimation on the gyroscope measurement value of the puncture simulation process to obtain the gyroscope regression deviation deterministic part; perform static deviation calibration calculation on the gyroscope measurement value of the puncture simulation process based on the gyroscope regression deviation deterministic part to obtain the gyroscope deviation calibration value of the puncture process;
穿刺训练场景路径模拟生成模块,用于基于穿刺过程陀螺仪偏差校准值对所选穿刺场景模拟过程进行穿刺路径模拟识别分析,以生成所选穿刺场景模拟过程对应的穿刺模拟训练路径;A puncture training scene path simulation generation module is used to perform puncture path simulation identification analysis on the selected puncture scene simulation process based on the gyroscope deviation calibration value of the puncture process, so as to generate a puncture simulation training path corresponding to the selected puncture scene simulation process;
穿刺模拟路径可视化模块,用于利用训练者用户界面对所选穿刺场景模拟过程对应的穿刺模拟训练路径进行穿刺模拟可视化处理,以执行相应的穿刺场景可视化教学过程。The puncture simulation path visualization module is used to use the trainer user interface to perform puncture simulation visualization processing on the puncture simulation training path corresponding to the selected puncture scene simulation process, so as to execute the corresponding puncture scene visualization teaching process.
进一步的,所述用户训练穿刺模拟操作选择模块包括以下功能:Furthermore, the user training puncture simulation operation selection module includes the following functions:
通过训练者用户界面选择需要模拟的穿刺场景,以得到训练所选模拟穿刺场景,其中训练所选模拟穿刺场景包括胸腔穿刺模拟场景、腰椎穿刺模拟场景、腹腔穿刺模拟场景以及骨髓穿刺模拟场景;Select the puncture scene to be simulated through the trainer user interface to obtain the simulated puncture scene selected for training, wherein the simulated puncture scene selected for training includes a thoracic puncture simulation scene, a lumbar puncture simulation scene, an abdominal puncture simulation scene, and a bone marrow puncture simulation scene;
根据训练所选模拟穿刺场景为相应的自动注射器配置对应的穿刺针以及穿刺注射深度操作器械,以得到所选模拟穿刺自动注射器;According to the simulated puncture scenario selected for training, the corresponding automatic injector is equipped with a corresponding puncture needle and a puncture injection depth operation instrument to obtain the selected simulated puncture automatic injector;
对训练所选模拟穿刺场景进行穿刺场景环境参数设定,以得到所选模拟穿刺场景环境参数集;基于所选模拟穿刺场景环境参数集对所选模拟穿刺自动注射器进行设备性能测试调优,得到模拟穿刺设备优化自动注射器;The puncture scene environment parameters are set for the selected simulated puncture scene for training to obtain the selected simulated puncture scene environment parameter set; the device performance test and optimization of the selected simulated puncture automatic injector is performed based on the selected simulated puncture scene environment parameter set to obtain the simulated puncture device optimized automatic injector;
对模拟穿刺设备优化自动注射器进行模拟穿刺操作流程设计,以生成模拟穿刺操作流程设计步骤文档;Design the simulated puncture operation process for the simulated puncture device optimized automatic syringe to generate the simulated puncture operation process design step document;
基于模拟穿刺操作流程设计步骤文档对训练所选模拟穿刺场景进行穿刺综合模拟操作,以生成所选穿刺场景模拟过程。Based on the simulated puncture operation process design step document, a comprehensive puncture simulation operation is performed on the simulated puncture scenario selected for training to generate a simulation process for the selected puncture scenario.
进一步的,所述穿刺陀螺仪偏差校准模块包括以下功能:Furthermore, the puncture gyroscope deviation calibration module includes the following functions:
利用所选模拟穿刺自动注射器内的陀螺仪传感器对所选穿刺场景模拟过程进行穿刺陀螺仪测量处理,以得到穿刺模拟过程陀螺仪测量值;通过无线传输技术将陀螺仪传感器上实时测量的穿刺模拟过程陀螺仪测量值上传至计算机处理单元;Using the gyro sensor in the selected simulated puncture automatic syringe to perform puncture gyro measurement processing on the selected puncture scene simulation process to obtain the gyro measurement value of the puncture simulation process; uploading the gyro measurement value of the puncture simulation process measured in real time on the gyro sensor to the computer processing unit through wireless transmission technology;
利用计算机处理单元获取陀螺仪传感器对应穿刺模拟过程的陀螺仪坐标系,并基于陀螺仪坐标系对穿刺模拟过程陀螺仪测量值进行测量值坐标系转换,以得到在陀螺仪坐标系下对应的陀螺仪测量值;Using a computer processing unit to obtain a gyro coordinate system of the gyro sensor corresponding to the puncture simulation process, and based on the gyro coordinate system, converting the gyro measurement value of the puncture simulation process into a measurement value coordinate system to obtain a gyro measurement value corresponding to the gyro coordinate system;
基于穿刺模拟过程的陀螺仪坐标系对所选穿刺场景模拟过程内对应的陀螺仪传感器进行角速度矢量统计分析,得到在陀螺仪坐标系下对应的陀螺仪实际角速度矢量;Based on the gyro coordinate system of the puncture simulation process, a statistical analysis of the angular velocity vector of the gyro sensor corresponding to the selected puncture scene simulation process is performed to obtain the actual angular velocity vector of the gyro corresponding to the gyro coordinate system;
根据在陀螺仪坐标系下对应的陀螺仪测量值以及陀螺仪实际角速度矢量对所选穿刺场景模拟过程内对应的陀螺仪传感器进行陀螺仪误差建模,以生成穿刺模拟陀螺仪误差数学模型;Performing gyroscope error modeling on the corresponding gyroscope sensor in the selected puncture scenario simulation process according to the corresponding gyroscope measurement value in the gyroscope coordinate system and the actual gyroscope angular velocity vector to generate a puncture simulation gyroscope error mathematical model;
通过为陀螺仪传感器配置静止条件,并基于静止条件对穿刺模拟陀螺仪误差数学模型内的陀螺仪偏差部分进行零阶校准处理,得到陀螺仪偏差零阶校准部分;通过电阻元件设置虚拟陀螺仪阵列与陀螺仪传感器组成陀螺仪虚拟模块,其中每个陀螺仪虚拟模块由三个方向轴上的正交陀螺仪组成,并基于陀螺仪虚拟模块对陀螺仪偏差零阶校准部分进行神经网络回归协助校准估算,得到陀螺仪回归偏差确定性部分;The zero-order calibration part of the gyroscope deviation is obtained by configuring a stationary condition for the gyroscope sensor and performing a zero-order calibration process on the gyroscope deviation part in the mathematical model of the puncture simulation gyroscope error based on the stationary condition; a virtual gyroscope array and a gyroscope sensor are set up through a resistor element to form a gyroscope virtual module, wherein each gyroscope virtual module is composed of orthogonal gyroscopes on three directional axes, and a neural network regression-assisted calibration estimation is performed on the zero-order calibration part of the gyroscope deviation based on the gyroscope virtual module to obtain a gyroscope regression deviation deterministic part;
基于陀螺仪回归偏差确定性部分对在陀螺仪坐标系下对应的陀螺仪测量值进行静态偏差校准计算,以得到穿刺过程陀螺仪偏差校准值。Based on the deterministic part of the gyroscope regression deviation, a static deviation calibration calculation is performed on the corresponding gyroscope measurement value in the gyroscope coordinate system to obtain the gyroscope deviation calibration value of the puncture process.
进一步的,所述的穿刺模拟陀螺仪误差数学模型具体为:Furthermore, the puncture simulation gyroscope error mathematical model is specifically:
; ;
式中,为在陀螺仪坐标系下对应的陀螺仪测量值,为在陀螺仪坐标系下对应的陀螺仪实际角速度矢量,为陀螺仪非对角元素和比例因子误差的矩阵,为陀螺仪偏差部分,为零均值高斯白噪声。In the formula, In the gyroscope coordinate system The corresponding gyroscope measurements are: In the gyroscope coordinate system The corresponding actual angular velocity vector of the gyroscope is, is the matrix of gyroscope off-diagonal elements and scale factor errors, is the gyro bias part, is zero-mean Gaussian white noise.
进一步的,所述的基于静止条件对穿刺模拟陀螺仪误差数学模型内的陀螺仪偏差部分进行零阶校准处理包括:Furthermore, the zero-order calibration process of the gyroscope deviation part in the puncture simulation gyroscope error mathematical model based on the static condition includes:
基于静止条件对穿刺模拟陀螺仪误差数学模型在陀螺仪一系列静止时进行相关参数测量,得到在陀螺仪一系列静止条件下对应的角速度测量矢量以及高斯测量白噪声;Based on the static condition, the mathematical model of the puncture simulation gyroscope error is used to measure the relevant parameters when the gyroscope is static for a series of times, and the corresponding angular velocity measurement vector and Gaussian measurement white noise under a series of static conditions of the gyroscope are obtained;
根据在陀螺仪一系列静止条件下对应的角速度测量矢量以及高斯测量白噪声进行误差模型重构,以得到在静止条件下的陀螺仪误差重构模型:The error model is reconstructed according to the angular velocity measurement vector corresponding to a series of stationary conditions of the gyroscope and the Gaussian measurement white noise to obtain the gyroscope error reconstruction model under stationary conditions:
; ;
式中,为在第次静止条件下对应的陀螺仪测量值,为在第次静止条件下对应的角速度测量矢量,为在第次静止条件下对应的陀螺仪估计偏差,为在第次静止条件下对应的高斯测量白噪声;In the formula, For the The corresponding gyroscope measurements under substationary conditions, For the The corresponding angular velocity measurement vector under sub-stationary conditions is: For the The corresponding gyroscope estimated bias under substationary conditions is, For the The corresponding Gaussian measurement white noise under substationary conditions;
通过零阶校准方法假设高斯测量白噪声趋于零均值,则陀螺仪测量值对应趋于零,并将上式的两边取期望算子进行零阶校准处理,得到陀螺仪偏差零阶校准部分:By assuming that the Gaussian measurement white noise tends to zero mean through the zero-order calibration method, the gyroscope measurement value tends to zero accordingly, and the expected operator is taken on both sides of the above formula for zero-order calibration processing to obtain the zero-order calibration part of the gyroscope bias:
; ;
其中是陀螺仪偏差零阶校准部分。in It is the zero-order calibration part of the gyroscope bias.
进一步的,所述的基于陀螺仪虚拟模块对陀螺仪偏差零阶校准部分进行神经网络回归协助校准估算包括:Furthermore, the neural network regression-assisted calibration estimation of the gyroscope deviation zero-order calibration part based on the gyroscope virtual module includes:
通过陀螺仪虚拟模块设计神经网络回归协助校准方法,其中神经网络回归协助校准方法为增加陀螺仪输入通道协助校准方法或者增加真实和虚拟陀螺仪训练数据协助校准方法;A neural network regression assisted calibration method is designed through a gyroscope virtual module, wherein the neural network regression assisted calibration method is a calibration method assisted by adding a gyroscope input channel or a calibration method assisted by adding real and virtual gyroscope training data;
基于神经网络回归协助校准方法对陀螺仪偏差零阶校准部分进行协助校准估算,得到陀螺仪回归偏差确定性部分。Based on the neural network regression assisted calibration method, the zero-order calibration part of the gyroscope deviation is assisted in calibration estimation to obtain the deterministic part of the gyroscope regression deviation.
进一步的,所述的基于增加陀螺仪输入通道协助校准方法对陀螺仪偏差零阶校准部分进行协助校准估算包括:Furthermore, the method for assisting calibration based on adding a gyroscope input channel to assist calibration includes:
通过增加陀螺仪输入通道协助校准方法设计一个卷积神经网络架构,其中卷积神经网络架构由卷积层、LeakyReLU激活函数以及最大池化层组成,并通过在卷积层输入每个陀螺仪模块特征:,其中为陀螺仪虚拟模块的数量,为窗口大小;A convolutional neural network architecture is designed by adding a gyroscope input channel to assist in the calibration method. The convolutional neural network architecture consists of a convolutional layer, a LeakyReLU activation function, and a maximum pooling layer, and each gyroscope module feature is input into the convolutional layer: ,in is the number of gyroscope virtual modules, is the window size;
在第个卷积层中网络输出,其中为窗口核大小,为第个窗口核处的陀螺仪偏差值,为步幅,为第个窗口核处的权重;根据第个卷积层中网络输出可将LeakyReLU激活函数定义为;In the The network output in the convolutional layer ,in is the window kernel size, For the The gyroscope bias value at the window kernel, is the stride, For the The weight at the window kernel; according to the The network output in the convolutional layer can be defined as the LeakyReLU activation function ;
基于第个卷积层中网络输出在最大池化层中进行池化计算,其中为池化大小,并将其输入展平为一个二维张量,以计算得出第一个全连接层,其中为第一个全连接层的权重,为第一个全连接层的偏差;Based on The network output in the convolutional layer is pooled in the maximum pooling layer. ,in is the pooling size and flattens its input into a 2D tensor to calculate the first fully connected layer ,in is the weight of the first fully connected layer, is the bias of the first fully connected layer;
通过引入LeakyReLU激活函数对与之连接的第二个全连接层进行重复计算,以得到最终神经网络回归输出,其中和分别为第二个全连接层的权重和偏差;通过均方误差损失函数计算神经网络回归损失,其中为训练样本总数;By introducing the LeakyReLU activation function, the second fully connected layer connected to it is repeatedly calculated to obtain the final neural network regression output ,in and are the weights and biases of the second fully connected layer respectively; the neural network regression loss is calculated by the mean square error loss function ,in is the total number of training samples;
通过输入陀螺仪偏差零阶校准部分进行协助校准估算,得到陀螺仪回归偏差确定性部分:By inputting the zero-order calibration part of the gyroscope bias to assist in the calibration estimation, the deterministic part of the gyroscope regression bias is obtained:
。 .
进一步的,所述的基于增加真实和虚拟陀螺仪训练数据协助校准方法对陀螺仪偏差零阶校准部分进行协助校准估算包括:Furthermore, the method for assisting calibration based on adding real and virtual gyroscope training data to assist in calibration estimation of the gyroscope bias zero-order calibration part includes:
收集陀螺仪虚拟模块的真实陀螺仪测量数据,其中、和分别代表陀螺仪虚拟模块内在三个方向轴正交陀螺仪上的真实测量读数;Collecting real gyroscope measurements from the gyroscope virtual module ,in , and They represent the actual measurement readings of the orthogonal gyroscopes on the three directional axes within the gyroscope virtual module;
通过模拟生成陀螺仪虚拟模块的虚拟陀螺仪测量数据,其中、和分别代表陀螺仪虚拟模块内在三个方向轴正交陀螺仪上的虚拟测量读数;Generate virtual gyroscope measurement data from the gyroscope virtual module through simulation ,in , and They represent the virtual measurement readings of the gyroscopes on the three orthogonal axes in the gyroscope virtual module;
将真实陀螺仪测量数据以及虚拟陀螺仪测量数据合并成一个训练集,并将其输入至卷积神经网络上进行神经网络回归训练,以网络输出在三个方向轴正交陀螺仪上的陀螺仪偏差值,其中为第层的权重矩阵,为第层的神经网络激活值,为第层的偏置项;Combine the real gyroscope measurement data and the virtual gyroscope measurement data into a training set , and input it into the convolutional neural network for neural network regression training, so that the network outputs the gyroscope deviation values on the three-axis orthogonal gyroscope ,in For the The weight matrix of the layer, For the The neural network activation value of the layer, For the The bias term of the layer;
根据在三个方向轴正交陀螺仪上的陀螺仪偏差值计算神经网络回归损失:The neural network regression loss is calculated based on the gyroscope bias values on the three orthogonal gyroscope axes:
; ;
其中为训练样本总数,为三个正交陀螺仪的索引;in is the total number of training samples, are the indices of the three orthogonal gyroscopes;
通过反向传播方法更新优化权重矩阵和偏置项:Update and optimize the weight matrix and bias terms through the back-propagation method:
; ;
; ;
其中为学习率;in is the learning rate;
通过输入陀螺仪偏差零阶校准部分进行协助校准估算,得到陀螺仪回归偏差确定性部分:By inputting the zero-order calibration part of the gyroscope bias to assist in the calibration estimation, the deterministic part of the gyroscope regression bias is obtained:
。 .
进一步的,所述穿刺训练场景路径模拟生成模块包括以下功能:Furthermore, the puncture training scenario path simulation generation module includes the following functions:
通过穿刺过程陀螺仪偏差校准值获取所选穿刺场景模拟过程在不同时间点位处对应的陀螺仪校准测量值;Obtaining gyroscope calibration measurement values corresponding to different time points of the selected puncture scenario simulation process through gyroscope deviation calibration values during the puncture process;
基于不同时间点位处对应的陀螺仪校准测量值对相对应的所选穿刺场景模拟过程进行三维虚拟空间场景构建,以生成所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型;Based on the corresponding gyroscope calibration measurement values at different time points, a three-dimensional virtual space scene is constructed for the corresponding selected puncture scene simulation process to generate a gyroscope puncture three-dimensional virtual space model corresponding to the selected puncture simulation process;
对所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型进行穿刺路径动态模拟识别分析,以生成所选穿刺场景模拟过程对应的穿刺模拟训练路径。The gyroscope puncture three-dimensional virtual space model corresponding to the selected puncture simulation process is subjected to dynamic simulation recognition analysis of the puncture path to generate a puncture simulation training path corresponding to the selected puncture scene simulation process.
进一步的,所述的对所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型进行穿刺路径动态模拟识别分析包括:Furthermore, the dynamic simulation and identification analysis of the puncture path of the gyroscope puncture three-dimensional virtual space model corresponding to the selected puncture simulation process includes:
对所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型进行穿刺关键节点标注,得到所选穿刺模拟过程对应的陀螺仪穿刺关键节点;Annotating key puncture nodes of the gyroscope puncture three-dimensional virtual space model corresponding to the selected puncture simulation process to obtain key puncture nodes of the gyroscope puncture corresponding to the selected puncture simulation process;
对所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型进行物理几何约束分析,以得到所选穿刺模拟过程对应的陀螺仪穿刺物理几何约束条件;Performing physical geometric constraint analysis on the gyroscopic puncture three-dimensional virtual space model corresponding to the selected puncture simulation process to obtain the gyroscopic puncture physical geometric constraint conditions corresponding to the selected puncture simulation process;
基于所选穿刺模拟过程对应的陀螺仪穿刺物理几何约束条件对相对应的陀螺仪穿刺关键节点进行穿刺路径预设跟踪分析,以生成所选穿刺模拟过程对应的陀螺仪穿刺约束预设路径;Based on the gyroscope puncture physical geometric constraint conditions corresponding to the selected puncture simulation process, a puncture path preset tracking analysis is performed on the corresponding gyroscope puncture key nodes to generate a gyroscope puncture constraint preset path corresponding to the selected puncture simulation process;
基于所选穿刺场景模拟过程对所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型进行穿刺过程力学仿真分析,生成所选穿刺模拟过程对应的穿刺力学反应仿真场;Based on the selected puncture scene simulation process, a puncture process mechanical simulation analysis is performed on the gyroscope puncture three-dimensional virtual space model corresponding to the selected puncture simulation process to generate a puncture mechanical response simulation field corresponding to the selected puncture simulation process;
根据所选穿刺模拟过程对应的穿刺力学反应仿真场对所选穿刺模拟过程对应的陀螺仪穿刺约束预设路径进行穿刺路径动态模拟识别分析,以生成所选穿刺场景模拟过程对应的穿刺模拟训练路径。According to the puncture mechanical response simulation field corresponding to the selected puncture simulation process, the puncture path dynamic simulation identification analysis is performed on the gyroscope puncture constraint preset path corresponding to the selected puncture simulation process to generate a puncture simulation training path corresponding to the selected puncture scene simulation process.
本发明的有益效果:Beneficial effects of the present invention:
本发明所提出的基于自动注射器的综合穿刺模拟系统,整体上由用户训练穿刺模拟操作选择模块、穿刺陀螺仪偏差校准模块、穿刺训练场景路径模拟生成模块以及穿刺模拟路径可视化模块组成,与现有技术相比,本申请的有益效果在于通过使用训练者用户界面选择需要模拟的穿刺场景,为用户提供了个性化和针对性的穿刺模拟训练体验,该步骤的关键在于它允许训练者根据自身需求选择特定的穿刺类型,例如胸腔、腰椎、腹腔和骨髓穿刺等,此灵活性不仅可以增强学习者的主动参与感,还能确保在所需的实际场景中进行训练,从而提高学习的有效性和针对性。通过根据所选模拟的穿刺场景为自动注射器配置对应的穿刺针以及穿刺注射深度操作器械,关键在于为不同的穿刺类型选择合适的穿刺针和注射深度操作器械,这个步骤的有效性体现在设备的精准性和适应性上,通过使用针对特定场景的设备,学员可以在模拟环境中体验到更接近真实操作的感觉,合适的器械配置不仅确保了训练的安全性,还使得学习者能够掌握不同穿刺技术的特点和要求,从而提升训练效果。同时,通过利用所选模拟穿刺自动注射器对相对应所选模拟的穿刺场景进行穿刺综合模拟操作,能够为学员提供了一个全面的实践机会,这一步骤的关键体现在为学员提供了一个可以将理论与实践相结合的平台,让其在真实的模拟场景中进行操作练习,通过综合模拟,学员能够体验到不同穿刺技术的应用,进一步巩固其穿刺的技能和知识,从而为后续的穿刺陀螺仪偏差校准处理过程提供了穿刺数据支持。其次,通过使用所选模拟穿刺自动注射器内的陀螺仪传感器对所选穿刺场景模拟过程进行穿刺陀螺仪测量处理,能够有效捕捉到穿刺模拟过程中的陀螺仪动态信息,这些陀螺仪测量值反映了穿刺模拟过程中自动注射器设备的姿态变化,为后续的陀螺仪偏差数据分析奠定了基础,还通过无线传输技术实时上传这些数据至计算机处理单元,保证了数据传输的及时性和准确性,这种实时性能够确保在穿刺模拟过程中立即识别和记录任何异常情况,进而提高穿刺操作的安全性与有效性。通过使用计算机处理单元计算机处理单元对穿刺模拟过程陀螺仪测量值进行神经网络回归偏差估算,能够有效地对陀螺仪的偏差部分进行修正,还通过创建虚拟陀螺仪阵列,能够进一步增强偏差校准的精确性与稳定性,采用神经网络回归方法进行校准估算,可以实现对复杂偏差模式的识别与校正,从而显著提升陀螺仪测量的准确性,此步骤不仅能够降低陀螺仪设备使用中的误差,还能提升穿刺模拟的可重复性和可靠性,使得在实际应用中能够得到更加一致的结果。还通过基于陀螺仪回归偏差确定性部分对在陀螺仪坐标系下对应的陀螺仪测量值进行静态偏差校准计算,能够获得穿刺过程中的陀螺仪偏差校准值,它确保了之前步骤中所积累的数据和模型能够被有效应用到实际场景中,通过对静态偏差的精准校正,不仅能够提高陀螺仪测量的准确性,还能增强穿刺操作的安全性,从而能够有效地校准陀螺仪测量过程当中的误差项。然后,通过先前校准计算得到的穿刺模拟过程中的陀螺仪偏差校准值对相对应的所选穿刺场景模拟过程进行穿刺路径动态模拟识别分析,这一过程能够识别和生成最佳的穿刺路径,为训练者医疗培训提供科学指导,通过模拟和分析不同的路径,可以更好地了解穿刺操作中的最佳实践和潜在挑战,从而制定更加合理的培训方案,这种动态模拟不仅可以反映实际操作中的复杂性,还能够实时调整路径,根据不同的情境和患者情况提供个性化的指导,由此产生的穿刺模拟训练路径,可以作为医务人员培训的参考,为其提供明确的操作步骤与技巧,从而能够提高了穿刺路径识别模拟的精确度。最后,通过利用训练者用户界面对穿刺模拟训练路径进行可视化处理,这一步骤通过图形化的展示方式极大地增强了穿刺模拟学习的直观性和互动性,通过可视化技术,学员可以清晰地看到穿刺过程中的每一个细节,进一步理解操作的要点与难点,这种视觉化的学习工具不仅能够吸引学员的注意力,还能提升他们的学习兴趣和参与度,可视化教学过程使得复杂的穿刺技术变得更加易于理解和掌握,使得整个穿刺模拟过程更加高效和有效。The comprehensive puncture simulation system based on automatic syringe proposed in the present invention is composed of a user training puncture simulation operation selection module, a puncture gyroscope deviation calibration module, a puncture training scene path simulation generation module and a puncture simulation path visualization module. Compared with the prior art, the beneficial effect of the present application is that by using the trainer user interface to select the puncture scene to be simulated, it provides users with a personalized and targeted puncture simulation training experience. The key to this step is that it allows trainers to select specific puncture types according to their own needs, such as thoracic, lumbar, abdominal and bone marrow punctures, etc. This flexibility can not only enhance the learners' active participation, but also ensure that training is carried out in the required actual scenarios, thereby improving the effectiveness and pertinence of learning. By configuring the corresponding puncture needle and puncture injection depth operation device for the automatic syringe according to the selected simulated puncture scene, the key is to select the appropriate puncture needle and injection depth operation device for different puncture types. The effectiveness of this step is reflected in the accuracy and adaptability of the equipment. By using equipment for specific scenarios, trainees can experience a feeling closer to real operation in a simulated environment. The appropriate equipment configuration not only ensures the safety of training, but also enables learners to master the characteristics and requirements of different puncture techniques, thereby improving the training effect. At the same time, by using the selected simulated puncture automatic syringe to perform comprehensive puncture simulation operations on the corresponding selected simulated puncture scene, it can provide trainees with a comprehensive practice opportunity. The key of this step is to provide trainees with a platform that can combine theory with practice, allowing them to practice operations in real simulated scenarios. Through comprehensive simulation, trainees can experience the application of different puncture techniques and further consolidate their puncture skills and knowledge, thereby providing puncture data support for the subsequent puncture gyroscope deviation calibration process. Secondly, by using the gyro sensor in the selected simulated puncture automatic syringe to perform puncture gyro measurement processing on the selected puncture scene simulation process, the dynamic information of the gyro in the puncture simulation process can be effectively captured. These gyro measurement values reflect the posture changes of the automatic syringe device during the puncture simulation process, laying the foundation for the subsequent gyro deviation data analysis. The data are also uploaded to the computer processing unit in real time through wireless transmission technology, ensuring the timeliness and accuracy of data transmission. This real-time performance can ensure that any abnormal situation is immediately identified and recorded during the puncture simulation process, thereby improving the safety and effectiveness of the puncture operation. By using the computer processing unit to perform neural network regression deviation estimation on the gyro measurement values of the puncture simulation process, the deviation part of the gyroscope can be effectively corrected. By creating a virtual gyroscope array, the accuracy and stability of the deviation calibration can be further enhanced. The use of the neural network regression method for calibration estimation can realize the recognition and correction of complex deviation patterns, thereby significantly improving the accuracy of gyroscope measurement. This step can not only reduce the error in the use of gyroscope equipment, but also improve the repeatability and reliability of puncture simulation, so that more consistent results can be obtained in practical applications. By performing static deviation calibration calculation on the corresponding gyroscope measurement values in the gyroscope coordinate system based on the deterministic part of the gyroscope regression deviation, the gyroscope deviation calibration value during the puncture process can be obtained, which ensures that the data and models accumulated in the previous steps can be effectively applied to actual scenarios. Through precise correction of static deviation, not only the accuracy of gyroscope measurement can be improved, but also the safety of puncture operation can be enhanced, thereby effectively calibrating the error terms in the gyroscope measurement process. Then, the gyroscope deviation calibration value in the puncture simulation process obtained by the previous calibration calculation is used to perform dynamic simulation and identification analysis of the puncture path for the corresponding selected puncture scene simulation process. This process can identify and generate the best puncture path, and provide scientific guidance for trainers' medical training. By simulating and analyzing different paths, we can better understand the best practices and potential challenges in puncture operations, so as to formulate more reasonable training plans. This dynamic simulation can not only reflect the complexity of actual operations, but also adjust the path in real time, and provide personalized guidance according to different scenarios and patient conditions. The resulting puncture simulation training path can be used as a reference for medical staff training, providing them with clear operating steps and techniques, thereby improving the accuracy of puncture path recognition simulation. Finally, the puncture simulation training path is visualized by using the trainer user interface. This step greatly enhances the intuitiveness and interactivity of puncture simulation learning through graphical display. Through visualization technology, trainees can clearly see every detail of the puncture process and further understand the key points and difficulties of the operation. This visual learning tool can not only attract the trainees' attention, but also enhance their learning interest and participation. The visualized teaching process makes complex puncture techniques easier to understand and master, making the entire puncture simulation process more efficient and effective.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
通过阅读参照以下附图所作的对非限制性实施所作的详细描述,本发明的其它特征、目的和优点将会变得更明显:Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments thereof made with reference to the following drawings:
图1为本发明基于自动注射器的综合穿刺模拟系统的模块示意图;FIG1 is a schematic diagram of a module of a comprehensive puncture simulation system based on an automatic injector according to the present invention;
图2为图1中用户训练穿刺模拟操作选择模块的功能流程示意图;FIG2 is a schematic diagram of the functional flow of the user training puncture simulation operation selection module in FIG1 ;
图3为图1中穿刺陀螺仪偏差校准模块的功能流程示意图;FIG3 is a schematic diagram of the functional flow of the puncture gyroscope deviation calibration module in FIG1 ;
图4为本发明人体胸腔部位穿刺模拟的深度示意图;FIG4 is a schematic diagram of the depth of the human chest puncture simulation of the present invention;
图5为本发明人体腰椎部位穿刺模拟的深度示意图;FIG5 is a schematic diagram of the depth of the lumbar puncture simulation of the present invention;
图6为本发明人体腹腔部位穿刺模拟的深度示意图;FIG6 is a schematic diagram of the depth of the human abdominal cavity puncture simulation of the present invention;
图7为本发明人体骨髓部位穿刺模拟的深度示意图。FIG. 7 is a schematic diagram of the depth of the human bone marrow puncture simulation according to the present invention.
具体实施方式DETAILED DESCRIPTION
下面结合附图对本发明的技术系统进行清楚、完整的描述,显然,所描述的实施例是本发明的一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域所属的技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical system of the present invention is described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by technicians in this field without creative work are within the scope of protection of the present invention.
为实现上述目的,请参阅图1至图3,本发明提供了一种基于自动注射器的综合穿刺模拟系统,所述系统包括以下模块:To achieve the above object, please refer to Figures 1 to 3. The present invention provides a comprehensive puncture simulation system based on an automatic syringe, and the system includes the following modules:
用户训练穿刺模拟操作选择模块,用于通过训练者用户界面选择需要模拟的穿刺场景,并根据所选模拟的穿刺场景为自动注射器配置对应的穿刺针以及穿刺注射深度操作器械,以得到所选模拟穿刺自动注射器;利用所选模拟穿刺自动注射器对相对应所选模拟的穿刺场景进行穿刺综合模拟操作,以生成所选穿刺场景模拟过程;The user training puncture simulation operation selection module is used to select the puncture scene to be simulated through the trainer user interface, and configure the corresponding puncture needle and puncture injection depth operation instrument for the automatic injector according to the selected simulated puncture scene to obtain the selected simulated puncture automatic injector; use the selected simulated puncture automatic injector to perform a comprehensive puncture simulation operation on the corresponding selected simulated puncture scene to generate a simulation process of the selected puncture scene;
穿刺陀螺仪偏差校准模块,用于利用所选模拟穿刺自动注射器内的陀螺仪传感器对所选穿刺场景模拟过程进行穿刺陀螺仪测量处理并上传至计算机处理单元,以得到穿刺模拟过程陀螺仪测量值;利用计算机处理单元对穿刺模拟过程陀螺仪测量值进行神经网络回归偏差估算,得到陀螺仪回归偏差确定性部分;基于陀螺仪回归偏差确定性部分对穿刺模拟过程陀螺仪测量值进行静态偏差校准计算,以得到穿刺过程陀螺仪偏差校准值;The puncture gyroscope deviation calibration module is used to use the gyroscope sensor in the selected simulated puncture automatic syringe to perform puncture gyroscope measurement processing on the selected puncture scene simulation process and upload it to the computer processing unit to obtain the gyroscope measurement value of the puncture simulation process; use the computer processing unit to perform neural network regression deviation estimation on the gyroscope measurement value of the puncture simulation process to obtain the gyroscope regression deviation deterministic part; perform static deviation calibration calculation on the gyroscope measurement value of the puncture simulation process based on the gyroscope regression deviation deterministic part to obtain the gyroscope deviation calibration value of the puncture process;
穿刺训练场景路径模拟生成模块,用于基于穿刺过程陀螺仪偏差校准值对所选穿刺场景模拟过程进行穿刺路径模拟识别分析,以生成所选穿刺场景模拟过程对应的穿刺模拟训练路径;A puncture training scene path simulation generation module is used to perform puncture path simulation identification analysis on the selected puncture scene simulation process based on the gyroscope deviation calibration value of the puncture process, so as to generate a puncture simulation training path corresponding to the selected puncture scene simulation process;
穿刺模拟路径可视化模块,用于利用训练者用户界面对所选穿刺场景模拟过程对应的穿刺模拟训练路径进行穿刺模拟可视化处理,以执行相应的穿刺场景可视化教学过程。The puncture simulation path visualization module is used to use the trainer user interface to perform puncture simulation visualization processing on the puncture simulation training path corresponding to the selected puncture scene simulation process, so as to execute the corresponding puncture scene visualization teaching process.
本发明实施例中,请参考图1所示,为本发明基于自动注射器的综合穿刺模拟系统的模块示意图,在本实例中,所述基于自动注射器的综合穿刺模拟系统包括以下模块:In the embodiment of the present invention, please refer to FIG. 1, which is a schematic diagram of the modules of the comprehensive puncture simulation system based on the automatic syringe of the present invention. In this example, the comprehensive puncture simulation system based on the automatic syringe includes the following modules:
S1:用户训练穿刺模拟操作选择模块,用于通过训练者用户界面选择需要模拟的穿刺场景,并根据所选模拟的穿刺场景为自动注射器配置对应的穿刺针以及穿刺注射深度操作器械,以得到所选模拟穿刺自动注射器;利用所选模拟穿刺自动注射器对相对应所选模拟的穿刺场景进行穿刺综合模拟操作,以生成所选穿刺场景模拟过程;S1: A user training puncture simulation operation selection module is used to select a puncture scene to be simulated through a trainer user interface, and configure a corresponding puncture needle and a puncture injection depth operation device for the automatic injector according to the selected simulated puncture scene to obtain the selected simulated puncture automatic injector; use the selected simulated puncture automatic injector to perform a comprehensive puncture simulation operation on the corresponding selected simulated puncture scene to generate a simulation process of the selected puncture scene;
在本发明实施例中,通过使用系统内的训练者用户界面选择需要模拟的穿刺场景,其中包括胸腔穿刺(如图4所示)、腰椎穿刺(如图5所示)、腹腔穿刺(如图6所示)和骨髓穿刺(如图7所示)等,用户通过交互式界面进行场景选择,界面可实时显示每种场景的详细信息与适用指示,从而选取得到训练所选模拟的穿刺场景。通过根据先前训练所选定的模拟穿刺场景为其相对应的自动注射器配置相应的穿刺注射深度操作器械及穿刺针,针对每种穿刺场景,确定穿刺针的类型和尺寸,以及注射深度操作器械的参数,例如胸腔穿刺使用胶管穿刺针、5ml注射器和50ml注射器;腹腔穿刺也使用胶管穿刺针、5ml注射器和50ml注射器;腹腔穿刺使用腰椎穿刺针、5ml注射器、测压管、试管;而骨髓穿刺使用骨髓穿刺针、5ml注射器、20ml注射器,这一过程使用专业的医疗器械配置工具,确保所有部件符合医疗标准及技术要求,配置完成后,自动注射器与穿刺器械进行组装,从而得到所选模拟穿刺自动注射器。然后,通过使用配置组装好的所选模拟穿刺自动注射器对先前所选定的训练所选模拟穿刺场景进行穿刺的综合模拟操作,以通过自动注射器执行整个穿刺过程,实时监测各项参数和反馈信息,并通过使用虚拟现实技术增强模拟体验,通过模拟系统生成的图像与声音,使操作更具沉浸感与真实性,完成后,记录模拟过程中的所有数据,为后续的分析与评估提供依据,确保训练的有效性与科学性,最终记录生成所选穿刺场景模拟过程。In an embodiment of the present invention, the trainer user interface in the system is used to select the puncture scene to be simulated, including thoracic puncture (as shown in FIG. 4 ), lumbar puncture (as shown in FIG. 5 ), abdominal puncture (as shown in FIG. 6 ) and bone marrow puncture (as shown in FIG. 7 ), etc. The user selects the scene through an interactive interface, and the interface can display detailed information and applicable instructions for each scene in real time, so as to select the puncture scene selected for simulation in training. By configuring the corresponding automatic syringe with the corresponding puncture injection depth operation instrument and puncture needle according to the simulated puncture scenario selected in the previous training, the type and size of the puncture needle and the parameters of the injection depth operation instrument are determined for each puncture scenario. For example, thoracic puncture uses a hose puncture needle, a 5ml syringe and a 50ml syringe; abdominal puncture also uses a hose puncture needle, a 5ml syringe and a 50ml syringe; abdominal puncture uses a lumbar puncture needle, a 5ml syringe, a pressure measuring tube, and a test tube; and bone marrow puncture uses a bone marrow puncture needle, a 5ml syringe, and a 20ml syringe. This process uses professional medical device configuration tools to ensure that all components meet medical standards and technical requirements. After the configuration is completed, the automatic syringe is assembled with the puncture instrument to obtain the selected simulated puncture automatic syringe. Then, by using the configured and assembled selected simulated puncture automatic syringe, a comprehensive simulation operation of puncture is performed on the previously selected simulated puncture scene for training, so as to execute the entire puncture process through the automatic syringe, monitor various parameters and feedback information in real time, and enhance the simulation experience by using virtual reality technology. The images and sounds generated by the simulation system make the operation more immersive and realistic. After completion, all data in the simulation process are recorded to provide a basis for subsequent analysis and evaluation, ensure the effectiveness and scientificity of the training, and finally record and generate the simulation process of the selected puncture scene.
其中,所述的自动注射器包括外壳和滑动配合于所述外壳内的推拉杆,所述推拉杆前端与所述外壳内壁密封滑动连接,从而在所述推拉杆的前端面与所述外壳的前端壁之间形成长度可调的容纳腔室,在所述外壳的前端设有与所述容纳腔室连通的注射接口,所述注射接口能够配置相应的穿刺针,例如,本发明中的胶管穿刺针、腰椎穿刺针以及骨髓穿刺针,在所述外壳的后端具有开口供所述推拉杆置入,在所述推拉杆上沿长度方向设有电阻元件,所述电阻元件被电性连接至检测电路,另外,所述的电阻元件能够与本发明所使用的陀螺仪传感器组成对应包含在三个方向轴上正交陀螺仪的陀螺仪虚拟模块,从而能够将陀螺仪虚拟模块实时监测的陀螺仪测量值经过所述检测电路传输至与陀螺仪传感器电性连接的计算机处理单元中。Among them, the automatic injector includes a shell and a push-pull rod slidably fitted in the shell, the front end of the push-pull rod is sealed and slidably connected to the inner wall of the shell, so that a length-adjustable accommodating chamber is formed between the front end surface of the push-pull rod and the front end wall of the shell, and an injection interface connected to the accommodating chamber is provided at the front end of the shell, and the injection interface can be configured with a corresponding puncture needle, for example, the hose puncture needle, lumbar puncture needle and bone marrow puncture needle in the present invention. An opening is provided at the rear end of the shell for the push-pull rod to be inserted, and a resistor element is provided on the push-pull rod along the length direction, and the resistor element is electrically connected to the detection circuit. In addition, the resistor element can correspond to the gyroscope sensor used in the present invention to form a gyroscope virtual module containing orthogonal gyroscopes on three directional axes, so that the gyroscope measurement value monitored in real time by the gyroscope virtual module can be transmitted to the computer processing unit electrically connected to the gyroscope sensor through the detection circuit.
S2:穿刺陀螺仪偏差校准模块,用于利用所选模拟穿刺自动注射器内的陀螺仪传感器对所选穿刺场景模拟过程进行穿刺陀螺仪测量处理并上传至计算机处理单元,以得到穿刺模拟过程陀螺仪测量值;利用计算机处理单元对穿刺模拟过程陀螺仪测量值进行神经网络回归偏差估算,得到陀螺仪回归偏差确定性部分;基于陀螺仪回归偏差确定性部分对穿刺模拟过程陀螺仪测量值进行静态偏差校准计算,以得到穿刺过程陀螺仪偏差校准值;S2: a puncture gyroscope deviation calibration module, which is used to perform puncture gyroscope measurement processing on the selected puncture scene simulation process using the gyroscope sensor in the selected simulated puncture automatic syringe and upload it to the computer processing unit to obtain the gyroscope measurement value of the puncture simulation process; use the computer processing unit to perform neural network regression deviation estimation on the gyroscope measurement value of the puncture simulation process to obtain the gyroscope regression deviation deterministic part; perform static deviation calibration calculation on the gyroscope measurement value of the puncture simulation process based on the gyroscope regression deviation deterministic part to obtain the gyroscope deviation calibration value of the puncture process;
在本发明实施例中,通过使用先前配置好的所选模拟穿刺自动注射器内嵌有的陀螺仪传感器实时监测所选穿刺场景模拟过程中的陀螺仪姿态变化,在穿刺模拟过程中,陀螺仪传感器收集并记录陀螺仪测量值,包括角速度和加速度数据,从而得到穿刺模拟过程陀螺仪测量值。同时,通过采用蓝牙或Wi-Fi等无线传输技术将陀螺仪传感器上实时测量的穿刺模拟过程陀螺仪测量值快速上传至与之电性连接的计算机处理单元,确保数据传输的完整性与及时性。通过使用计算机处理单元接收到先前实时监测得到的穿刺模拟过程陀螺仪测量值,并将其转换到穿刺模拟过程当中对应的陀螺仪坐标系下,确保后续分析的数据精确反映穿刺过程中的实际运动状态,并通过结合先前获取得到的陀螺仪坐标系对所选穿刺场景模拟过程内对应的陀螺仪传感器进行角速度矢量的统计分析,以通过利用统计分析工具,针对每个时间点的测量数据进行聚合,计算出在陀螺仪坐标系下的实际角速度矢量,同时,通过结合先前分析得到的在陀螺仪坐标系下对应的陀螺仪测量值、陀螺仪实际角速度矢量建立相应的陀螺仪误差数学计算模型,并通过采用最小二乘法或卡尔曼滤波算法,对收集到的数据进行拟合与建模,识别出陀螺仪系统偏差与高斯白噪声,形成适合该穿刺场景的专属误差模型,例如:。然后,通过为其配置相应的静止状态条件,以便进行零阶校准处理,也即将陀螺仪传感器置于静止状态,收集此状态下的陀螺仪测量值,提取出其偏差部分,同时将相应的陀螺仪传感器至于先前配置的多个静止状态条件下进行测量,以获取陀螺仪一系列静止条件下对应的角速度测量矢量以及高斯测量白噪声,并将其获取的角速度测量矢量以及高斯测量白噪声输入至先前构建的穿刺模拟陀螺仪误差数学模型中进行误差模型重构,以获取对应的陀螺仪误差重构模型;式中,为在第次静止条件下对应的陀螺仪测量值,为在第次静止条件下对应的角速度测量矢量,为在第次静止条件下对应的陀螺仪估计偏差,为在第次静止条件下对应的高斯测量白噪声;还通过使用零阶校准方法将高斯测量白噪声假设趋于零均值,由于陀螺仪处于静止状态,则陀螺仪测量值也对应趋于零,并将上式陀螺仪误差重构模型的两边取期望算子进行零阶校准处理,也约等于零阶校准部分:In the embodiment of the present invention, the gyroscope attitude change during the selected puncture scene simulation process is monitored in real time by using the previously configured gyroscope sensor embedded in the selected simulated puncture automatic syringe. During the puncture simulation process, the gyroscope sensor collects and records the gyroscope measurement value, including angular velocity and acceleration data, so as to obtain the gyroscope measurement value of the puncture simulation process. At the same time, the gyroscope measurement value of the puncture simulation process measured in real time on the gyroscope sensor is quickly uploaded to the computer processing unit electrically connected thereto by using wireless transmission technology such as Bluetooth or Wi-Fi, thereby ensuring the integrity and timeliness of data transmission. By using a computer processing unit to receive the gyroscopic measurement values of the puncture simulation process obtained by real-time monitoring previously, and converting them into the corresponding gyroscopic coordinate system in the puncture simulation process, it is ensured that the data analyzed subsequently accurately reflects the actual motion state in the puncture process, and by combining the gyroscopic coordinate system obtained previously, the corresponding gyroscopic sensor in the selected puncture scene simulation process is statistically analyzed for the angular velocity vector, so as to aggregate the measurement data at each time point by using a statistical analysis tool, and calculate the actual angular velocity vector in the gyroscopic coordinate system. At the same time, by combining the corresponding gyroscopic measurement values and the actual gyroscopic angular velocity vector obtained in the previous analysis in the gyroscopic coordinate system, a corresponding gyroscopic error mathematical calculation model is established, and by using the least squares method or Kalman filtering algorithm, the collected data is fitted and modeled, the gyroscopic system deviation and Gaussian white noise are identified, and a dedicated error model suitable for the puncture scene is formed, for example: Then, by configuring the corresponding static state conditions for it, a zero-order calibration process is performed, that is, the gyroscope sensor is placed in a static state, the gyroscope measurement values in this state are collected, and the deviation part is extracted. At the same time, the corresponding gyroscope sensor is measured under multiple static state conditions configured previously to obtain the angular velocity measurement vector corresponding to a series of static conditions of the gyroscope. and Gaussian measurement white noise , and obtain the angular velocity measurement vector and Gaussian measurement white noise Input into the previously constructed puncture simulation gyroscope error mathematical model to reconstruct the error model to obtain the corresponding gyroscope error reconstruction model ; In the formula, For the The corresponding gyroscope measurements under substationary conditions, For the The corresponding angular velocity measurement vector under sub-stationary conditions is: For the The corresponding gyroscope estimated bias under substationary conditions is, For the The Gaussian measurement white noise corresponding to the sub-stationary condition; the Gaussian measurement white noise is assumed to be zero mean by using the zero-order calibration method. Since the gyroscope is in a stationary state, the gyroscope measurement value also tends to zero accordingly, and the expected operator is taken on both sides of the gyroscope error reconstruction model for zero-order calibration, which is also approximately equal to the zero-order calibration part:
; ;
从而得到陀螺仪偏差零阶校准部分。随后,通过自动注射器上配置的电阻元件模拟构建一个包含多个正交陀螺仪的虚拟陀螺仪阵列,与实际陀螺仪传感器组成相应的陀螺仪虚拟模块,并通过应用陀螺仪虚拟模块搭建相应的神经网络回归环境来提高陀螺仪校准的性能,这一环境利用高性能计算平台,采用现有的卷积神经网络模型与陀螺仪传感器数据进行结合,通过使用真实陀螺仪和虚拟陀螺仪阵列来协助校准,也即由三个陀螺仪组成的单个陀螺仪模块,采用了相应的神经网络回归校准方法,其中具体为增加陀螺仪输入通道的协助校准方法:通过设计一个卷积神经网络架构,其中卷积神经网络架构由卷积层、LeakyReLU激活函数以及最大池化层组成,并通过在卷积层输入每个陀螺仪模块特征:,其中为陀螺仪虚拟模块的数量,为窗口大小;在第个卷积层中网络输出,其中为窗口核大小,为第个窗口核处的陀螺仪偏差值,为步幅,为第个窗口核处的权重;根据第个卷积层中网络输出可将LeakyReLU激活函数定义为;基于第个卷积层中网络输出在最大池化层中进行池化计算,其中为池化大小,并将其输入展平为一个二维张量,以计算得出第一个全连接层,其中为第一个全连接层的权重,为第一个全连接层的偏差;通过引入LeakyReLU激活函数对与之连接的第二个全连接层进行重复计算,以得到最终神经网络回归输出,其中和分别为第二个全连接层的权重和偏差;通过均方误差损失函数计算神经网络回归损失,其中为训练样本总数;然后通过输入陀螺仪偏差零阶校准部分进行协助校准估算,得到该方法的回归偏差确定性部分;或者是增加真实和虚拟陀螺仪训练数据的协助校准方法:通过陀螺仪虚拟模块的真实陀螺仪测量数据,其中、和分别代表陀螺仪虚拟模块内在三个方向轴正交陀螺仪上的真实测量读数;通过模拟生成陀螺仪虚拟模块的虚拟陀螺仪测量数据,其中、和分别代表陀螺仪虚拟模块内在三个方向轴正交陀螺仪上的虚拟测量读数;将真实陀螺仪测量数据以及虚拟陀螺仪测量数据合并成一个训练集,并将其输入至卷积神经网络上进行神经网络回归训练,以网络输出在三个方向轴正交陀螺仪上的陀螺仪偏差值,其中为第层的权重矩阵,为第层的神经网络激活值,为第层的偏置项;根据在三个方向轴正交陀螺仪上的陀螺仪偏差值计算神经网络回归损失:;其中为训练样本总数,为三个正交陀螺仪的索引;通过反向传播方法更新优化权重矩阵和偏置项:Thus, the zero-order calibration part of the gyroscope deviation is obtained. Subsequently, a virtual gyroscope array containing multiple orthogonal gyroscopes is constructed by simulating the resistor element configured on the automatic syringe, and a corresponding gyroscope virtual module is formed with the actual gyroscope sensor. The gyroscope virtual module is applied to build a corresponding neural network regression environment to improve the performance of gyroscope calibration. This environment uses a high-performance computing platform and combines the existing convolutional neural network model with the gyroscope sensor data. It assists in calibration by using real gyroscopes and virtual gyroscope arrays, that is, a single gyroscope module composed of three gyroscopes, and adopts the corresponding neural network regression calibration method, which specifically adds a gyroscope input channel to assist in calibration: by designing a convolutional neural network architecture, wherein the convolutional neural network architecture consists of a convolutional layer, a LeakyReLU activation function, and a maximum pooling layer, and by inputting the features of each gyroscope module in the convolutional layer: ,in is the number of gyroscope virtual modules, is the window size; in The network output in the convolutional layer ,in is the window kernel size, For the The gyroscope bias value at the window kernel, is the stride, For the The weight at the window kernel; according to the The network output in the convolutional layer can be defined as the LeakyReLU activation function Based on The network output in the convolutional layer is pooled in the maximum pooling layer. ,in is the pooling size and flattens its input into a 2D tensor to calculate the first fully connected layer ,in is the weight of the first fully connected layer, is the bias of the first fully connected layer; the LeakyReLU activation function is introduced to repeatedly calculate the second fully connected layer connected to it to obtain the final neural network regression output ,in and are the weights and biases of the second fully connected layer respectively; the neural network regression loss is calculated by the mean square error loss function ,in is the total number of training samples; then the assisted calibration estimation is performed by inputting the zero-order calibration part of the gyroscope bias to obtain the regression bias deterministic part of the method Or an assisted calibration method that adds real and virtual gyroscope training data: real gyroscope measurement data through the gyroscope virtual module ,in , and Respectively represent the real measurement readings of the orthogonal gyroscopes on the three axes in the gyroscope virtual module; generate the virtual gyroscope measurement data of the gyroscope virtual module through simulation ,in , and Represents the virtual measurement readings of the gyroscope on the three orthogonal axes in the gyroscope virtual module; the real gyroscope measurement data and the virtual gyroscope measurement data are combined into a training set , and input it into the convolutional neural network for neural network regression training, so that the network outputs the gyroscope deviation values on the three-axis orthogonal gyroscope ,in For the The weight matrix of the layer, For the The neural network activation value of the layer, For the The bias term of the layer; the neural network regression loss is calculated based on the gyroscope bias values on the three axis orthogonal gyroscopes: ;in is the total number of training samples, are the indices of the three orthogonal gyroscopes; the weight matrix and bias terms are updated and optimized by the back-propagation method:
; ;
; ;
其中为学习率;通过输入陀螺仪偏差零阶校准部分进行协助校准估算,得到该方法的回归偏差确定性部分:,以上任意一种神经网络模型的回归校准方法都能够通过监督学习的方式,不断优化模型参数,以减小模型预测输出与实际陀螺仪数据之间的误差,从而回归计算得到相应的陀螺仪回归偏差确定性部分。最后,通过结合先前校准估算得到的陀螺仪回归偏差确定性部分对在陀螺仪坐标系下对应的陀螺仪测量值进行偏差的校准计算,以将计算的确定性偏差将从陀螺仪测量值中减去:,最终得到穿刺过程陀螺仪偏差校准值。in is the learning rate; the regression bias deterministic part of the method is obtained by inputting the gyroscope bias zero-order calibration part to assist in calibration estimation: Any of the above neural network model regression calibration methods can continuously optimize the model parameters through supervised learning to reduce the error between the model prediction output and the actual gyroscope data, thereby regressing and calculating the corresponding gyroscope regression bias deterministic part. Finally, by combining the gyroscope regression bias deterministic part estimated by the previous calibration The gyroscope measurement value corresponding to the gyroscope coordinate system is calibrated to calculate the bias so that the calculated deterministic bias will be subtracted from the gyroscope measurement value: , and finally the gyroscope deviation calibration value of the puncture process is obtained.
S3:穿刺训练场景路径模拟生成模块,用于基于穿刺过程陀螺仪偏差校准值对所选穿刺场景模拟过程进行穿刺路径模拟识别分析,以生成所选穿刺场景模拟过程对应的穿刺模拟训练路径;S3: a puncture training scene path simulation generation module, used to perform puncture path simulation identification analysis on the selected puncture scene simulation process based on the puncture process gyroscope deviation calibration value, so as to generate a puncture simulation training path corresponding to the selected puncture scene simulation process;
在本发明实施例中,通过对先前经过实时陀螺仪偏差校准后得到的穿刺过程陀螺仪偏差校准值进行时序变化的分析,以分析并记录所选穿刺场景模拟过程当中陀螺仪在每一个时间点处的测量校准数值,并通过结合先前分析获取得到的不同时间点位处对应的陀螺仪校准测量值使用三维建模软件对相对应的所选穿刺场景模拟过程进行虚拟空间场景的构建,以依据不同时间点的陀螺仪测量校准数据,建立三维坐标系,并根据穿刺路径、穿刺角度和时间动态变化绘制出精确的三维模型,模型中包含穿刺针的运动轨迹和目标组织的形态,通过数值计算将这些元素整合在一起,形成完整的穿刺模拟过程的三维虚拟空间模型,以直观地反映出不同时间点下穿刺过程的变化情况,然后,通过利用动态模拟分析工具(包括三维建模软件(如Blender或Maya)、有限元分析软件(如ANSYS或COMSOL)以及力学仿真软件(如MATLAB或Simulink))对先前所构建的三维虚拟空间模型进行穿刺路径的模拟识别与分析,该过程通过算法模拟穿刺针的运动轨迹,并与目标组织的物理特性进行实时交互,并通过使用计算机视觉技术和机器学习算法,分析不同穿刺路径的有效性和安全性,动态模拟工具能够评估穿刺过程中的可能风险,生成可视化的训练路径图,输出的穿刺模拟训练路径能够为实际穿刺操作提供参考依据,确保操作的准确性与安全性,最终模拟生成所选穿刺场景模拟过程对应的穿刺模拟训练路径。In an embodiment of the present invention, the time-series change analysis of the gyroscope deviation calibration value of the puncture process obtained after the real-time gyroscope deviation calibration is performed to analyze and record the measurement calibration value of the gyroscope at each time point in the selected puncture scene simulation process, and the corresponding gyroscope calibration measurement values at different time points obtained by combining the previous analysis are used to construct a virtual space scene for the corresponding selected puncture scene simulation process using a three-dimensional modeling software, so as to establish a three-dimensional coordinate system based on the gyroscope measurement calibration data at different time points, and draw an accurate three-dimensional model according to the puncture path, puncture angle and time dynamic changes, the model includes the motion trajectory of the puncture needle and the morphology of the target tissue, these elements are integrated together through numerical calculation to form a complete three-dimensional virtual space model of the puncture simulation process, so as to intuitively reflect the changes of the puncture process at different time points. Then, the puncture path is simulated and analyzed by using dynamic simulation analysis tools (including 3D modeling software (such as Blender or Maya), finite element analysis software (such as ANSYS or COMSOL) and mechanical simulation software (such as MATLAB or Simulink)) for the previously constructed 3D virtual space model. This process simulates the motion trajectory of the puncture needle through an algorithm and interacts with the physical properties of the target tissue in real time. By using computer vision technology and machine learning algorithms, the effectiveness and safety of different puncture paths are analyzed. The dynamic simulation tool can evaluate the possible risks in the puncture process and generate a visual training path diagram. The output puncture simulation training path can provide a reference for the actual puncture operation to ensure the accuracy and safety of the operation. Finally, the puncture simulation training path corresponding to the selected puncture scene simulation process is simulated and generated.
S4:穿刺模拟路径可视化模块,用于利用训练者用户界面对所选穿刺场景模拟过程对应的穿刺模拟训练路径进行穿刺模拟可视化处理,以执行相应的穿刺场景可视化教学过程。S4: a puncture simulation path visualization module, which is used to perform puncture simulation visualization processing on the puncture simulation training path corresponding to the selected puncture scene simulation process using the trainer user interface, so as to execute the corresponding puncture scene visualization teaching process.
在本发明实施例中,通过使用训练者用户界面将生成的所选穿刺场景模拟过程对应的穿刺模拟训练路径进行可视化处理,以通过3D可视化软件,将模拟路径图形化展现,使用真实场景的模型与路径进行叠加,确保用户能够直观理解穿刺过程,在可视化过程中,操作人员可以通过界面交互查看每个步骤的细节,并结合相应的教学内容进行学习与训练,此可视化处理提高了学习效率,使得穿刺场景的教学过程更加生动具体,从而增强了操作人员的实操能力。In an embodiment of the present invention, the generated puncture simulation training path corresponding to the selected puncture scene simulation process is visualized by using a trainer user interface, so that the simulation path is graphically presented through 3D visualization software, and the model of the real scene is superimposed on the path to ensure that the user can intuitively understand the puncture process. During the visualization process, the operator can view the details of each step through interface interaction, and learn and train in combination with the corresponding teaching content. This visualization processing improves learning efficiency and makes the teaching process of the puncture scene more vivid and specific, thereby enhancing the operator's practical ability.
进一步的,作为本发明的一个实施例,参考图2所示,为图1中用户训练穿刺模拟操作选择模块的功能流程示意图,在本实施例中所述用户训练穿刺模拟操作选择模块包括以下功能:Further, as an embodiment of the present invention, referring to FIG. 2 , which is a functional flow diagram of the user training puncture simulation operation selection module in FIG. 1 , the user training puncture simulation operation selection module in this embodiment includes the following functions:
S11:通过训练者用户界面选择需要模拟的穿刺场景,以得到训练所选模拟穿刺场景,其中训练所选模拟穿刺场景包括胸腔穿刺模拟场景、腰椎穿刺模拟场景、腹腔穿刺模拟场景以及骨髓穿刺模拟场景;S11: selecting a puncture scene to be simulated through the trainer user interface to obtain a simulated puncture scene selected for training, wherein the simulated puncture scene selected for training includes a thoracic puncture simulation scene, a lumbar puncture simulation scene, an abdominal puncture simulation scene, and a bone marrow puncture simulation scene;
在本发明实施例中,通过使用系统内的训练者用户界面选择需要模拟的穿刺场景,其中包括胸腔穿刺、腰椎穿刺、腹腔穿刺和骨髓穿刺等,用户通过交互式界面进行场景选择,界面可实时显示每种场景的详细信息与适用指示,系统记录所选场景并生成相应的配置文件,确保后续步骤能够准确引用该场景的特定参数与要求,最终选取得到训练所选模拟穿刺场景。In an embodiment of the present invention, a trainer user interface within the system is used to select a puncture scenario that needs to be simulated, including thoracic puncture, lumbar puncture, abdominal puncture, and bone marrow puncture, etc. The user selects the scenario through an interactive interface, and the interface can display detailed information and applicable instructions for each scenario in real time. The system records the selected scenario and generates a corresponding configuration file to ensure that subsequent steps can accurately reference the specific parameters and requirements of the scenario, and finally select the simulated puncture scenario selected for training.
S12:根据训练所选模拟穿刺场景为相应的自动注射器配置对应的穿刺针以及穿刺注射深度操作器械,以得到所选模拟穿刺自动注射器;S12: configuring a corresponding puncture needle and a puncture injection depth operating device for a corresponding automatic injector according to the simulated puncture scenario selected for training, so as to obtain the selected simulated puncture automatic injector;
在本发明实施例中,通过根据先前训练所选定的模拟穿刺场景为其相对应的自动注射器配置相应的穿刺注射深度操作器械及穿刺针,针对每种穿刺场景,确定穿刺针的类型和尺寸,以及注射深度操作器械的参数,例如胸腔穿刺使用胶管穿刺针、5ml注射器和50ml注射器;腹腔穿刺也使用胶管穿刺针、5ml注射器和50ml注射器;腹腔穿刺使用腰椎穿刺针、5ml注射器、测压管、试管;而骨髓穿刺使用骨髓穿刺针、5ml注射器、20ml注射器,这一过程使用专业的医疗器械配置工具,确保所有部件符合医疗标准及技术要求,配置完成后,自动注射器与穿刺器械进行组装,形成专门针对所选模拟穿刺场景的自动注射器,最终得到所选模拟穿刺自动注射器。In an embodiment of the present invention, the corresponding automatic injector is configured with a corresponding puncture injection depth operating instrument and puncture needle according to the simulated puncture scenario selected by the previous training, and the type and size of the puncture needle and the parameters of the injection depth operating instrument are determined for each puncture scenario. For example, a hose puncture needle, a 5ml syringe and a 50ml syringe are used for thoracic puncture; a hose puncture needle, a 5ml syringe and a 50ml syringe are also used for abdominal puncture; a lumbar puncture needle, a 5ml syringe, a pressure measuring tube and a test tube are used for abdominal puncture; and a bone marrow puncture needle, a 5ml syringe and a 20ml syringe are used for bone marrow puncture. This process uses a professional medical device configuration tool to ensure that all components meet medical standards and technical requirements. After the configuration is completed, the automatic injector is assembled with the puncture instrument to form an automatic injector specifically for the selected simulated puncture scenario, and finally the selected simulated puncture automatic injector is obtained.
S13:对训练所选模拟穿刺场景进行穿刺场景环境参数设定,以得到所选模拟穿刺场景环境参数集;基于所选模拟穿刺场景环境参数集对所选模拟穿刺自动注射器进行设备性能测试调优,得到模拟穿刺设备优化自动注射器;S13: setting the puncture scene environment parameters for the selected simulated puncture scene for training to obtain a selected simulated puncture scene environment parameter set; performing device performance test and optimization on the selected simulated puncture automatic injector based on the selected simulated puncture scene environment parameter set to obtain a simulated puncture device optimized automatic injector;
在本发明实施例中,通过对先前所选定的训练所选模拟穿刺场景进行环境参数设定,以通过利用环境模拟软件建立场景模型,输入与穿刺相关的关键环境参数,例如模拟人的组织密度、血管分布及脏器位置,并通过调试界面确认所有环境变量设置无误,生成环境参数集,这些参数将用于后续的设备测试与模拟操作,确保模拟的真实感与有效性,从而得到所选模拟穿刺场景环境参数集。同时,通过结合先前设定的所选模拟穿刺场景环境参数集对相对应的穿刺自动注射器进行性能测试与调优,以通过使用性能测试平台,模拟不同的穿刺条件,通过逐步增加穿刺深度和调整穿刺速度,监测设备的反应和输出,在此过程中,收集数据以评估设备的稳定性和准确性,及时调整设备的参数,确保最终得到优化的模拟穿刺设备,符合所有安全与性能标准,最终得到模拟穿刺设备优化自动注射器。In an embodiment of the present invention, the environment parameters of the previously selected simulated puncture scene are set, so as to establish a scene model by using the environment simulation software, input key environment parameters related to puncture, such as tissue density, vascular distribution and organ position of the simulated person, and confirm that all environment variables are set correctly through the debugging interface, and generate an environment parameter set, which will be used for subsequent equipment testing and simulation operations to ensure the realism and effectiveness of the simulation, thereby obtaining the selected simulated puncture scene environment parameter set. At the same time, the corresponding puncture automatic injector is performance tested and tuned by combining the previously set selected simulated puncture scene environment parameter set, so as to simulate different puncture conditions by using the performance test platform, monitor the reaction and output of the device by gradually increasing the puncture depth and adjusting the puncture speed, and in this process, collect data to evaluate the stability and accuracy of the device, adjust the parameters of the device in time, ensure that the optimized simulated puncture device is finally obtained, meet all safety and performance standards, and finally obtain the simulated puncture device optimized automatic injector.
S14:对模拟穿刺设备优化自动注射器进行模拟穿刺操作流程设计,以生成模拟穿刺操作流程设计步骤文档;S14: Design a simulated puncture operation process for the simulated puncture device by optimizing the automatic syringe to generate a simulated puncture operation process design step document;
在本发明实施例中,通过对优化后的穿刺自动注射器进行操作流程设计,以通过使用标准化操作流程文档模板,详细记录每个操作步骤,包括穿刺前的准备、穿刺过程中的关键动作及穿刺后的处理方法,并通过多次演练与反馈,逐步完善操作流程,确保其逻辑清晰、易于执行,最终设计生成模拟穿刺操作流程设计步骤文档。In an embodiment of the present invention, an operation process design is performed for the optimized puncture automatic injector, so that each operation step is recorded in detail by using a standardized operation process document template, including preparations before puncture, key actions during the puncture process, and post-puncture treatment methods. The operation process is gradually improved through multiple drills and feedback to ensure that its logic is clear and easy to execute, and finally a simulated puncture operation process design step document is designed and generated.
S15:基于模拟穿刺操作流程设计步骤文档对训练所选模拟穿刺场景进行穿刺综合模拟操作,以生成所选穿刺场景模拟过程。S15: Performing a comprehensive puncture simulation operation on the simulated puncture scenario selected for training based on the simulated puncture operation process design step document to generate a simulation process for the selected puncture scenario.
在本发明实施例中,通过结合先前设计生成的模拟穿刺操作流程设计步骤文档对所选定的模拟穿刺场景进行综合模拟操作,以通过自动注射器执行整个穿刺过程,实时监测各项参数和反馈信息,并通过使用虚拟现实技术增强模拟体验,通过模拟系统生成的图像与声音,使操作更具沉浸感与真实性,完成后,记录模拟过程中的所有数据,为后续的分析与评估提供依据,确保训练的有效性与科学性,最终记录生成所选穿刺场景模拟过程。In an embodiment of the present invention, a comprehensive simulation operation is performed on the selected simulated puncture scene by combining the simulated puncture operation process design step document generated by the previous design, so as to perform the entire puncture process through an automatic syringe, monitor various parameters and feedback information in real time, and enhance the simulation experience by using virtual reality technology. The images and sounds generated by the simulation system make the operation more immersive and realistic. After completion, all data in the simulation process are recorded to provide a basis for subsequent analysis and evaluation, ensure the effectiveness and scientificity of the training, and finally record and generate the simulation process of the selected puncture scene.
进一步的,作为本发明的一个实施例,参考图3所示,为图1中穿刺陀螺仪偏差校准模块的功能流程示意图,在本实施例中所述穿刺陀螺仪偏差校准模块包括以下功能:Further, as an embodiment of the present invention, referring to FIG3 , which is a functional flow diagram of the puncture gyroscope deviation calibration module in FIG1 , the puncture gyroscope deviation calibration module in this embodiment includes the following functions:
S21:利用所选模拟穿刺自动注射器内的陀螺仪传感器对所选穿刺场景模拟过程进行穿刺陀螺仪测量处理,以得到穿刺模拟过程陀螺仪测量值;通过无线传输技术将陀螺仪传感器上实时测量的穿刺模拟过程陀螺仪测量值上传至计算机处理单元;S21: using the gyro sensor in the selected simulated puncture automatic syringe to perform puncture gyro measurement processing on the selected puncture scene simulation process to obtain puncture simulation process gyro measurement values; uploading the puncture simulation process gyro measurement values measured in real time on the gyro sensor to the computer processing unit through wireless transmission technology;
在本发明实施例中,通过使用先前配置好的所选模拟穿刺自动注射器内嵌有的陀螺仪传感器实时监测所选穿刺场景模拟过程中的陀螺仪姿态变化,在穿刺模拟过程中,陀螺仪传感器收集并记录陀螺仪测量值,包括角速度和加速度数据,从而得到穿刺模拟过程陀螺仪测量值。同时,通过采用蓝牙或Wi-Fi等无线传输技术将陀螺仪传感器上实时测量的穿刺模拟过程陀螺仪测量值快速上传至与之电性连接的计算机处理单元,该计算机处理单元能够接收并实时显示数据,确保数据传输的完整性与及时性。In the embodiment of the present invention, the gyroscope attitude change during the selected puncture scene simulation process is monitored in real time by using the previously configured gyroscope sensor embedded in the selected simulated puncture automatic syringe. During the puncture simulation process, the gyroscope sensor collects and records the gyroscope measurement value, including angular velocity and acceleration data, so as to obtain the gyroscope measurement value of the puncture simulation process. At the same time, by using wireless transmission technology such as Bluetooth or Wi-Fi, the gyroscope measurement value of the puncture simulation process measured in real time on the gyroscope sensor is quickly uploaded to a computer processing unit electrically connected thereto, and the computer processing unit is capable of receiving and displaying the data in real time, thereby ensuring the integrity and timeliness of data transmission.
S22:利用计算机处理单元获取陀螺仪传感器对应穿刺模拟过程的陀螺仪坐标系,并基于陀螺仪坐标系对穿刺模拟过程陀螺仪测量值进行测量值坐标系转换,以得到在陀螺仪坐标系下对应的陀螺仪测量值;S22: using a computer processing unit to obtain a gyroscope coordinate system of the gyroscope sensor corresponding to the puncture simulation process, and performing a measurement value coordinate system conversion on the gyroscope measurement value of the puncture simulation process based on the gyroscope coordinate system to obtain a corresponding gyroscope measurement value in the gyroscope coordinate system;
在本发明实施例中,通过使用计算机处理单元接收到先前实时监测得到的穿刺模拟过程陀螺仪测量值,并将其转换到穿刺模拟过程当中对应的陀螺仪坐标系下,首先,通过定义陀螺仪坐标系,确保坐标系的原点与陀螺仪传感器的位置一致。然后,通过数学转换公式,将穿刺模拟过程中的测量值进行坐标系转换,得到在陀螺仪坐标系下的对应测量值,这一过程确保后续分析的数据精确反映穿刺过程中的实际运动状态,最终得到在陀螺仪坐标系下对应的陀螺仪测量值。In the embodiment of the present invention, the gyroscope measurement value of the puncture simulation process previously monitored in real time is received by using a computer processing unit, and converted to the corresponding gyroscope coordinate system in the puncture simulation process. First, by defining the gyroscope coordinate system, it is ensured that the origin of the coordinate system is consistent with the position of the gyroscope sensor. Then, the measurement value in the puncture simulation process is converted into a coordinate system through a mathematical conversion formula to obtain the corresponding measurement value in the gyroscope coordinate system. This process ensures that the data analyzed subsequently accurately reflects the actual motion state in the puncture process, and finally obtains the corresponding gyroscope measurement value in the gyroscope coordinate system.
S23:基于穿刺模拟过程的陀螺仪坐标系对所选穿刺场景模拟过程内对应的陀螺仪传感器进行角速度矢量统计分析,得到在陀螺仪坐标系下对应的陀螺仪实际角速度矢量;S23: performing statistical analysis on the angular velocity vector of the gyroscope sensor corresponding to the selected puncture scene simulation process based on the gyroscope coordinate system of the puncture simulation process to obtain the actual angular velocity vector of the gyroscope corresponding to the gyroscope coordinate system;
在本发明实施例中,通过结合先前获取得到的穿刺模拟过程的陀螺仪坐标系对所选穿刺场景模拟过程内对应的陀螺仪传感器进行角速度矢量的统计分析,以通过利用统计分析工具,针对每个时间点的测量数据进行聚合,计算出在陀螺仪坐标系下的实际角速度矢量,这一分析过程考虑了多个因素,如传感器的灵敏度和模拟环境的变化,确保得到的角速度矢量能够准确反映穿刺操作中的动态变化,最终得到在陀螺仪坐标系下对应的陀螺仪实际角速度矢量。In an embodiment of the present invention, the angular velocity vector of the corresponding gyroscope sensor in the selected puncture scene simulation process is statistically analyzed by combining the gyroscope coordinate system of the puncture simulation process previously obtained, so as to aggregate the measurement data at each time point by using a statistical analysis tool, and calculate the actual angular velocity vector in the gyroscope coordinate system. This analysis process takes into account multiple factors, such as the sensitivity of the sensor and changes in the simulation environment, to ensure that the obtained angular velocity vector can accurately reflect the dynamic changes in the puncture operation, and finally obtain the actual angular velocity vector of the gyroscope corresponding to the gyroscope coordinate system.
S24:根据在陀螺仪坐标系下对应的陀螺仪测量值以及陀螺仪实际角速度矢量对所选穿刺场景模拟过程内对应的陀螺仪传感器进行陀螺仪误差建模,以生成穿刺模拟陀螺仪误差数学模型;S24: performing gyroscope error modeling on the corresponding gyroscope sensor in the selected puncture scenario simulation process according to the corresponding gyroscope measurement value in the gyroscope coordinate system and the actual gyroscope angular velocity vector, so as to generate a puncture simulation gyroscope error mathematical model;
在本发明实施例中,通过结合先前分析得到的在陀螺仪坐标系下对应的陀螺仪测量值、陀螺仪实际角速度矢量建立相应的陀螺仪误差数学计算模型,并通过采用最小二乘法或卡尔曼滤波算法,对收集到的数据进行拟合与建模,识别出陀螺仪系统偏差与高斯白噪声,这一建模过程将有助于后续步骤的校准工作,确保穿刺模拟设备在不同条件下的测量精度和可靠性,形成适合该穿刺场景的专属误差模型,最终建模生成穿刺模拟陀螺仪误差数学模型。In an embodiment of the present invention, a corresponding gyroscope error mathematical calculation model is established by combining the corresponding gyroscope measurement values and the actual angular velocity vector of the gyroscope in the gyroscope coordinate system obtained in the previous analysis, and the collected data is fitted and modeled by adopting the least squares method or the Kalman filtering algorithm to identify the gyroscope system deviation and Gaussian white noise. This modeling process will help the calibration work in subsequent steps, ensure the measurement accuracy and reliability of the puncture simulation equipment under different conditions, form an exclusive error model suitable for the puncture scenario, and finally generate a puncture simulation gyroscope error mathematical model.
S25:通过为陀螺仪传感器配置静止条件,并基于静止条件对穿刺模拟陀螺仪误差数学模型内的陀螺仪偏差部分进行零阶校准处理,得到陀螺仪偏差零阶校准部分;通过电阻元件设置虚拟陀螺仪阵列与陀螺仪传感器组成陀螺仪虚拟模块,其中每个陀螺仪虚拟模块由三个方向轴上的正交陀螺仪组成,并基于陀螺仪虚拟模块对陀螺仪偏差零阶校准部分进行神经网络回归协助校准估算,得到陀螺仪回归偏差确定性部分;S25: by configuring a stationary condition for the gyroscope sensor, and performing a zero-order calibration process on the gyroscope deviation part in the puncture simulation gyroscope error mathematical model based on the stationary condition, a zero-order calibration part of the gyroscope deviation is obtained; a virtual gyroscope array and a gyroscope sensor are set up through a resistor element to form a gyroscope virtual module, wherein each gyroscope virtual module is composed of orthogonal gyroscopes on three direction axes, and a neural network regression-assisted calibration estimation is performed on the zero-order calibration part of the gyroscope deviation based on the gyroscope virtual module to obtain a gyroscope regression deviation deterministic part;
在本发明实施例中,通过为自动注射器上的陀螺仪传感器配置相应的静止状态条件,以便进行零阶校准处理,也即将陀螺仪传感器置于静止状态,收集此状态下的陀螺仪测量值,提取出其偏差部分,同时将相应的陀螺仪传感器至于先前配置的多个静止状态条件下进行测量,以获取陀螺仪一系列静止条件下对应的角速度测量矢量以及高斯测量白噪声,并将其获取的角速度测量矢量以及高斯测量白噪声输入至先前构建的穿刺模拟陀螺仪误差数学模型中进行误差模型重构,以获取对应的陀螺仪误差重构模型;式中,为在第次静止条件下对应的陀螺仪测量值,为在第次静止条件下对应的角速度测量矢量,为在第次静止条件下对应的陀螺仪估计偏差,为在第次静止条件下对应的高斯测量白噪声;还通过使用零阶校准方法将高斯测量白噪声假设趋于零均值,由于陀螺仪处于静止状态,则陀螺仪测量值也对应趋于零,并将上式陀螺仪误差重构模型的两边取期望算子进行零阶校准处理,也约等于零阶校准部分:In the embodiment of the present invention, the gyro sensor on the automatic injector is configured with corresponding static state conditions so as to perform zero-order calibration processing, that is, the gyro sensor is placed in a static state, the gyro measurement values in this state are collected, and the deviation part thereof is extracted. At the same time, the corresponding gyro sensor is placed in a plurality of static state conditions configured previously for measurement, so as to obtain the angular velocity measurement vector corresponding to a series of static conditions of the gyro and Gaussian measurement white noise , and obtain the angular velocity measurement vector and Gaussian measurement white noise Input into the previously constructed puncture simulation gyroscope error mathematical model to reconstruct the error model to obtain the corresponding gyroscope error reconstruction model ; In the formula, For the The corresponding gyroscope measurements under substationary conditions, For the The corresponding angular velocity measurement vector under sub-stationary conditions is: For the The corresponding gyroscope estimated bias under substationary conditions is, For the The Gaussian measurement white noise corresponding to the sub-stationary condition; the Gaussian measurement white noise is assumed to be zero mean by using the zero-order calibration method. Since the gyroscope is in a stationary state, the gyroscope measurement value also tends to zero accordingly, and the expected operator is taken on both sides of the gyroscope error reconstruction model for zero-order calibration, which is also approximately equal to the zero-order calibration part:
; ;
从而得到陀螺仪偏差零阶校准部分。随后,通过自动注射器上配置的电阻元件模拟构建一个包含多个正交陀螺仪的虚拟陀螺仪阵列,与实际陀螺仪传感器组成相应的陀螺仪虚拟模块,并通过应用陀螺仪虚拟模块搭建相应的神经网络回归环境来提高陀螺仪校准的性能,这一环境利用高性能计算平台,采用现有的卷积神经网络模型与陀螺仪传感器数据进行结合,通过使用真实陀螺仪和虚拟陀螺仪阵列来协助校准,也即由三个陀螺仪组成的单个陀螺仪模块,采用了相应的神经网络回归校准方法,其中具体为增加陀螺仪输入通道的协助校准方法:通过设计一个卷积神经网络架构,其中卷积神经网络架构由卷积层、LeakyReLU激活函数以及最大池化层组成,并通过在卷积层输入每个陀螺仪模块特征:,其中为陀螺仪虚拟模块的数量,为窗口大小;在第个卷积层中网络输出,其中为窗口核大小,为第个窗口核处的陀螺仪偏差值,为步幅,为第个窗口核处的权重;根据第个卷积层中网络输出可将LeakyReLU激活函数定义为;基于第个卷积层中网络输出在最大池化层中进行池化计算,其中为池化大小,并将其输入展平为一个二维张量,以计算得出第一个全连接层,其中为第一个全连接层的权重,为第一个全连接层的偏差;通过引入LeakyReLU激活函数对与之连接的第二个全连接层进行重复计算,以得到最终神经网络回归输出,其中和分别为第二个全连接层的权重和偏差;通过均方误差损失函数计算神经网络回归损失,其中为训练样本总数;然后通过输入陀螺仪偏差零阶校准部分进行协助校准估算,得到陀螺仪回归偏差确定性部分:;或者是增加真实和虚拟陀螺仪训练数据的协助校准方法:通过陀螺仪虚拟模块的真实陀螺仪测量数据,其中、和分别代表陀螺仪虚拟模块内在三个方向轴正交陀螺仪上的真实测量读数;通过模拟生成陀螺仪虚拟模块的虚拟陀螺仪测量数据,其中、和分别代表陀螺仪虚拟模块内在三个方向轴正交陀螺仪上的虚拟测量读数;将真实陀螺仪测量数据以及虚拟陀螺仪测量数据合并成一个训练集,并将其输入至卷积神经网络上进行神经网络回归训练,以网络输出在三个方向轴正交陀螺仪上的陀螺仪偏差值,其中为第层的权重矩阵,为第层的神经网络激活值,为第层的偏置项;根据在三个方向轴正交陀螺仪上的陀螺仪偏差值计算神经网络回归损失:;其中为训练样本总数,为三个正交陀螺仪的索引;通过反向传播方法更新优化权重矩阵和偏置项:Thus, the zero-order calibration part of the gyroscope deviation is obtained. Subsequently, a virtual gyroscope array containing multiple orthogonal gyroscopes is constructed by simulating the resistor element configured on the automatic syringe, and a corresponding gyroscope virtual module is formed with the actual gyroscope sensor. The gyroscope virtual module is applied to build a corresponding neural network regression environment to improve the performance of gyroscope calibration. This environment uses a high-performance computing platform and combines the existing convolutional neural network model with the gyroscope sensor data. It assists in calibration by using real gyroscopes and virtual gyroscope arrays, that is, a single gyroscope module composed of three gyroscopes, and adopts the corresponding neural network regression calibration method, which specifically adds a gyroscope input channel to assist in calibration: by designing a convolutional neural network architecture, wherein the convolutional neural network architecture consists of a convolutional layer, a LeakyReLU activation function, and a maximum pooling layer, and by inputting the features of each gyroscope module in the convolutional layer: ,in is the number of gyroscope virtual modules, is the window size; in The network output in the convolutional layer ,in is the window kernel size, For the The gyroscope bias value at the window kernel, is the stride, For the The weight at the window kernel; according to the The network output in the convolutional layer can be defined as the LeakyReLU activation function Based on The network output in the convolutional layer is pooled in the maximum pooling layer. ,in is the pooling size and flattens its input into a 2D tensor to calculate the first fully connected layer ,in is the weight of the first fully connected layer, is the bias of the first fully connected layer; the LeakyReLU activation function is introduced to repeatedly calculate the second fully connected layer connected to it to obtain the final neural network regression output ,in and are the weights and biases of the second fully connected layer respectively; the neural network regression loss is calculated by the mean square error loss function ,in is the total number of training samples; then the gyroscope bias zero-order calibration part is input to assist in calibration estimation, and the gyroscope regression bias deterministic part is obtained: Or an assisted calibration method that adds real and virtual gyroscope training data: real gyroscope measurement data through the gyroscope virtual module ,in , and Respectively represent the real measurement readings of the orthogonal gyroscopes on the three axes in the gyroscope virtual module; generate the virtual gyroscope measurement data of the gyroscope virtual module through simulation ,in , and Represents the virtual measurement readings of the gyroscope on the three orthogonal axes in the gyroscope virtual module; the real gyroscope measurement data and the virtual gyroscope measurement data are combined into a training set , and input it into the convolutional neural network for neural network regression training, so that the network outputs the gyroscope deviation values on the three-axis orthogonal gyroscope ,in For the The weight matrix of the layer, For the The neural network activation value of the layer, For the The bias term of the layer; the neural network regression loss is calculated based on the gyroscope bias values on the three axis orthogonal gyroscopes: ;in is the total number of training samples, are the indices of the three orthogonal gyroscopes; the weight matrix and bias terms are updated and optimized by the back-propagation method:
; ;
; ;
其中为学习率;通过输入陀螺仪偏差零阶校准部分进行协助校准估算,得到陀螺仪回归偏差确定性部分:,以上任意一种神经网络模型的回归校准方法都能够通过监督学习的方式,不断优化模型参数,以减小模型预测输出与实际陀螺仪数据之间的误差,最终回归计算得到相应的陀螺仪回归偏差确定性部分。in is the learning rate; the gyroscope regression bias deterministic part is obtained by inputting the zero-order calibration part of the gyroscope bias to assist in calibration estimation: ,Any of the above regression calibration methods of the neural network models can continuously optimize the model parameters through supervised learning to reduce the error between the model prediction output and the actual gyroscope data, and finally regress the calculation to obtain the corresponding deterministic part of the gyroscope regression deviation.
S26:基于陀螺仪回归偏差确定性部分对在陀螺仪坐标系下对应的陀螺仪测量值进行静态偏差校准计算,以得到穿刺过程陀螺仪偏差校准值。S26: Based on the deterministic part of the gyroscope regression deviation, a static deviation calibration calculation is performed on the corresponding gyroscope measurement value in the gyroscope coordinate system to obtain a gyroscope deviation calibration value for the puncture process.
在本发明实施例中,通过结合先前校准估算得到的陀螺仪回归偏差确定性部分对在陀螺仪坐标系下对应的陀螺仪测量值进行偏差的校准计算,以将计算的确定性偏差将从陀螺仪测量值中减去:,最终得到穿刺过程陀螺仪偏差校准值。In an embodiment of the present invention, the gyroscope regression bias deterministic part is obtained by combining the previously calibrated estimate The gyroscope measurement value corresponding to the gyroscope coordinate system is calibrated to calculate the bias so that the calculated deterministic bias will be subtracted from the gyroscope measurement value: , and finally the gyroscope deviation calibration value of the puncture process is obtained.
进一步的,所述的穿刺模拟陀螺仪误差数学模型具体为:Furthermore, the puncture simulation gyroscope error mathematical model is specifically:
; ;
式中,为在陀螺仪坐标系下对应的陀螺仪测量值,为在陀螺仪坐标系下对应的陀螺仪实际角速度矢量,为陀螺仪非对角元素和比例因子误差的矩阵,为陀螺仪偏差部分,为零均值高斯白噪声。In the formula, In the gyroscope coordinate system The corresponding gyroscope measurements are: In the gyroscope coordinate system The corresponding actual angular velocity vector of the gyroscope is, is the matrix of gyroscope off-diagonal elements and scale factor errors, is the gyro bias part, is zero-mean Gaussian white noise.
本发明通过使用具体的数学模型并经过验证得到了一个穿刺模拟陀螺仪误差数学模型,用于描述所选穿刺场景模拟过程内对应的陀螺仪传感器在穿刺模拟过程当中所出现的陀螺仪测量偏差情况,该数学模型充分考虑了在陀螺仪坐标系下对应的陀螺仪测量值,在陀螺仪坐标系下对应的陀螺仪实际角速度矢量,陀螺仪非对角元素和比例因子误差的矩阵,陀螺仪偏差部分,零均值高斯白噪声与以上各参数之间的相互关联关系构成了一种函数关系,该数学模型可以有效地对陀螺仪的测量值进行校正,从而提高穿刺过程中角速度的测量精度,模型中的偏差部分和噪声建模能够减少测量误差,使得得到的角速度矢量更加准确,同时,该数学模型提供了一种系统化的方式来分析陀螺仪的误差来源,包括非对角元素和比例因子误差(矩阵M),这些因素会导致不同方向上的测量值不一致,通过模型可以量化这些影响,陀螺仪偏差在实际使用过程当中常常不可避免,通过校准可以减少其影响。而高斯白噪声通过对噪声的建模,可以对其进行统计分析,从而改善测量的稳定性。通过对陀螺仪误差的建模与校准,能够对于外部干扰和内部噪声的鲁棒性大幅增强,在穿刺模拟中,陀螺仪可以更准确地反映实际的操作情况,从而降低失败率和提高安全性。通过建立数学模型使得误差来源和校正过程具备可追溯性,便于后续的研究和改进,对于未来的穿刺过程或其他相关应用,可以根据之前的模型和数据进行相应的优化,从而为提高穿刺模拟过程的测量精度、鲁棒性及实时性提供了有力工具。The present invention obtains a puncture simulation gyroscope error mathematical model by using a specific mathematical model and verifying it, which is used to describe the gyroscope measurement deviation of the corresponding gyroscope sensor in the selected puncture scene simulation process during the puncture simulation process. The mathematical model fully considers the gyroscope coordinate system. The corresponding gyroscope measurement value is , in the gyroscope coordinate system The corresponding actual angular velocity vector of the gyroscope is , the matrix of gyroscope off-diagonal elements and scale factor errors , gyro bias part , zero-mean Gaussian white noise The correlation between the above parameters constitutes a functional relationship , the mathematical model can effectively correct the gyroscope's measurement value, thereby improving the measurement accuracy of the angular velocity during the puncture process. The deviation part and noise modeling in the model can reduce the measurement error, making the obtained angular velocity vector more accurate. At the same time, the mathematical model provides a systematic way to analyze the error sources of the gyroscope, including non-diagonal elements and proportional factor errors (matrix M). These factors will cause inconsistent measurements in different directions. These effects can be quantified through the model. Gyroscope deviation is often unavoidable in actual use, and its impact can be reduced through calibration. Gaussian white noise can be statistically analyzed by modeling the noise, thereby improving the stability of the measurement. By modeling and calibrating the gyroscope error, the robustness to external interference and internal noise can be greatly enhanced. In the puncture simulation, the gyroscope can more accurately reflect the actual operation situation, thereby reducing the failure rate and improving safety. By establishing a mathematical model, the error source and correction process are traceable, which is convenient for subsequent research and improvement. For future puncture processes or other related applications, corresponding optimization can be performed based on previous models and data, thus providing a powerful tool for improving the measurement accuracy, robustness and real-time performance of the puncture simulation process.
进一步的,所述穿刺训练场景路径模拟生成模块包括以下功能:Furthermore, the puncture training scenario path simulation generation module includes the following functions:
通过穿刺过程陀螺仪偏差校准值获取所选穿刺场景模拟过程在不同时间点位处对应的陀螺仪校准测量值;Obtaining gyroscope calibration measurement values corresponding to different time points of the selected puncture scenario simulation process through gyroscope deviation calibration values during the puncture process;
在本发明实施例中,通过对先前经过实时陀螺仪偏差校准后得到的穿刺过程陀螺仪偏差校准值进行时序变化的分析,以分析并记录所选穿刺场景模拟过程当中陀螺仪在每一个时间点处的测量校准数值,并确保了每个时间点的测量值都经过了精确的校准,从而消除了由于设备误差或环境因素引起的偏差,通过时序分析获取这些校准测量值,可以更好地理解穿刺过程的动态变化,最终获取所选穿刺场景模拟过程在不同时间点位处对应的陀螺仪校准测量值。In an embodiment of the present invention, by analyzing the time series changes of the gyroscope deviation calibration value of the puncture process obtained after the real-time gyroscope deviation calibration, the measurement calibration value of the gyroscope at each time point in the selected puncture scene simulation process is analyzed and recorded, and it is ensured that the measurement value at each time point is accurately calibrated, thereby eliminating the deviation caused by equipment error or environmental factors. By obtaining these calibration measurement values through time series analysis, the dynamic changes of the puncture process can be better understood, and finally the gyroscope calibration measurement values corresponding to the selected puncture scene simulation process at different time points can be obtained.
优选地,基于不同时间点位处对应的陀螺仪校准测量值对相对应的所选穿刺场景模拟过程进行三维虚拟空间场景构建,以生成所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型;Preferably, a three-dimensional virtual space scene is constructed for the corresponding selected puncture scene simulation process based on the corresponding gyroscope calibration measurement values at different time points to generate a gyroscope puncture three-dimensional virtual space model corresponding to the selected puncture simulation process;
在本发明实施例中,通过结合先前分析获取得到的不同时间点位处对应的陀螺仪校准测量值使用三维建模软件对相对应的所选穿刺场景模拟过程进行虚拟空间场景的构建,以依据不同时间点的陀螺仪测量校准数据,建立三维坐标系,并根据穿刺路径、穿刺角度和时间动态变化绘制出精确的三维模型,模型中包含穿刺针的运动轨迹和目标组织的形态,通过数值计算将这些元素整合在一起,形成完整的穿刺模拟过程的三维虚拟空间模型,该模型不仅具备高精度,还能够直观地反映出不同时间点下穿刺过程的变化情况,最终建模生成所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型。In an embodiment of the present invention, a virtual space scene is constructed for the corresponding selected puncture scene simulation process using three-dimensional modeling software by combining the corresponding gyroscope calibration measurement values at different time points obtained by previous analysis, so as to establish a three-dimensional coordinate system based on the gyroscope measurement calibration data at different time points, and draw an accurate three-dimensional model according to the puncture path, puncture angle and time dynamic changes. The model includes the motion trajectory of the puncture needle and the morphology of the target tissue. These elements are integrated together through numerical calculation to form a complete three-dimensional virtual space model of the puncture simulation process. The model not only has high precision, but also can intuitively reflect the changes in the puncture process at different time points. Finally, a gyroscope puncture three-dimensional virtual space model corresponding to the selected puncture simulation process is generated by modeling.
优选地,对所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型进行穿刺路径动态模拟识别分析,以生成所选穿刺场景模拟过程对应的穿刺模拟训练路径。Preferably, a puncture path dynamic simulation recognition analysis is performed on the gyroscope puncture three-dimensional virtual space model corresponding to the selected puncture simulation process to generate a puncture simulation training path corresponding to the selected puncture scene simulation process.
在本发明实施例中,通过利用动态模拟分析工具(包括三维建模软件(如Blender或Maya)、有限元分析软件(如ANSYS或COMSOL)以及力学仿真软件(如MATLAB或Simulink))对先前所构建的陀螺仪穿刺三维虚拟空间模型进行穿刺路径的模拟识别与分析,该过程通过算法模拟穿刺针的运动轨迹,并与目标组织的物理特性进行实时交互,并通过使用计算机视觉技术和机器学习算法,分析不同穿刺路径的有效性和安全性,动态模拟工具能够评估穿刺过程中的可能风险,生成可视化的训练路径图,输出的穿刺模拟训练路径能够为实际穿刺操作提供参考依据,确保操作的准确性与安全性,最终模拟生成所选穿刺场景模拟过程对应的穿刺模拟训练路径。In an embodiment of the present invention, a dynamic simulation analysis tool (including three-dimensional modeling software (such as Blender or Maya), finite element analysis software (such as ANSYS or COMSOL) and mechanical simulation software (such as MATLAB or Simulink)) is used to simulate, identify and analyze the puncture path of the previously constructed gyroscope puncture three-dimensional virtual space model. The process simulates the motion trajectory of the puncture needle through an algorithm and interacts with the physical properties of the target tissue in real time. By using computer vision technology and machine learning algorithms, the effectiveness and safety of different puncture paths are analyzed. The dynamic simulation tool can evaluate the possible risks in the puncture process and generate a visual training path diagram. The output puncture simulation training path can provide a reference basis for the actual puncture operation to ensure the accuracy and safety of the operation. Finally, the puncture simulation training path corresponding to the selected puncture scene simulation process is simulated and generated.
进一步的,所述的对所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型进行穿刺路径动态模拟识别分析包括:Furthermore, the dynamic simulation and identification analysis of the puncture path of the gyroscope puncture three-dimensional virtual space model corresponding to the selected puncture simulation process includes:
对所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型进行穿刺关键节点标注,得到所选穿刺模拟过程对应的陀螺仪穿刺关键节点;Annotating key puncture nodes of the gyroscope puncture three-dimensional virtual space model corresponding to the selected puncture simulation process to obtain key puncture nodes of the gyroscope puncture corresponding to the selected puncture simulation process;
在本发明实施例中,通过在所选穿刺模拟过程中,首先构建对应的陀螺仪穿刺三维虚拟空间模型,并利用三维建模软件(如Blender或Maya),导入模型后进行关键节点的标注,其中关键节点包括穿刺的起始点、穿刺深度及目标组织的边界,通过在先前构建得到的陀螺仪穿刺三维虚拟空间模型中添加关键节点的标记,确保这些关键节点具有明确的坐标信息,每个关键节点的坐标通过三维坐标系统进行记录,最终得到所选穿刺模拟过程对应的陀螺仪穿刺关键节点。In an embodiment of the present invention, during the selected puncture simulation process, a corresponding gyroscope puncture three-dimensional virtual space model is first constructed, and after importing the model using three-dimensional modeling software (such as Blender or Maya), key nodes are annotated, wherein the key nodes include the starting point of the puncture, the puncture depth, and the boundary of the target tissue. By adding key node marks to the previously constructed gyroscope puncture three-dimensional virtual space model, it is ensured that these key nodes have clear coordinate information, and the coordinates of each key node are recorded through a three-dimensional coordinate system, and finally the gyroscope puncture key nodes corresponding to the selected puncture simulation process are obtained.
优选地,对所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型进行物理几何约束分析,以得到所选穿刺模拟过程对应的陀螺仪穿刺物理几何约束条件;Preferably, a physical geometric constraint analysis is performed on the gyroscopic puncture three-dimensional virtual space model corresponding to the selected puncture simulation process to obtain the gyroscopic puncture physical geometric constraint conditions corresponding to the selected puncture simulation process;
在本发明实施例中,通过对先前建模得到的所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型进行物理几何约束分析,以通过应用有限元分析软件(如ANSYS或COMSOL),对模型进行力学特性模拟,并设置材料属性、边界条件及施加的力,通过网格划分,获得模型的物理几何约束条件,这一过程确保模型在模拟穿刺过程中,能够真实反映物理行为,并明确各个部件间的相互作用,特别是在穿刺过程中可能遇到的物理几何应力分布情况,最终得到所选穿刺模拟过程对应的陀螺仪穿刺物理几何约束条件。In an embodiment of the present invention, a physical geometric constraint analysis is performed on the gyroscope puncture three-dimensional virtual space model corresponding to the selected puncture simulation process obtained by previous modeling, so as to simulate the mechanical properties of the model by applying finite element analysis software (such as ANSYS or COMSOL), and set material properties, boundary conditions and applied forces, and obtain the physical geometric constraint conditions of the model through meshing. This process ensures that the model can truly reflect the physical behavior during the simulated puncture process, and clarifies the interaction between the various components, especially the physical geometric stress distribution that may be encountered during the puncture process, and finally obtains the gyroscope puncture physical geometric constraint conditions corresponding to the selected puncture simulation process.
优选地,基于所选穿刺模拟过程对应的陀螺仪穿刺物理几何约束条件对相对应的陀螺仪穿刺关键节点进行穿刺路径预设跟踪分析,以生成所选穿刺模拟过程对应的陀螺仪穿刺约束预设路径;Preferably, based on the gyroscope puncture physical geometric constraint conditions corresponding to the selected puncture simulation process, a puncture path preset tracking analysis is performed on the corresponding gyroscope puncture key nodes to generate a gyroscope puncture constraint preset path corresponding to the selected puncture simulation process;
在本发明实施例中,通过结合先前仿真约束分析得到的所选穿刺模拟过程对应的陀螺仪穿刺物理几何约束条件对相对应的陀螺仪穿刺关键节点进行穿刺路径预设跟踪分析,以通过利用路径规划算法(如A*算法或Dijkstra算法),针对陀螺仪穿刺关键节点,生成针对相应的物理几何约束条件下初始的穿刺路径,该路径将考虑关键节点之间的距离、方向和约束条件,确保穿刺过程的顺利进行,生成的穿刺约束预设路径以数字形式记录,提供给后续动态模拟过程使用,最终跟踪生成所选穿刺模拟过程对应的陀螺仪穿刺约束预设路径。In an embodiment of the present invention, the puncture path preset tracking analysis is performed on the corresponding gyroscope puncture key nodes by combining the gyroscope puncture physical geometric constraint conditions corresponding to the selected puncture simulation process obtained by the previous simulation constraint analysis, so as to generate an initial puncture path under the corresponding physical geometric constraint conditions for the gyroscope puncture key nodes by utilizing a path planning algorithm (such as an A* algorithm or a Dijkstra algorithm). The path will take into account the distance, direction and constraint conditions between the key nodes to ensure the smooth progress of the puncture process. The generated puncture constraint preset path is recorded in digital form and provided for use in subsequent dynamic simulation processes, and finally the gyroscope puncture constraint preset path corresponding to the selected puncture simulation process is tracked and generated.
优选地,基于所选穿刺场景模拟过程对所选穿刺模拟过程对应的陀螺仪穿刺三维虚拟空间模型进行穿刺过程力学仿真分析,生成所选穿刺模拟过程对应的穿刺力学反应仿真场;Preferably, based on the selected puncture scene simulation process, a puncture process mechanical simulation analysis is performed on the gyroscope puncture three-dimensional virtual space model corresponding to the selected puncture simulation process to generate a puncture mechanical response simulation field corresponding to the selected puncture simulation process;
在本发明实施例中, 通过结合所选穿刺场景模拟过程对相对应建模生成的陀螺仪穿刺三维虚拟空间模型进行穿刺过程力学仿真分析,以通过使用力学仿真软件(如MATLAB或Simulink),对三维虚拟空间模型实施穿刺力学反应仿真,在该过程中,设定初始条件和施加的力,通过时间步长仿真穿刺过程,生成穿刺场景模拟过程中实际产生的力学反应仿真场,这一模拟不仅可视化穿刺时所需的力和反应,还可以分析不同深度下的力学表现,最终仿真生成所选穿刺模拟过程对应的穿刺力学反应仿真场。In an embodiment of the present invention, a mechanical simulation analysis of the puncture process is performed on the corresponding modeled gyroscope puncture three-dimensional virtual space model by combining the selected puncture scene simulation process, so as to implement puncture mechanical response simulation on the three-dimensional virtual space model by using mechanical simulation software (such as MATLAB or Simulink). In this process, the initial conditions and applied forces are set, and the puncture process is simulated by time steps to generate a mechanical response simulation field actually generated during the puncture scene simulation process. This simulation not only visualizes the force and response required for puncture, but also analyzes the mechanical performance at different depths, and finally generates a puncture mechanical response simulation field corresponding to the selected puncture simulation process.
优选地,根据所选穿刺模拟过程对应的穿刺力学反应仿真场对所选穿刺模拟过程对应的陀螺仪穿刺约束预设路径进行穿刺路径动态模拟识别分析,以生成所选穿刺场景模拟过程对应的穿刺模拟训练路径。Preferably, a puncture path dynamic simulation identification analysis is performed on the gyroscope puncture constraint preset path corresponding to the selected puncture simulation process according to the puncture mechanical response simulation field corresponding to the selected puncture simulation process, so as to generate a puncture simulation training path corresponding to the selected puncture scene simulation process.
在本发明实施例中,通过结合先前仿真生成的所选穿刺模拟过程对应的穿刺力学反应仿真场对穿刺约束预设路径进行动态模拟识别分析,以通过运用动态仿真软件(如Unity或Unreal Engine),将生成的力学反应应用于预设路径,通过实时模拟展现穿刺模拟过程中的动态变化,这一模拟分析能够识别潜在的路径偏差及不适应性,并根据仿真结果优化穿刺模拟训练路径,确保训练效果的准确性与有效性,生成的最佳穿刺训练路径将为实际穿刺训练提供参考依据,最终模拟生成所选穿刺场景模拟过程对应的穿刺模拟训练路径。In an embodiment of the present invention, a dynamic simulation identification analysis is performed on the preset path of the puncture constraint by combining the puncture mechanical response simulation field corresponding to the selected puncture simulation process generated by the previous simulation, so that the generated mechanical response is applied to the preset path by using dynamic simulation software (such as Unity or Unreal Engine), and the dynamic changes in the puncture simulation process are displayed through real-time simulation. This simulation analysis can identify potential path deviations and inadaptability, and optimize the puncture simulation training path according to the simulation results to ensure the accuracy and effectiveness of the training effect. The generated optimal puncture training path will provide a reference basis for actual puncture training, and finally simulate and generate the puncture simulation training path corresponding to the selected puncture scene simulation process.
以上所述仅是本发明的具体实施方式,使本领域技术人员能够理解或实现本发明。对这些实施例的多种修改对本领域的技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本发明的精神或范围的情况下,在其它实施例中实现。因此,本发明将不会被限制于本文所示的这些实施例,而是要符合与本文所发明的原理和新颖特点相一致的最宽的范围。The above description is only a specific embodiment of the present invention, so that those skilled in the art can understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but should conform to the widest scope consistent with the principles and novel features invented herein.
Claims (7)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411597848.7A CN119152745B (en) | 2024-11-11 | 2024-11-11 | Comprehensive puncture simulation system based on automatic injector |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411597848.7A CN119152745B (en) | 2024-11-11 | 2024-11-11 | Comprehensive puncture simulation system based on automatic injector |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN119152745A CN119152745A (en) | 2024-12-17 |
| CN119152745B true CN119152745B (en) | 2025-05-30 |
Family
ID=93815639
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202411597848.7A Active CN119152745B (en) | 2024-11-11 | 2024-11-11 | Comprehensive puncture simulation system based on automatic injector |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN119152745B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112071149A (en) * | 2020-09-17 | 2020-12-11 | 苏州智昕医教科技有限公司 | Wearable medical simulation puncture skill training system and method |
| CN213987999U (en) * | 2021-01-28 | 2021-08-17 | 天津市疾病预防控制中心 | An injection simulation teaching aid for teaching |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9013617B2 (en) * | 2012-10-12 | 2015-04-21 | Qualcomm Incorporated | Gyroscope conditioning and gyro-camera alignment |
| CN115046539A (en) * | 2021-03-09 | 2022-09-13 | 北京大学 | Dynamic calibration method for MEMS electronic compass |
| CN114201044A (en) * | 2021-12-09 | 2022-03-18 | 浙江理工大学 | A human-like tactile reproducing device and method with interactive function |
| CN116086493B (en) * | 2022-12-12 | 2026-02-17 | 武汉极目智能技术有限公司 | Nine-axis IMU calibration method, system, electronic equipment and storage medium |
| CN117975800A (en) * | 2024-03-18 | 2024-05-03 | 四川大学华西医院 | An interactive renal puncture simulation training model and simulation method thereof |
| CN118015905A (en) * | 2024-03-26 | 2024-05-10 | 沈阳宇宙宠儿电子科技有限公司 | Digital puncture needle and use method |
-
2024
- 2024-11-11 CN CN202411597848.7A patent/CN119152745B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112071149A (en) * | 2020-09-17 | 2020-12-11 | 苏州智昕医教科技有限公司 | Wearable medical simulation puncture skill training system and method |
| CN213987999U (en) * | 2021-01-28 | 2021-08-17 | 天津市疾病预防控制中心 | An injection simulation teaching aid for teaching |
Also Published As
| Publication number | Publication date |
|---|---|
| CN119152745A (en) | 2024-12-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12154455B2 (en) | Camera aided simulator for minimally invasive surgical training | |
| CN113706960B (en) | Nursing operation exercise platform based on VR technology and use method | |
| Basdogan et al. | VR-based simulators for training in minimally invasive surgery | |
| US9142145B2 (en) | Medical training systems and methods | |
| US9424761B2 (en) | Medical simulation system and method with configurable anatomy model manufacturing | |
| EP3998596B1 (en) | Augmented reality simulator for professional and educational training | |
| US8550821B2 (en) | Simulation system for arthroscopic surgery training | |
| US20180137782A1 (en) | Virtual Tool Manipulation System | |
| KR20190112817A (en) | Laparoscopic Training System | |
| US11164483B2 (en) | Medical simulator for the simulation of puncture operations | |
| CN201431466Y (en) | Human motion capture and thee-dimensional representation system | |
| US12354492B2 (en) | Vibrotactile method, apparatus and system for training and practicing dental procedures | |
| CN118982940A (en) | A combat trauma teaching and training system based on MR technology | |
| CN119479423A (en) | A virtual simulation operation training and analysis system for anesthesia puncture | |
| KR20190067966A (en) | Acupuncture Training Simulation System | |
| CN110767021B (en) | Robot joint replacement test system based on virtual reality technology | |
| CN119152745B (en) | Comprehensive puncture simulation system based on automatic injector | |
| CN113096509B (en) | Stress calculation method based on surgical operation suture stress model | |
| CN106924957A (en) | A kind of athletic training amount of exercise monitoring system | |
| Lahanas et al. | A simple sensor calibration technique for estimating the 3D pose of endoscopic instruments | |
| TW201443818A (en) | Object-oriented rehabilitation assisting system and operation setting method thereof | |
| JP2008134373A (en) | Method and system of preparing biological data for operation simulation, operation simulation method, and operation simulator | |
| Mirabella et al. | A motion capture system for sport training and rehabilitation | |
| Latham et al. | Review of medical simulation training for endovascular thrombectomy | |
| CN116631252A (en) | Physical examination simulation system and method based on mixed reality technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |