KR102274004B1 - Ultrasonic simulation system - Google Patents

Abstract

The present invention relates to an ultrasound simulation system for simulating ultrasound diagnosis through an ultrasound phantom by a user by manipulating a probe. The ultrasonic simulation system according to the present invention includes a body phantom of a body shape, a probe that is provided inside the body phantom, a sensor attached to each preset position, a probe that reacts with one of the sensors of the organ phantom from the outside of the body phantom, and probe manipulation When one of the sensor of the output unit, the probe, and the organ phantom, which outputs an ultrasound image of an organ according to the present invention matches a preset condition, the ultrasound image of the organ set in the corresponding sensor is output through the output unit, but different images depending on the disease It includes a control unit for outputting.

Description

Ultrasonic simulation system

The present invention relates to an ultrasound simulation system, and more particularly, to an ultrasound simulation system for simulating ultrasound diagnosis through an ultrasound phantom by a user by manipulating a probe.

Ultrasonic diagnostic equipment is a device that injects ultrasound generated from a probe into a diagnostic object, converts information contained in the returned ultrasound into an electrical signal, and displays it on a monitor, and is currently widely used in the medical industry. It is a medical diagnostic device.

Since the results of such ultrasound diagnosis vary greatly depending on the experience and knowledge of the examiner, the examination should be performed with sufficient theoretical knowledge and practical experience. However, due to the characteristics of ultrasound diagnosis, it is not possible to gain practical experience without actually having a patient, and even if there is an experience, there is a problem in that it is impossible to diagnose patients according to various diseases.

In order to solve this problem, Korean Patent Application Laid-Open No. 10-2009-0078487 discloses "a simulator for acquiring 3/4-dimensional ultrasound diagnosis technology and a simulation method thereof".

The disclosed simulator for acquiring ultrasound diagnosis technology is based on real data such as the human body, internal organs, and fetuses, and uses commercial software to model a three-dimensional image of a virtual patient's polygonal 3D/4D modeling data, location information, and movement. Virtual human body, internal organs, fetal data composed of information and color information, 3D probe data configured in a polygonal shape using the above commercial software, 3/4 dimensional modeling data of the virtual patient, and 3D probe modeling data are stored in a database and loading it from a computer equipment having a display means that can be realized on a screen, etc. to display the virtual human body in opaque/translucent mode, display the 3D probe on the screen, and enlarge/move/rotate the virtual human body and the 3D probe Thus, the two-dimensional ultrasound image is displayed on the screen at the same time according to the mutual location information, the region of interest of the two-dimensional ultrasound image and the driving information of the 3D probe are set, and the 3/4-dimensional image data is configured and visualized and displayed on the screen. , a computer device having a display means that can be realized on a screen or the like.

That is, the simulator for acquiring ultrasound diagnosis technology discloses the contents of realizing a 3/4D ultrasound image by manipulating a probe implemented on the simulator for a virtual patient to reproduce various clinical situations.

However, although the disclosed simulator for acquiring ultrasound diagnosis technology can perform ultrasound diagnosis virtually through simulation, it is difficult to obtain practical experience because it does not operate an actual probe, and it is difficult to obtain ultrasound diagnosis experience according to various diseases. there was

Accordingly, an object of the present invention is to provide an ultrasound simulation system for simulating ultrasound diagnosis through an ultrasound phantom by a user by manipulating a probe.

Another object of the present invention is to provide an ultrasound simulation system capable of obtaining ultrasound diagnosis experience according to various diseases.

The ultrasound simulation system according to the present invention includes a body-shaped body phantom, a probe that is provided inside the body phantom, and a sensor for each preset position is attached to the organ phantom, and a probe that reacts with one of the sensors of the organ phantom outside the body phantom , an output unit for outputting an ultrasound image of an organ according to the manipulation of the probe, and outputting an ultrasound image of an organ set in the corresponding sensor through the output unit when one of the probe and the sensor of the organ phantom matches a preset condition However, it is characterized in that it comprises a control unit for outputting different images according to the disease.

In the ultrasound simulation system according to the present invention, the control unit outputs an ultrasound image of an organ set in the corresponding sensor through the output unit when the position and the incident angle of the probe match values set for each sensor of the organ phantom characterized in that

In the ultrasound simulation system according to the present invention, the control unit determines the proficiency level of a user who operates the probe through user-specific information including a position of the probe, an incident angle, and a required time as the control unit operates the probe. do it with

In the ultrasound simulation system according to the present invention, the control unit learns the user's skill level according to the user-specific information of the probe through an artificial intelligence engine.

In the ultrasound simulation system according to the present invention, the control unit provides a mission of a difficulty corresponding to the skill level according to the determined skill level of the user.

In the ultrasound simulation system according to the present invention, the control unit provides a video with different diseases according to the determined skill level of the user, or provides a mission with a different guide voice according to the skill level of the user.

The ultrasound simulation system according to the present invention outputs an ultrasound image of an organ set in the corresponding sensor through the output unit when a preset condition is matched between the probe and one of the sensors of the organ phantom by the user manipulating the probe, thereby providing sufficient learning for the user. Give yourself time to gain experience with ultrasound diagnosis.

In addition, the ultrasound simulation system according to the present invention provides different images according to diseases, so that the user can learn cases that are difficult to observe normally, thereby improving work ability.

1 is a block diagram showing the configuration of an ultrasound simulation system according to an embodiment of the present invention.
2 is an exemplary diagram for explaining a body phantom according to an embodiment of the present invention.
3 is an exemplary diagram for explaining a long-term phantom according to an embodiment of the present invention.
4 to 7 are diagrams illustrating ultrasound simulation results for each location according to an embodiment of the present invention.
8 is a diagram for explaining the configuration of a deep neural network (DNN) according to an embodiment of the present invention.

Prior to the detailed description of the present invention, the terms or words used in the present specification and claims described below should not be construed as being limited to their ordinary or dictionary meanings, and the inventors should develop their own inventions in the best way. For explanation, it should be interpreted as meaning and concept consistent with the technical idea of the present invention based on the principle that it can be appropriately defined as a concept of a term. Accordingly, the embodiments described in this specification and the configurations shown in the drawings are only the most preferred embodiments of the present invention, and do not represent all of the technical spirit of the present invention, so various equivalents that can be substituted for them at the time of the present application It should be understood that there may be water and variations.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this case, it should be noted that the same components in the accompanying drawings are denoted by the same reference numerals as possible. In addition, detailed descriptions of well-known functions and configurations that may obscure the gist of the present invention will be omitted. For the same reason, some components are exaggerated, omitted, or schematically illustrated in the accompanying drawings, and the size of each component does not fully reflect the actual size.

1 is a block diagram showing the configuration of an ultrasound simulation system according to an embodiment of the present invention, FIG. 2 is an exemplary diagram for explaining a body phantom according to an embodiment of the present invention, and FIG. 3 is an embodiment of the present invention It is an exemplary view for explaining a long-term phantom according to the present invention, and FIGS. 4 to 7 are views showing ultrasound simulation results for each location according to an embodiment of the present invention.

1 to 3 , the ultrasound simulation system 100 according to an embodiment of the present invention includes a phantom 10 , a probe 20 , an input unit 30 , an output unit 40 , a storage unit 50 and a control unit 60 .

The phantom 10 is a model used as a substitute for a human body undergoing an ultrasound examination, and is used to measure the distribution of ultrasound in a material, such as diffusion, attenuation, and scattering of ultrasound in an object. The phantom 10 may include a body phantom 11 and an organ phantom 12 .

The body phantom 11 may have a body shape as shown in FIG. 2 , and the probe 20 comes into contact with the outer surface. The body phantom 11 may be made of a material capable of forming a touch and shape similar to that of a real body so that a user can obtain an experience similar to that of actually contacting the probe 20 with the body.

In addition, the body phantom 11 is provided with a space capable of accommodating the organ phantom 12 therein, so that the organ phantom 12 can be accommodated therein.

The organ phantom 12 is provided inside the body phantom 11, and a sensor 21a may be attached to each preset position. At this time, the organ phantom 12 is composed of a plurality of sensors 12a and may be disposed at a preset position, but preferably, as shown in FIG. 3 , it is formed in a shape similar to that of an actual organ, and a sensor is located in each part. (12a) may be attached.

This long-term phantom 12 reacts with the probe 20, and when the position and the incident angle of the probe 20 match the values set in each sensor 12a, the controller 60 controls the corresponding position and incident angle. Information may be transmitted to the controller 60 to output an ultrasound image corresponding to a corresponding position and an incident angle through the output unit 40 .

For example, the organ phantom 12 may be used in various applications such as echocardiography, epigastric ultrasound examination, liver ultrasound examination, varicose vein ultrasound examination, gynecological ultrasound examination, prostate ultrasound examination, testicular ultrasound examination, musculoskeletal ultrasound examination, thyroid ultrasound examination, breast ultrasound examination, etc. A sensor 12a may be arranged to simulate a type of ultrasound examination. Meanwhile, in the following description, echocardiography will be described as an example.

The probe 20 has the same shape as an actual ultrasound probe, and may react with a sensor provided in the organ phantom 12 . For example, the probe 20 may include an ultrasonic sensor, an infrared sensor, a gyro sensor, and the like, and various sensors capable of reacting with a sensor provided in the organ phantom 12 may be applied. On the other hand, when one of the sensors of the probe 20 and the long-term phantom 12 reacts, the probe 20 transmits information on the position and incident angle of the corresponding sensor to the controller 60 or the corresponding sensor of the long-term phantom 12 responds. It may be transmitted to the control unit 60 , but it is preferable to transmit information on the position and incident angle of the sensor to which the probe 20 responds to the control unit 60 . Also, the probe 20 may continuously transmit the current location, current incident angle information, etc. to the real-time controller 60 .

The input unit 30 receives various information such as number and character information, and transmits input signals related to setting various functions and controlling functions of the ultrasound simulation system 100 to the control unit 60 . The input unit 30 may include at least one of a keypad and a touchpad that generate an input signal according to a touch or manipulation. In this case, the input unit 50 may be configured in the form of a single touch panel (or touch screen) together with the display unit 41 to perform input and display functions at the same time. In particular, the input unit 30 may input information about a user who operates the probe 20 and the type of disease to be simulated.

The output unit 40 may include a display unit 41 and a speaker 42 .

The display unit 41 displays information about a series of operation states and operation results that occur while the function of the ultrasound simulation system 100 is performed. In particular, the display unit 41 may output an ultrasound image, information for each user, a skill level for each user, and the like. Here, the display unit 41 includes a liquid crystal display (LCD), an ultra-thin liquid crystal display (TFT-LCD, Thin Film Transistor LCD), a light emitting diode (LED, Light Emitting Diode), and an organic light emitting diode (OLED, Organic LED). ), an active organic light emitting diode (AMOLED, Active Matrix OLED), a retina display, a flexible display, and a three-dimensional display. In this case, when the display unit 41 is configured in the form of a touch screen, some or all of the functions of the input unit 30 may be performed.

The speaker 42 may output a guide voice for a guide related to the operating state of the probe 20 under the control of the controller 60 . For example, the speaker 42 is "adjust the angle of incidence within 60°." As such, as the user manipulates the probe 20 , a guide voice for a guide may be output. At this time, the speaker 42 may output a different guide voice according to the skill level of the user under the control of the controller 60 .

The storage unit 50 is a device for storing data, and stores an application program required for a functional operation of the ultrasound simulation system 100 . When each function is activated in response to a user's request, the storage unit 50 executes corresponding application programs under the control of the control unit 60 to provide each function. In particular, the storage unit 50 includes a program for outputting an ultrasound image according to the position and angle of incidence of the probe 20 , a program for outputting an ultrasound image according to a disease, and an ultrasound image according to the position, angle of incidence, and disease of the probe 20 . can be saved. The storage unit 50 includes a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (eg, SD or XD memory). , Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory, ROM, Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory , a magnetic disk, and an optical disk may include at least one storage medium.

When one of the sensors of the probe 20 and the organ phantom 12 matches a preset condition, the controller 60 may output an ultrasound image of the organ set in the corresponding sensor through the display unit 41 . At this time, when the position and the incident angle of the probe 20 match the values set for each sensor of the organ phantom 41 , the controller 60 may output the ultrasound image of the organ set in the corresponding sensor through the display unit 41 . have.

For example, when the first sensor 1 and the probe 20 match among the plurality of sensors 12a of FIG. 2 , the controller 60 may determine the incidence angle of a Parasternal long axis ( FIG. 4 ) or a Parasternal short axis ultrasound image. can be printed out. Also, when the second sensor 2 and the probe 20 coincide with each other, the controller 60 may output an apical 4 chamber ( FIG. 5 ), an apical 2 chamber, and an apical 3 chamber ultrasound image. In addition, when the third sensor 3 and the probe 20 match, the controller 60 may output an ultrasound image corresponding to a subcostal ( FIG. 6 ), and the fourth sensor 4 and the probe 20 are If they match, an ultrasound image corresponding to the suprasternal notch ( FIG. 7 ) may be output.

Here, when the control unit 60 receives disease information selected through the input unit 30 , and the position and incidence angle of the probe 20 match the values set in each sensor of the organ phantom 41 , the ultrasonic wave according to the disease information You can output an image. That is, the controller 60 may output an ultrasound image of an organ to which each disease is applied.

Also, as the user manipulates the probe 20 , the controller 60 may determine the proficiency of the user in operating the probe 20 through user-specific information including the position of the probe 20 , the angle of incidence, and the required time. . That is, the controller 60 may receive user-specific information from the probe 20 and determine the user's proficiency in consideration of ultrasound diagnosis accuracy and required time.

Also, the controller 60 may learn the user's skill level according to the user-specific information of the probe 20 through the artificial intelligence engine. Accordingly, the control unit 60 may increase the accuracy according to the user's skill level determination.

Here, the control unit 60 may provide a mission of a difficulty corresponding to the determined skill level of the user. For example, the controller 60 may provide a video in which a disease is different according to the determined skill level of the user, or a mission in which a guide voice is changed according to the skill level of the user. That is, the controller 60 outputs a detailed guidance voice according to the state of the probe 20 to a user whose proficiency is lower than a preset value, and a basic guidance voice according to the state of the probe 20 to a user whose proficiency is higher than a preset value. It can be configured to output only

Meanwhile, FIG. 8 is a diagram for explaining the configuration of a deep neural network (DNN) according to an embodiment of the present invention. Here, the learning of the following proficiency is described as using a deep neural network, but various artificial intelligence engines are applicable.

Referring to FIG. 8 , a deep neural network (DNN) may be a multilayer perceptron (MLP). A deep neural network (DNN) includes multiple layers (IL, HL, OL). The plurality of layers includes an input layer (IL), a plurality of hidden layers (HL: HL1 to HLk), and an output layer (OL).

In addition, each of the plurality of layers IL, HL, and OL includes a plurality of nodes. For example, as shown, the input layer IL may include m input nodes i1 to im, and the output layer OL may include n output nodes o1 to on. In addition, among the hidden layers HL, the first hidden layer HL1 includes a nodes h11 to h1a, the second hidden layer HL2 includes b nodes h21 to h2b, and the kth hidden layer HL2 includes the k nodes. The layer HLk may include l nodes hk1 to hkl.

Each of the plurality of nodes of the plurality of layers performs an operation. In particular, a plurality of nodes of different layers are connected by a channel (indicated by a dotted line) having a weight (W). In other words, the calculation result of one node is weighted and becomes the input of the next layer node. That is, any one node of any one layer of a deep neural network (DNN) receives a value obtained by applying a weight to the input from the node of the previous layer, sums them up, takes an activation function, and transmits the result to the input of the next layer do.

Accordingly, when user-specific information, i.e., the position of the probe, the angle of incidence, the required time, etc., is input to the input layer (IL) of the deep neural network (DNN), the deep neural network (DNN) performs a plurality of measurements (IL) on the input data. , HL, OL) is performed to calculate an output value indicating the proficiency level of the inputted user-specific information by performing a plurality of calculations.

More specifically, when at least one of the probe position, the angle of incidence, and the required time, which are user-specific information, is input to the plurality of input nodes i1 to im of the input layer IL of the deep neural network (DNN), the first Each of the plurality of first hidden nodes h11 to h1a of the hidden layer HL1 receives a value in which a weight is applied to each process analysis result value of the plurality of input nodes i1 to im (indicated by a dotted line), and the input value After summing all , an operation according to the activation function is performed on the summed values to calculate a plurality of first hidden node values. Then, each of the plurality of second hidden nodes h21 to h2b of the second hidden layer HL2 receives a value in which a weight is applied to each of the plurality of first hidden node values of the plurality of first hidden nodes h11 to h1a. (indicated by a dotted line), all input values are summed, and a plurality of second hidden node values are calculated by performing an operation according to the activation function on the summed values. In this way, a weight is applied to a previous node value in the hidden layer HL and transmitted, and a current node value is calculated through calculation. By repeating this process, a plurality of k-th hidden node values of the plurality of k-th hidden nodes hk1 to hkl of the k-th hidden layer HLk may be calculated.

Each of the plurality of output nodes (o1 to on) has a weight w = [w1, w2] for a plurality of (l) kth hidden node values of a plurality of kth hidden nodes (hk1 to hkl) of the kth hidden layer (HLk). , … , wl] is input (indicated by a dotted line), summing all the input values, and then calculating the output value by performing an operation on the summed values according to the activation function.

As such, in the ultrasound simulation system 100 according to an embodiment of the present invention, the user operates the probe 20 so that one of the probe 20 and the sensor 12a of the organ phantom 12 matches a preset condition. In this case, by outputting an ultrasound image of an organ set in the corresponding sensor through the output unit 40, sufficient learning time is provided to the user to obtain an ultrasound diagnosis experience.

In addition, the ultrasound simulation system 100 according to an embodiment of the present invention provides different images according to diseases, so that the user learns a case that is difficult to observe normally, thereby improving work ability.

Although the present invention has been described above using several preferred embodiments, these examples are illustrative and not restrictive. As such, those of ordinary skill in the art to which the present invention pertains will understand that various changes and modifications can be made in accordance with the doctrine of equivalents without departing from the spirit of the present invention and the scope of rights set forth in the appended claims.

10: phantom 11: body phantom
12: long phantom 20: probe
30: input unit 40: output unit
41: display unit 42: speaker
50: storage unit 60: control unit

Claims (6)

body shape body phantom;
a long-term phantom provided inside the body phantom, to which a sensor is attached for each preset position;
a probe that reacts with one of the sensors of the organ phantom outside the body phantom;
an output unit for outputting an ultrasound image of an organ according to the manipulation of the probe;
a controller configured to output, through the output unit, an ultrasound image of an organ set in the corresponding sensor when one of the probe and one of the sensors of the organ phantom matches a preset condition, but outputting a different image according to a disease; including,
The control unit is
As the probe is manipulated, the user's proficiency in manipulating the probe is determined through user-specific information including the position, incident angle, and required time of the probe, and the user's proficiency is artificially calculated according to the user-specific information of the probe. It learns through the intelligence engine, and provides a mission of a difficulty corresponding to the skill level according to the determined skill level of the user, but provides a video with different diseases according to the determined skill level of the user, or provides a guide voice according to the skill level Ultrasound simulation system, characterized in that it provides a mission. According to claim 1,
The control unit is
When the position and the incident angle of the probe match the values set in each sensor of the organ phantom, the ultrasound image of the organ set in the corresponding sensor is output through the output unit. delete delete delete delete

Images