CN110163185B - Vein image acquisition method and related product - Google Patents

Abstract

The embodiment of the application discloses a vein image acquisition method and a related product, which are applied to electronic equipment, wherein the electronic equipment comprises a vein identification module and an ultrasonic sensor, and the method comprises the following steps: determining target characteristic parameters of skin of a preset part of a target object through the ultrasonic sensor; determining a target vein image acquisition parameter of the vein identification module according to the target characteristic parameter; and carrying out vein acquisition through the vein identification module according to the target vein image acquisition parameters to obtain a target vein image. Adopt this application embodiment, can be through ultrasonic sensor perception skin information in advance, and then, according to skin information adjustment vein image acquisition parameter, so, can promote vein image acquisition efficiency.

Description

Vein image acquisition method and related products

technical field

This application relates to the technical field of electronic equipment, in particular to a vein image acquisition method and related products.

Background technique

With the popularization and application of electronic devices (such as mobile phones, tablet computers, etc.), electronic devices can support more and more applications, and their functions are becoming more and more powerful. Indispensable electronic supplies.

For electronic equipment, security has always been the focus of electronic equipment. With the development of technology, vein recognition technology has also become a popular biometric technology for electronic equipment. How to improve the efficiency of vein image collection needs to be solved urgently.

Contents of the invention

Embodiments of the present application provide a vein image collection method and related products, which can improve the vein image collection efficiency.

In the first aspect, the embodiment of the present application provides an electronic device, the electronic device includes a vein recognition module, an ultrasonic sensor and a processing circuit, wherein,

The ultrasonic sensor is used to determine the target characteristic parameters of the skin of the preset part of the target object;

The processing circuit is used to determine the target vein image acquisition parameters of the vein identification module according to the target characteristic parameters;

The vein recognition module is used to collect veins according to the target vein image collection parameters to obtain target vein images.

In the second aspect, the embodiment of the present application provides a vein image acquisition method, which is applied to an electronic device, and the electronic device includes a vein recognition module and an ultrasonic sensor, and the method includes:

Determining the target characteristic parameters of the skin of the preset part of the target object through the ultrasonic sensor;

Determine the target vein image acquisition parameters of the vein recognition module according to the target characteristic parameters;

The vein recognition module performs vein collection according to the target vein image collection parameters to obtain the target vein image.

In the third aspect, the embodiment of the present application provides a vein image acquisition device, which is applied to electronic equipment, and the electronic equipment includes a vein identification module and an ultrasonic sensor, and the device includes:

A first determining unit, configured to determine target characteristic parameters of the skin of a preset part of the target object through the ultrasonic sensor;

A second determining unit, configured to determine target vein image acquisition parameters of the vein identification module according to the target characteristic parameters;

The acquisition unit is configured to perform vein acquisition by the vein identification module according to the acquisition parameters of the target vein image to obtain the target vein image.

In a fourth aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and are configured to be processed by the above The above program includes instructions for executing the steps in the second aspect of the embodiments of the present application.

In the fifth aspect, the embodiment of the present application provides a computer-readable storage medium, wherein the above-mentioned computer-readable storage medium stores a computer program for electronic data exchange, wherein the above-mentioned computer program enables the computer to execute Some or all of the steps described in the second aspect.

In a sixth aspect, an embodiment of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable the computer to execute the program as implemented in the present application. Example of some or all of the steps described in the second aspect. The computer program product may be a software installation package.

It can be seen that the vein image acquisition method and related products described in the embodiments of the present application are applied to electronic equipment, and the electronic equipment includes a vein recognition module and an ultrasonic sensor, and the ultrasonic sensor determines the target of the skin of the preset part of the target object. The characteristic parameter is to determine the target vein image acquisition parameters of the vein recognition module according to the target characteristic parameters, and the vein recognition module performs vein acquisition according to the target vein image acquisition parameters to obtain the target vein image, which can pre-perceive the skin information through the ultrasonic sensor, and then, The vein image acquisition parameters are adjusted according to the skin information, so that the vein image acquisition efficiency can be improved.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1A is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

FIG. 1B is a schematic flowchart of a vein image acquisition method provided in an embodiment of the present application;

Fig. 2 is a schematic flow chart of another vein image acquisition method provided by the embodiment of the present application;

Fig. 3 is a schematic flow chart of another vein image acquisition method provided by the embodiment of the present application;

FIG. 4 is a schematic structural diagram of another electronic device provided by an embodiment of the present application;

FIG. 5A is a block diagram of functional units of a vein image acquisition device provided in an embodiment of the present application;

Fig. 5B is a block diagram of functional units of another vein image acquisition device provided by the embodiment of the present application.

Detailed ways

In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiment of the application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiment of the application. Obviously, the described embodiment is only It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

The terms "first", "second" and the like in the specification and claims of the present application and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "include" and "have", as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally further includes For other steps or units inherent in these processes, methods, products or devices.

Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The occurrences of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is understood explicitly and implicitly by those skilled in the art that the embodiments described herein can be combined with other embodiments.

The electronic devices involved in the embodiments of the present application may include various handheld devices with wireless communication functions, vehicle-mounted devices, wearable devices (smart watches, smart bracelets, wireless earphones, augmented reality/virtual reality devices, smart glasses), A computing device or other processing device connected to a wireless modem, and various forms of user equipment (UE), mobile station (mobile station, MS), terminal device (terminal device) and so on.

The following describes the embodiments of the present application in detail.

Please refer to FIG. 1A. FIG. 1A is a schematic structural diagram of an electronic device disclosed in an embodiment of the present application. The electronic device 100 includes a storage and processing circuit 110, and a sensor 170 connected to the storage and processing circuit 110. The sensor 170 includes a camera. ,in:

Electronic device 100 may include control circuitry, which may include storage and processing circuitry 110 . The storage and processing circuit 110 can be memory, such as hard disk drive memory, non-volatile memory (such as flash memory or other electronically programmable read-only memory used to form a solid-state drive, etc.), volatile memory (such as static or dynamic random access memory, etc.) access memory, etc.), etc., the embodiment of the present application is not limited. Processing circuitry in storage and processing circuitry 110 may be used to control the operation of electronic device 100 . The processing circuit may be implemented based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio codec chips, application specific integrated circuits, display driver integrated circuits, and the like.

The storage and processing circuit 110 can be used to run software in the electronic device 100, such as Internet browsing applications, Voice over Internet Protocol (Voice over Internet Protocol, VOIP) telephone call applications, email applications, media playback applications, operating system functions wait. These software can be used to perform control operations such as camera based image acquisition, ambient light measurement based on ambient light sensor, proximity sensor based measurement based on proximity sensor, information based on status indicators such as status indicators such as LEDs Display functions, touch sensor based touch event detection, functions associated with displaying information on multiple (e.g. layered) display screens, operations associated with performing wireless communication functions, functions associated with collecting and generating audio signals Operations, control operations associated with collecting and processing button press event data, and other functions in the electronic device 100 are not limited by this embodiment of the present application.

The electronic device 100 may include an input-output circuit 150 . The input-output circuit 150 can be used to enable the electronic device 100 to realize data input and output, that is, allow the electronic device 100 to receive data from external devices and also allow the electronic device 100 to output data from the electronic device 100 to external devices. The input-output circuit 150 may further include a sensor 170 . The sensor 170 may include a vein recognition module and an ultrasonic sensor, and may also include an ambient light sensor, a proximity sensor based on light and capacitance, a fingerprint recognition module, a touch sensor (for example, based on an optical touch sensor and/or a capacitive touch sensor, wherein , the touch sensor can be a part of the touch display screen, or can be used independently as a touch sensor structure), acceleration sensor, camera, and other sensors, etc. The camera can be a front camera or a rear camera, and the fingerprint recognition module can be integrated Under the display screen, it is used to collect fingerprint images. The fingerprint recognition module can be at least one of the following: an optical fingerprint recognition module, an ultrasonic fingerprint recognition module, etc., which are not limited here.

Wherein, the vein recognition module can be integrated and arranged under the display screen, or the vein recognition module can also be arranged on the back of the housing of the electronic device, or the vein recognition module can also be arranged on the side of the electronic device. Specifically, the vein identification module may include an infrared lamp and a vein image acquisition module. The infrared lamp can emit infrared light. When the infrared light irradiates the skin of human veins, the infrared light will pass through the skin, and the vein will reflect, thereby forming a vein pattern image. , so that the vein image can be collected by the vein image collection module.

Input-output circuitry 150 may also include one or more display screens, such as display screen 130 . The display screen 130 may include one or a combination of liquid crystal display screens, organic light emitting diode display screens, electronic ink display screens, plasma display screens, and display screens using other display technologies. Display 130 may include an array of touch sensors (ie, display 130 may be a touch-sensitive display). The touch sensor may be a capacitive touch sensor formed from an array of transparent touch sensor electrodes such as indium tin oxide (ITO) electrodes, or may be a touch sensor formed using other touch technologies such as acoustic touch, pressure sensitive touch, resistive touch Touch, optical touch, etc. are not limited in this embodiment of the application.

The electronic device 100 may also include an audio component 140 . The audio component 140 may be used to provide audio input and output functions for the electronic device 100 . The audio components 140 in the electronic device 100 may include speakers, microphones, buzzers, tone generators, and other components for generating and detecting sounds.

The communication circuit 120 can be used to provide the electronic device 100 with the ability to communicate with external devices. The communication circuit 120 may include analog and digital input-output interface circuits, and wireless communication circuits based on radio frequency signals and/or optical signals. Wireless communication circuitry in communication circuitry 120 may include radio frequency transceiver circuitry, power amplifier circuitry, low noise amplifiers, switches, filters, and antennas. For example, the wireless communication circuit in the communication circuit 120 may include a circuit for supporting near field communication (Near Field Communication, NFC) by transmitting and receiving near field coupled electromagnetic signals. For example, communication circuitry 120 may include a near field communication antenna and a near field communication transceiver. Communications circuitry 120 may also include cellular telephone transceiver circuitry and antennas, wireless local area network transceiver circuitry and antennas, and the like.

The electronic device 100 may further include a battery, a power management circuit and other input-output units 160 . The input-output unit 160 may include buttons, joysticks, click wheels, scroll wheels, touch pads, keypads, keyboards, cameras, light emitting diodes and other status indicators, and the like.

A user can input commands through the input-output circuit 150 to control the operation of the electronic device 100 , and can use the output data of the input-output circuit 150 to receive status information and other outputs from the electronic device 100 .

Based on the electronic device described in FIG. 1A above, it can be used to realize the following functions:

The ultrasonic sensor is used to determine the target characteristic parameters of the skin of the preset part of the target object;

The processing circuit is used to determine the target vein image acquisition parameters of the vein identification module according to the target characteristic parameters;

The vein recognition module is used to collect veins according to the target vein image collection parameters to obtain target vein images.

In a possible example, in terms of determining the target characteristic parameters of the skin of the preset part of the target object, the ultrasonic sensor is specifically used for:

Acquiring target physiological characteristic parameters of the target object;

According to the correspondence between the preset physiological characteristic parameters and the working parameters of the ultrasonic sensor, determine the target working parameters corresponding to the target physiological characteristic parameters;

performing image acquisition on a preset part of the target object with the target working parameters by the ultrasonic sensor to obtain a 3D image of the target;

Parameter extraction is performed on the target 3D image to obtain target feature parameters of the skin.

In a possible example, when the target characteristic parameters include skin thickness, in terms of performing parameter extraction on the target 3D image to obtain the target characteristic parameters of the skin, the ultrasonic sensor is specifically used for:

Performing vein recognition on the target 3D image to obtain a target vein area;

selecting a plurality of test points in the target vein area;

determining the shortest distance between the skin surface and each of the plurality of test points according to the 3D image to obtain a plurality of shortest distances;

The average value of the multiple shortest distances is taken as the skin thickness.

In a possible example, in terms of determining the target vein image acquisition parameters of the vein identification module according to the target characteristic parameters, the processing circuit is specifically configured to:

According to the preset mapping relationship between characteristic parameters and vein image acquisition parameters, the target vein image acquisition parameters corresponding to the vein identification module corresponding to the target characteristic parameters are determined.

In a possible example, the processing circuit is further specifically configured to:

performing image segmentation on the target vein image to obtain a target vein region image;

performing feature extraction on the image of the target vein region to obtain a set of target feature points;

Dividing the image of the target vein region into multiple regions, each of which has the same area size;

Determining the number of feature points in each of the multiple areas according to the set of target feature points to obtain multiple numbers of feature points;

Selecting a number of feature points greater than a preset threshold from the plurality of feature point numbers to obtain at least one target feature point number, and acquiring an area corresponding to the at least one target feature point number to obtain at least one target area;

Acquiring a preset vein template corresponding to the preset location;

matching the feature points corresponding to the at least one target area with the feature points corresponding to the preset vein template to obtain a target matching value;

When the target matching value is greater than the preset matching threshold, it is confirmed that the vein identification is successful.

It can be seen that the electronic device described in the embodiment of the present application includes a vein identification module and an ultrasonic sensor, and the target characteristic parameter of the skin of the preset part of the target object is determined by the ultrasonic sensor, and the vein is determined according to the target characteristic parameter. Identify the target vein image acquisition parameters of the module. The vein identification module performs vein acquisition according to the target vein image acquisition parameters to obtain the target vein image. The ultrasonic sensor can pre-perceive the skin information, and then adjust the vein image acquisition parameters according to the skin information. In this way, the vein image collection efficiency can be improved.

Please refer to Figure 1B, Figure 1B is a schematic flow diagram of a vein image acquisition method provided by the embodiment of the present application, as shown in the figure, it is applied to the electronic device shown in Figure 1A, and the electronic device includes a vein recognition module and Ultrasonic sensor, the vein image acquisition method includes:

101. Determine, by using the ultrasonic sensor, target characteristic parameters of skin of a preset part of a target object.

Wherein, in the embodiment of the present application, the target object may be a human being, or other animals, which is not limited here. The preset position can be set by the user or defaulted by the system. The preset position can be at least one of the following: fingers, palms, arms, thighs, neck, etc., which are not limited here. Since the ultrasonic sensor has a certain penetrating ability, according to this characteristic, some characteristics of the user's skin can be sensed in advance through the ultrasonic sensor, so that the vein image acquisition parameters can be adjusted from person to person. For example, different people have different skin tissues, and some people have thick skin, so it may be difficult for the infrared light emitted by the vein recognition module to penetrate the skin.

In addition, the above-mentioned target feature parameter may be at least one of the following: skin thickness, vein location, skin roughness, skin laxity, whether there is a tattoo, skin age, etc., which is not limited here. Skin thickness can be understood as the shortest distance between the skin surface and veins, and vein location can be understood as the position of veins.

In a possible example, the above step 101, using the ultrasonic sensor to determine the target characteristic parameters of the skin of the preset part of the target object, may include the following steps:

11. Obtaining target physiological characteristic parameters of the target object;

12. According to the corresponding relationship between the preset physiological characteristic parameters and the working parameters of the ultrasonic sensor, determine the target working parameters corresponding to the target physiological characteristic parameters;

13. Using the ultrasonic sensor to collect images of preset parts of the target object with the target working parameters to obtain a 3D image of the target;

14. Perform parameter extraction on the target 3D image to obtain target feature parameters of the skin.

Wherein, in the embodiment of the present application, the physiological characteristic parameter may be one of the following: age, height, weight, fat percentage, blood type, medical history, occupation, gender, race, blood pressure, blood fat, etc., which are not limited herein. The electronic device can pre-store the corresponding relationship between the preset physiological characteristic parameters and the working parameters of the ultrasonic sensor. In specific implementation, the electronic device can obtain the target physiological characteristic parameters of the target object, and then determine the target physiological characteristic according to the corresponding relationship The target working parameters corresponding to the parameters can control the ultrasonic sensor to collect images of the preset parts of the target object with the target working parameters to obtain the target 3D image, and extract the parameters of the target 3D image to obtain the target characteristic parameters of the skin. The initial positioning of veins is achieved by ultrasonic technology, which facilitates better adjustment of vein acquisition parameters in the follow-up to acquire high-quality vein images.

In a possible example, when the target characteristic parameters include skin thickness, the above step 14, performing parameter extraction on the target 3D image to obtain the target characteristic parameters of the skin, may include the following steps:

141. Perform vein recognition on the target 3D image to obtain a target vein area;

142. Select multiple test points in the target vein area;

143. Determine the shortest distance between the skin surface and each of the multiple test points according to the 3D image, to obtain multiple shortest distances;

144. Use the average value of the multiple shortest distances as the skin thickness.

Among them, the electronic device can identify the veins of the 3D image, specifically, convert the 3D image into a 2D image, perform image segmentation on the 2D image, that is, determine the target vein area, or take a cross-section of the 3D image, According to the image corresponding to the cross section, the target vein area can be determined, and multiple test points can be selected in the target vein area, and the shortest distance between the skin surface and multiple test points can be determined according to the 3D image, and multiple shortest distances can be obtained. The average value of multiple shortest distances can be taken as the skin thickness.

102. Determine target vein image acquisition parameters of the vein identification module according to the target feature parameters.

Among them, the target feature parameters reflect some characteristics of the skin to a certain extent, such as skin thickness, skin density, etc. Therefore, the target vein image acquisition parameters of the vein recognition module can be determined according to the target feature parameters.

In a possible example, the above step 102, determining the target vein image acquisition parameters of the vein recognition module according to the target characteristic parameters, may include the following steps:

According to the preset mapping relationship between characteristic parameters and vein image acquisition parameters, the target vein image acquisition parameters corresponding to the vein identification module corresponding to the target characteristic parameters are determined.

Wherein, the mapping relationship between preset characteristic parameters and vein image acquisition parameters can be pre-stored in the electronic device, and then, the target vein image acquisition parameters corresponding to the vein identification module corresponding to the target characteristic parameters can be determined according to the mapping relationship.

103. Use the vein recognition module to collect veins according to the target vein image collection parameters to obtain target vein images.

Wherein, the above-mentioned target vein acquisition parameters may include at least one of the following parameters: operating current of the vein identification module, operating voltage of the vein identification module, operating power of the vein identification module, operating frequency of the vein identification module, vein identification module The frequency band of the infrared light of the group, the wavelength of the infrared light of the vein recognition module, the emission power of the infrared light of the vein recognition module, etc. are not limited here. In a specific implementation, the electronic device may perform vein collection according to the target vein collection parameter set to obtain a target vein image.

Optionally, the above-mentioned target vein image may be a vein image of any part of the user's body, for example, finger veins, palm veins, leg veins, main veins, etc., which are not limited here. In specific implementation, which part needs to be obtained Vein, you can perform vein acquisition on this part, that is, you can get the image of the target vein.

In the specific implementation, when the preset part of the user's body is close to the vein recognition module of the electronic device, the vein recognition module can be used to collect the target vein with the target vein collection parameter set to obtain the target vein image, and the preset part can be determined by the user. Set by yourself or default by the system, the preset position can be at least one of the following: fingers, palms, arms, thighs, neck, etc., which are not limited here.

In a possible example, after the above step 103, the following steps may also be included:

A1. Segmenting the image of the target vein to obtain an image of the target vein region;

A2, performing feature extraction on the image of the target vein region to obtain a set of target feature points;

A3. Dividing the image of the target vein region into multiple regions, each of which has the same area size;

A4. Determine the number of feature points in each of the multiple areas according to the set of target feature points to obtain multiple numbers of feature points;

A5. Select a number of feature points greater than a preset threshold from the plurality of feature point numbers to obtain at least one target feature point number, and obtain an area corresponding to the at least one target feature point number to obtain at least one target area;

A6. Obtaining a preset vein template corresponding to the preset location;

A7. Match the feature points corresponding to the at least one target area with the feature points corresponding to the preset vein template to obtain a target matching value;

A8. When the target matching value is greater than the preset matching threshold, confirm that the vein recognition is successful.

Wherein, the above-mentioned preset threshold, preset vein template, and preset matching threshold can be set by the user or defaulted by the system. Multiple preset vein templates can be pre-stored in the electronic device, and different parts can correspond to different vein templates. For example, a finger corresponds to a finger vein template, a palm corresponds to a palm vein template, and so on.

In the specific implementation, the target vein image can be image segmented to obtain the target vein region image, and then feature extraction is performed on the target vein region image to obtain the target feature point set, and the target vein region image can be divided into multiple regions, each The size of the area is the same, the number of feature points in each area can be determined according to the target feature point set, and the number of multiple feature points can be obtained. The number of feature points reflects the image quality to a certain extent, and the image quality of the area is good. There are many corresponding feature points. Because the thickness of the user’s skin is different, the collection of veins in some parts may be incomplete. Therefore, the area with clear veins can be selected for vein recognition, that is, select the number of feature points greater than Preset the number of feature points with a threshold value to obtain at least one target feature point number, and acquire an area corresponding to the at least one target feature point number to obtain at least one target area.

Further, the electronic device can acquire a preset vein template corresponding to a preset location, wherein the preset location can be identified by means of image recognition, for example, collect a vein image and input it into a preset neural network model, namely The acquisition part corresponding to the vein image can be obtained. Since the veins of each part of the human body generally have a certain similarity, the corresponding part can be identified through the vein image through the pre-prepared preset neural network model. Of course , the collection site can also be input by the user, the above-mentioned preset neural network model can be defaulted by the system, and then at least one feature point corresponding to the target area is matched with the feature point corresponding to the preset vein template to obtain the target matching value, each Matching between the feature points corresponding to the target area and the feature points corresponding to the preset vein template can obtain a matching value, thus at least one matching value can be obtained, and the target matching value can be understood as the sum of all matching values in at least one matching value mean. When the target matching value is greater than the preset matching threshold, it can be determined that the vein recognition is successful, and then the unlocking operation can be performed, or a preset operation can be performed, and the preset operation can be set by the user, such as: enter the main page or The specified page, the specified page can be set by the user, or the system default, and can also be the startup application, automatic dialing, etc., which is not limited here.

In a possible example, the following steps may also be included:

B1. Determine the approach rate at which the preset location approaches the vein recognition module and the current distance between the preset location and the vein recognition module;

B2. Estimating the vein image acquisition time of the vein recognition module according to the current distance and the approach rate;

B3. Adjusting the acquisition parameters of the target vein image according to the approach speed to obtain the adjusted acquisition parameters of the target vein image;

The above step 103, through the vein recognition module performing vein acquisition according to the target vein image acquisition parameters to obtain the target vein image, can be implemented in the following manner:

When the vein image acquisition time is up, the vein identification module performs vein acquisition according to the adjusted target vein image acquisition parameters to obtain the target vein image.

Among them, the electronic device can determine the approaching speed of the vein recognition module through the ultrasonic sensor. Specifically, it can transmit ultrasonic waves at preset time intervals and receive ultrasonic waves, and use the ultrasonic sensor to detect the approaching distance of the preset position within a unit time and the The current distance between the preset location and the vein recognition module is based on the approach distance to obtain the approach rate. The preset time interval can be set by the user or defaulted by the system. Furthermore, the vein recognition module can be estimated based on the current distance and the approach rate The vein image acquisition time, the vein image acquisition time < the current distance/approach rate, the vein image acquisition time can be any moment between 0 and the current distance/approach rate, for example, the vein image acquisition time can be at the preset position The moment when the distance to the vein recognition module is equal to 1/2 of the current distance. Of course, different approach rates may cause image shaking. Therefore, the target vein image acquisition parameters can be adjusted, and the mapping relationship between the rate and the adjustment coefficient can be stored in the electronic device in advance, and then the approach rate can be determined according to the mapping relationship. The corresponding target adjustment coefficient, the adjustment coefficient is a positive number, in this way, the adjusted target vein image acquisition parameters can be obtained, and when the vein image acquisition time is up, the vein recognition module will perform vein recognition according to the adjusted target vein image acquisition parameters. Acquisition to obtain the target vein image, in this way, a vein image with better image quality can be obtained.

In a possible example, after the above step 103, the following steps may also be included:

C1. Performing image segmentation on the target vein image to obtain a target vein region image;

C2. Analyzing the feature point distribution of the image of the target vein region;

C3. Perform circular image interception on the target vein area image according to M different centers to obtain M circular vein area images, where M is an integer greater than 3;

C4. Select a target circular vein region image from the M circular vein region images, the number of feature points contained in the target circular vein region image is greater than that of the other M circular vein region images Image of circular vein area;

C5. Divide the image of the target circular vein region to obtain N rings, and the ring widths of the N rings are the same;

C6. Starting from the ring with the smallest radius among the N rings, matching the feature points of the N rings with the preset vein template in turn, and accumulating the matching values of the matched rings;

C7. Stop performing feature point matching when the accumulated matching value is greater than the preset matching threshold, and output a prompt message indicating successful vein recognition.

Wherein, the electronic device can perform image segmentation on the target vein image to obtain the target vein region image, the target vein region image can be an image including only vein lines, and then analyze the feature point distribution of the target vein region image, according to M different circle centers Perform circular image interception on the target vein area image to obtain M circular vein area images, M is an integer greater than 3, select the target circular vein area image from the M circular vein area images, and the target circular vein area image The number of feature points contained in the region image is larger than other circular vein region images in the M circular vein region images, and the target circular vein region image is divided into N rings, and the ring widths of the N rings are the same, from Starting from the ring with the smallest radius among the N rings, the N rings are sequentially matched with the feature points of the preset vein template, and the matching values of the matched rings are accumulated. In this way, in the process of vein recognition, different positions can be Or the feature points of different veins are used for matching, and when the accumulated matching value is greater than the preset matching threshold, the feature point matching is stopped immediately,

It can be seen that the vein image acquisition method described in the embodiment of the present application is applied to electronic equipment, and the electronic equipment includes a vein recognition module and an ultrasonic sensor, and the target characteristic parameters of the skin of the preset part of the target object are determined by the ultrasonic sensor, The target vein image acquisition parameters of the vein recognition module are determined according to the target characteristic parameters, and the veins are collected by the vein recognition module according to the target vein image acquisition parameters to obtain the target vein image, which can pre-perceive the skin information through the ultrasonic sensor, and then, according to the skin information By adjusting the vein image acquisition parameters, the efficiency of vein image acquisition can be improved.

Consistent with the above-mentioned embodiment shown in FIG. 1B, please refer to FIG. 2. FIG. 2 is a schematic flow chart of a vein image acquisition method provided in the embodiment of the present application. As shown in the figure, it is applied to the electronic device shown in FIG. 1A equipment, the electronic equipment includes a vein recognition module and an ultrasonic sensor, and the vein image collection method includes:

201. Determine target characteristic parameters of skin of a preset part of a target object by using the ultrasonic sensor.

202. Determine target vein image acquisition parameters of the vein identification module according to the target feature parameters.

203. Use the vein recognition module to collect veins according to the target vein image collection parameters to obtain a target vein image.

204. Perform image segmentation on the target vein image to obtain a target vein region image.

205. Perform feature extraction on the image of the target vein region to obtain a set of target feature points.

206. Divide the image of the target vein region into multiple regions, each of which has the same size.

207. Determine the number of feature points in each of the multiple areas according to the target feature point set to obtain multiple numbers of feature points.

208. Select a number of feature points greater than a preset threshold from the multiple numbers of feature points to obtain at least one target number of feature points, and acquire an area corresponding to the at least one number of target feature points to obtain at least one target area.

209. Acquire a preset vein template corresponding to the preset location.

210. Match the feature points corresponding to the at least one target area with the feature points corresponding to the preset vein template to obtain a target matching value.

211. When the target matching value is greater than a preset matching threshold, confirm that vein recognition is successful.

Wherein, the specific description of the above step 201-step 211 can refer to the corresponding steps of the vein image acquisition method described above in FIG. 1B , which will not be repeated here.

In a possible example, after the above step 212, the following steps may also be included:

D1. Determine the target application corresponding to the preset location according to the mapping relationship between the preset location and the application;

D2. Start the target application.

Among them, the electronic device can pre-store the mapping relationship between preset parts and applications. For example, the veins of each finger can correspond to different applications, and then determine the target application corresponding to the vein collection part according to the mapping relationship, and start the target application. The application, in this way, realizes that different veins of the user can start different applications, which improves the convenience of the user.

It can be seen that the vein image acquisition method described in the embodiment of the present application is applied to electronic equipment, and the electronic equipment includes a vein recognition module and an ultrasonic sensor, and the target characteristic parameters of the skin of the preset part of the target object are determined by the ultrasonic sensor, The target vein image acquisition parameters of the vein recognition module are determined according to the target characteristic parameters, and the veins are collected by the vein recognition module according to the target vein image acquisition parameters to obtain the target vein image, which can pre-perceive the skin information through the ultrasonic sensor, and then, according to the skin information Adjusting the vein image acquisition parameters can not only improve the vein image acquisition efficiency, but also select the template corresponding to the acquisition site during vein recognition, and select the region with many feature points from the vein image for vein recognition, which is helpful Improve the efficiency of vein recognition.

Consistent with the above embodiment shown in FIG. 1B, please refer to FIG. 3. FIG. 3 is a schematic flow diagram of a vein image acquisition method provided in the embodiment of the present application. As shown in the figure, it is applied to the electronic device shown in FIG. 1A. equipment, the electronic equipment includes a vein recognition module and an ultrasonic sensor, and the vein image collection method includes:

301. Determine target characteristic parameters of skin of a preset part of a target object by using the ultrasonic sensor.

302. According to a preset mapping relationship between characteristic parameters and vein image acquisition parameters, determine target vein image acquisition parameters corresponding to the vein identification module corresponding to the target characteristic parameters.

303. Use the vein recognition module to collect veins according to the target vein image collection parameters to obtain a target vein image.

Wherein, for the specific description of the above-mentioned steps 301-303, reference may be made to the corresponding steps of the vein image acquisition method described in FIG. 1B above, which will not be repeated here.

It can be seen that the vein image acquisition method described in the embodiment of the present application is applied to electronic equipment, and the electronic equipment includes a vein recognition module and an ultrasonic sensor, and the target characteristic parameters of the skin of the preset part of the target object are determined by the ultrasonic sensor, The target vein image acquisition parameters of the vein recognition module are determined according to the target characteristic parameters, and the veins are collected by the vein recognition module according to the target vein image acquisition parameters to obtain the target vein image, which can pre-perceive the skin information through the ultrasonic sensor, and then, according to the skin information By adjusting the vein image acquisition parameters, the efficiency of vein image acquisition can be improved.

Consistent with the above embodiment, please refer to FIG. 4, which is a schematic structural diagram of an electronic device provided by an embodiment of the present application. As shown in the figure, the electronic device includes a processor, a memory, a communication interface, and one or more program, the electronic device includes a vein recognition module and an ultrasonic sensor, wherein the one or more programs are stored in the memory and are configured to be executed by the processor. In the embodiment of the present application, the program includes Instructions to perform the following steps:

Determining the target characteristic parameters of the skin of the preset part of the target object through the ultrasonic sensor;

Determine the target vein image acquisition parameters of the vein recognition module according to the target characteristic parameters;

The vein recognition module performs vein collection according to the target vein image collection parameters to obtain the target vein image.

It can be seen that the electronic device described in the embodiment of the present application includes a vein identification module and an ultrasonic sensor, and the target characteristic parameter of the skin of the preset part of the target object is determined by the ultrasonic sensor, and the vein is determined according to the target characteristic parameter. Identify the target vein image acquisition parameters of the module. The vein identification module performs vein acquisition according to the target vein image acquisition parameters to obtain the target vein image. The ultrasonic sensor can pre-perceive the skin information, and then adjust the vein image acquisition parameters according to the skin information. In this way, the vein image collection efficiency can be improved.

In a possible example, in terms of determining the target characteristic parameters of the skin of the preset part of the target object through the ultrasonic sensor, the above program includes instructions for performing the following steps:

Acquiring target physiological characteristic parameters of the target object;

According to the correspondence between the preset physiological characteristic parameters and the working parameters of the ultrasonic sensor, determine the target working parameters corresponding to the target physiological characteristic parameters;

performing image acquisition on a preset part of the target object with the target working parameters by the ultrasonic sensor to obtain a 3D image of the target;

Parameter extraction is performed on the target 3D image to obtain target feature parameters of the skin.

In a possible example, when the target characteristic parameter includes skin thickness, in terms of performing parameter extraction on the target 3D image to obtain the target characteristic parameter of the skin, the above program includes instructions for performing the following steps:

Performing vein recognition on the target 3D image to obtain a target vein area;

selecting a plurality of test points in the target vein area;

determining the shortest distance between the skin surface and each of the plurality of test points according to the 3D image to obtain a plurality of shortest distances;

The average value of the multiple shortest distances is taken as the skin thickness.

In a possible example, in terms of determining the target vein image acquisition parameters of the vein recognition module according to the target characteristic parameters, the above program includes instructions for performing the following steps:

According to the preset mapping relationship between characteristic parameters and vein image acquisition parameters, the target vein image acquisition parameters corresponding to the vein identification module corresponding to the target characteristic parameters are determined.

In one possible example, the above program also includes instructions for:

performing image segmentation on the target vein image to obtain a target vein region image;

performing feature extraction on the image of the target vein region to obtain a set of target feature points;

Dividing the image of the target vein region into multiple regions, each of which has the same area size;

Determining the number of feature points in each of the multiple areas according to the set of target feature points to obtain multiple numbers of feature points;

Selecting a number of feature points greater than a preset threshold from the plurality of feature point numbers to obtain at least one target feature point number, and acquiring an area corresponding to the at least one target feature point number to obtain at least one target area;

Acquiring a preset vein template corresponding to the preset location;

matching the feature points corresponding to the at least one target area with the feature points corresponding to the preset vein template to obtain a target matching value;

When the target matching value is greater than the preset matching threshold, it is confirmed that the vein identification is successful.

The foregoing mainly introduces the solutions of the embodiments of the present application from the perspective of executing the process on the method side. It can be understood that, in order to realize the above functions, the electronic device includes hardware structures and/or software modules corresponding to each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of the examples described in the embodiments provided herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.

The embodiment of the present application may divide the electronic device into functional units according to the above method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units. It should be noted that the division of units in the embodiment of the present application is schematic, and is only a logical function division, and there may be another division manner in actual implementation.

FIG. 5A is a block diagram of functional units of the vein image acquisition device 500 involved in the embodiment of the present application. The vein image acquisition device 500 is applied to electronic equipment, and the electronic equipment includes a vein identification module and an ultrasonic sensor. The device 500 includes: a first determination unit 501, a second determination unit 502, and an acquisition unit 503, wherein,

The first determination unit 501 is configured to determine the target characteristic parameters of the skin of the preset part of the target object through the ultrasonic sensor;

The second determining unit 502 is configured to determine target vein image acquisition parameters of the vein identification module according to the target characteristic parameters;

The acquisition unit 503 is configured to perform vein acquisition by the vein identification module according to the acquisition parameters of the target vein image to obtain a target vein image.

It can be seen that the vein image acquisition device described in the embodiment of the present application is applied to electronic equipment, and the electronic equipment includes a vein recognition module and an ultrasonic sensor, and the target characteristic parameters of the skin of the preset part of the target object are determined by the ultrasonic sensor. The target vein image acquisition parameters of the vein recognition module are determined according to the target characteristic parameters, and the veins are collected by the vein recognition module according to the target vein image acquisition parameters to obtain the target vein image, which can pre-perceive the skin information through the ultrasonic sensor, and then, according to the skin information By adjusting the vein image acquisition parameters, the efficiency of vein image acquisition can be improved.

In a possible example, in terms of determining the target characteristic parameters of the skin of the preset part of the target object through the ultrasonic sensor, the first determining unit 501 is specifically configured to:

Acquiring target physiological characteristic parameters of the target object;

According to the correspondence between the preset physiological characteristic parameters and the working parameters of the ultrasonic sensor, determine the target working parameters corresponding to the target physiological characteristic parameters;

performing image acquisition on a preset part of the target object with the target working parameters by the ultrasonic sensor to obtain a 3D image of the target;

Parameter extraction is performed on the target 3D image to obtain target feature parameters of the skin.

In a possible example, when the target characteristic parameter includes skin thickness, in terms of performing parameter extraction on the target 3D image to obtain the target characteristic parameter of the skin, the first determining unit 501 is specifically configured to:

Performing vein recognition on the target 3D image to obtain a target vein area;

selecting a plurality of test points in the target vein area;

determining the shortest distance between the skin surface and each of the plurality of test points according to the 3D image to obtain a plurality of shortest distances;

The average value of the multiple shortest distances is taken as the skin thickness.

In a possible example, in terms of determining the target vein image acquisition parameters of the vein identification module according to the target characteristic parameters, the second determination unit 502 is specifically configured to:

According to the preset mapping relationship between characteristic parameters and vein image acquisition parameters, the target vein image acquisition parameters corresponding to the vein identification module corresponding to the target characteristic parameters are determined.

In a possible example, as shown in Fig. 5B, Fig. 5B is another modified structure of the vein image acquisition device described in Fig. 5A. Compared with Fig. 5A, it may further include: segmentation unit 504, extraction unit 505, division unit 506, a third determination unit 507, an acquisition unit 508, and a matching unit 509, wherein,

A segmentation unit 504, configured to perform image segmentation on the target vein image to obtain an image of the target vein region;

An extraction unit 505, configured to perform feature extraction on the image of the target vein region to obtain a set of target feature points;

A division unit 506, configured to divide the target vein region image into multiple regions, each region having the same area size;

The third determining unit 507 is configured to determine the number of feature points in each of the multiple areas according to the target feature point set, and obtain multiple numbers of feature points;

The obtaining unit 508 is configured to select a number of feature points greater than a preset threshold from the plurality of feature point numbers to obtain at least one target feature point number, and obtain an area corresponding to the at least one target feature point number to obtain at least one a target area; and acquiring a preset vein template corresponding to the preset location;

A matching unit 509, configured to match the feature points corresponding to the at least one target area with the feature points corresponding to the preset vein template to obtain a target matching value;

The third determining unit 507 is further configured to confirm that the vein recognition is successful when the target matching value is greater than a preset matching threshold.

An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables the computer to execute some or all of the steps of any method described in the above method embodiments , the above-mentioned computer includes electronic equipment.

An embodiment of the present application also provides a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable the computer to execute any one of the methods described in the above method embodiments. Some or all steps of the method. The computer program product may be a software installation package, and the computer includes electronic equipment.

It should be noted that for the foregoing method embodiments, for the sake of simple description, they are expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited by the described action sequence. Depending on the application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions and modules involved are not necessarily required by this application.

In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the above units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components can be combined or integrated. to another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical or other forms.

The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the above-mentioned integrated units are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application is essentially or part of the contribution to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory. Several instructions are included to make a computer device (which may be a personal computer, server or network device, etc.) execute all or part of the steps of the above-mentioned methods in various embodiments of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable memory, and the memory can include: a flash disk , Read-only memory (English: Read-Only Memory, abbreviated: ROM), random access device (English: Random Access Memory, abbreviated: RAM), magnetic disk or optical disk, etc.

The embodiments of the present application have been introduced in detail above, and specific examples have been used in this paper to illustrate the principles and implementation methods of the present application. The descriptions of the above embodiments are only used to help understand the methods and core ideas of the present application; meanwhile, for Those skilled in the art will have changes in specific implementation methods and application scopes based on the ideas of the present application. In summary, the contents of this specification should not be construed as limiting the present application.

Claims (11)

1. An electronic device, characterized in that the electronic device includes a vein recognition module, an ultrasonic sensor and a processing circuit, wherein, The ultrasonic sensor is used to determine the target characteristic parameters of the skin of the preset part of the target object; The processing circuit is used to determine the target vein image acquisition parameters of the vein identification module according to the target characteristic parameters; The vein recognition module is used to collect veins according to the target vein image collection parameters to obtain target vein images; Wherein, in terms of determining the target characteristic parameters of the skin of the preset part of the target object, the ultrasonic sensor is specifically used for: Acquiring target physiological characteristic parameters of the target object; According to the correspondence between the preset physiological characteristic parameters and the working parameters of the ultrasonic sensor, determine the target working parameters corresponding to the target physiological characteristic parameters; performing image acquisition on a preset part of the target object with the target working parameters by the ultrasonic sensor to obtain a 3D image of the target; Parameter extraction is performed on the target 3D image to obtain target feature parameters of the skin. 2. The electronic device according to claim 1, wherein, when the target characteristic parameters include skin thickness, in the parameter extraction of the target 3D image to obtain the target characteristic parameters of the skin, the Ultrasonic sensors are used in particular for: Performing vein recognition on the target 3D image to obtain a target vein area; selecting a plurality of test points in the target vein area; determining the shortest distance between the skin surface and each of the plurality of test points according to the 3D image to obtain a plurality of shortest distances; The average value of the multiple shortest distances is taken as the skin thickness. 3. The electronic device according to claim 1 or 2, wherein, in terms of determining the target vein image acquisition parameters of the vein identification module according to the target characteristic parameters, the processing circuit is specifically used for: According to the preset mapping relationship between characteristic parameters and vein image acquisition parameters, the target vein image acquisition parameters corresponding to the vein identification module corresponding to the target characteristic parameters are determined. 4. The electronic device according to claim 1 or 2, wherein the processing circuit is further specifically used for: performing image segmentation on the target vein image to obtain a target vein region image; performing feature extraction on the image of the target vein region to obtain a set of target feature points; Dividing the image of the target vein region into multiple regions, each of which has the same area size; Determining the number of feature points in each of the multiple areas according to the set of target feature points to obtain multiple numbers of feature points; Selecting a number of feature points greater than a preset threshold from the plurality of feature point numbers to obtain at least one target feature point number, and acquiring an area corresponding to the at least one target feature point number to obtain at least one target area; Acquiring a preset vein template corresponding to the preset location; matching the feature points corresponding to the at least one target area with the feature points corresponding to the preset vein template to obtain a target matching value; When the target matching value is greater than the preset matching threshold, it is confirmed that the vein identification is successful. 5. A vein image acquisition method, characterized in that it is applied to electronic equipment, and the electronic equipment includes a vein identification module and an ultrasonic sensor, and the method comprises: Determining the target characteristic parameters of the skin of the preset part of the target object through the ultrasonic sensor; Determine the target vein image acquisition parameters of the vein recognition module according to the target characteristic parameters; Using the vein recognition module to collect veins according to the target vein image collection parameters to obtain target vein images; Wherein, the determination of the target characteristic parameters of the skin of the preset part of the target object through the ultrasonic sensor includes: Acquiring target physiological characteristic parameters of the target object; According to the correspondence between the preset physiological characteristic parameters and the working parameters of the ultrasonic sensor, determine the target working parameters corresponding to the target physiological characteristic parameters; performing image acquisition on a preset part of the target object with the target working parameters by the ultrasonic sensor to obtain a 3D image of the target; Parameter extraction is performed on the target 3D image to obtain target feature parameters of the skin. 6. The method according to claim 5, wherein, when the target characteristic parameters include skin thickness, the parameter extraction is performed on the target 3D image to obtain the target characteristic parameters of the skin, including: Performing vein recognition on the target 3D image to obtain a target vein area; selecting a plurality of test points in the target vein area; determining the shortest distance between the skin surface and each of the plurality of test points according to the 3D image to obtain a plurality of shortest distances; The average value of the multiple shortest distances is taken as the skin thickness. 7. The method according to claim 5 or 6, wherein the determining the target vein image acquisition parameters of the vein identification module according to the target characteristic parameters comprises: According to the preset mapping relationship between the characteristic parameter and the vein image acquisition parameter, the target vein image acquisition parameter corresponding to the vein identification module corresponding to the target characteristic parameter is determined. 8. The method according to claim 5 or 6, wherein the method further comprises: performing image segmentation on the target vein image to obtain a target vein region image; performing feature extraction on the image of the target vein region to obtain a set of target feature points; Dividing the image of the target vein region into multiple regions, each of which has the same area size; Determining the number of feature points in each of the multiple areas according to the set of target feature points to obtain multiple numbers of feature points; Selecting a number of feature points greater than a preset threshold from the plurality of feature point numbers to obtain at least one target feature point number, and acquiring an area corresponding to the at least one target feature point number to obtain at least one target area; Acquiring a preset vein template corresponding to the preset location; matching the feature points corresponding to the at least one target area with the feature points corresponding to the preset vein template to obtain a target matching value; When the target matching value is greater than the preset matching threshold, it is confirmed that the vein identification is successful. 9. A vein image acquisition device, characterized in that it is applied to electronic equipment, and the electronic equipment includes a vein identification module and an ultrasonic sensor, and the device includes: A first determining unit, configured to determine target characteristic parameters of the skin of a preset part of the target object through the ultrasonic sensor; A second determining unit, configured to determine target vein image acquisition parameters of the vein identification module according to the target characteristic parameters; An acquisition unit, configured to acquire a target vein image through the vein recognition module according to the target vein image acquisition parameters; Wherein, the determination of the target characteristic parameters of the skin of the preset part of the target object through the ultrasonic sensor includes: Acquiring target physiological characteristic parameters of the target object; According to the correspondence between the preset physiological characteristic parameters and the working parameters of the ultrasonic sensor, determine the target working parameters corresponding to the target physiological characteristic parameters; performing image acquisition on a preset part of the target object with the target working parameters by the ultrasonic sensor to obtain a 3D image of the target; Parameter extraction is performed on the target 3D image to obtain target feature parameters of the skin. 10. An electronic device, characterized in that it includes a processor and a memory, the memory is used to store one or more programs, and is configured to be executed by the processor, the program includes a program for executing the program according to claim 5 - Instructions for steps in any of the methods described in any one of 8. 11. A computer-readable storage medium, characterized by storing a computer program for electronic data exchange, wherein the computer program causes a computer to execute the method according to any one of claims 5-8.

Images