KR20210098509A - information processing - Google Patents

Abstract

The present invention relates to an information processing method, a pack delivery method, an apparatus, an electronic device and a recording medium, and the method can be applied to a pack delivery terminal, wherein the method collects a first pack image corresponding to a first pack delivery package to do; acquiring pack-fold document information of the first pack-packed parcel included in the first pack-fold image; collecting a first facial image of the recipient of the first packaged parcel; and executing a pack delivery operation of the first packed parcel based on the pack delivery document information of the first packed parcel and the first face image, wherein the pack delivery document information includes recipient information and the pack delivery of the first packed parcel and at least one of identification information.

Description

information processing

The present invention relates to the field of computer technology, and more particularly, to an information processing method, a method for releasing a package, an apparatus, an electronic device, and a recording medium.

Today, the pack-bae industry is developing rapidly, and the number of pack-bae products per day is very large. Pack pack hours are daytime working hours, and since many residents are working at this time, it is inconvenient to receive pack ships, and a collection point for pack ships has been created. The packers put the packs into the packs collection point, and the residents receive the packs at the pack packs collection point.

Embodiments of the present invention provide an information processing method, a pack delivery method, an apparatus, an electronic device, and a recording medium.

According to a first aspect of an embodiment of the present invention, there is provided an information processing method applied to a pack delivery terminal, the method comprising: collecting a first pack image corresponding to a first pack pack; acquiring pack-fold document information of the first pack-packed parcel included in the first pack-fold image; collecting a first facial image of the recipient of the first packaged parcel; and executing a pack-shipping operation of a first pack-shipped parcel based on the pack-ship document information of the first pack-packed parcel and the first face image, wherein the pack-ship document information includes recipient information and pack-fold identification of the first pack-packed parcel at least one of the information.

According to a second aspect of an embodiment of the present invention, there is provided a method for shipping a pack, wherein the method includes acquiring a pack image of a packed parcel collected by using at least one camera of a terminal device, wherein the pack image is the pack pack Used to obtain information about the packing of the parcel -; acquiring a first face image collected using the at least one camera; and executing a shipment operation of the pack-packed parcel based on the pack-packed image and the first face image.

According to a third aspect of an embodiment of the present invention, there is provided a pack times delivery method, wherein the method includes receiving a pack delivery request message sent by a terminal device, wherein the pack delivery request message includes first face data and pack times data wherein the first face data includes a first face image of the recipient collected by the terminal device and/or characteristic information of the first face image, and at least a part of the packed image of the packed data pack and/or the package. including pack-fold document information acquired in the pack-fold image; executing shipment verification of the pack-packed parcel based on the first face data and the pack-fold data; and transmitting, to the terminal device, a pack delivery response for indicating whether the release verification has been passed.

According to a fourth aspect of an embodiment of the present invention, there is provided an electronic device, wherein the electronic device includes a processor and a memory, wherein the memory stores one or a plurality of programs, wherein the one or more programs are configured by the processor and the program executes some or all of the steps described in any method of the first aspect, the second aspect, or the third aspect of the embodiments of the present invention.

According to a fifth aspect of the embodiment of the present invention, there is provided an information processing device, wherein the device is applied to a pack-ship terminal, the device collects a first pack image corresponding to the first pack-packed parcel, and the first pack-packed parcel an image collection module for collecting a first facial image of the recipient of an information acquisition module for acquiring pack-fold document information of the first pack-packed parcel included in the first pack-fold image; and an operation execution module for executing a pack delivery operation of the first pack delivery parcel based on the pack delivery document information of the first pack delivery parcel and the first face image, wherein the pack delivery document information includes recipient information and the first It includes at least one of pack pack identification information of the pack pack package.

According to a sixth aspect of the embodiment of the present invention, there is provided an apparatus for packing and discharging, wherein the apparatus acquires an image of a packed package collected by using at least one camera of a terminal device, and using the at least one camera an image acquisition module for acquiring the collected first face image; and a shipping processing module for executing a shipping operation of the packed parcel based on the pack image and the first face image, wherein the pack shipping image is used to obtain pack shipping document information of the pack delivery package.

According to a seventh aspect of an embodiment of the present invention, there is provided an apparatus for sending out a pack, the apparatus comprising: a message receiving module for receiving a request message for sending a pack sent by a terminal device; a verification processing module for executing shipment verification of the packed parcel based on the first face data and the pack-fold data; and a response sending module configured to transmit, to the terminal device, a pack times delivery response for indicating whether the delivery verification has been passed, wherein the pack times delivery request message includes first face data and pack times data, and the first The face data includes a first face image of the recipient collected by the terminal device and/or characteristic information of the first face image, and at least a part of the packed image of the pack-fold data and/or the pack-fold image acquired within the pack-fold image. Contains document information.

According to an eighth aspect of an embodiment of the present invention, there is provided a computer-readable recording medium, wherein the computer-readable recording medium stores a computer program, wherein the computer program is configured to cause a computer to: Any or all of the steps described in any method of the second aspect or the third aspect are carried out.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of the present invention or a technical solution of the prior art will be more clearly described, and drawings necessary for use in the description of the embodiment or the prior art will be briefly introduced.
1 is a schematic diagram showing a flow of an information processing method according to an embodiment of the present invention.
Fig. 2 is a schematic diagram showing a flow of an information processing method according to an embodiment of the present invention.
Fig. 3 is a schematic diagram showing a flow of another information processing method according to the embodiment of the present invention.
4 is a schematic diagram showing a flow of an information processing method according to an embodiment of the present invention.
Fig. 5 is a schematic diagram showing a flow of an information processing method according to an embodiment of the present invention.
6 is a schematic diagram showing a flow of an information processing method according to an embodiment of the present invention.
Fig. 7 is a schematic diagram showing a flow of a method for inquiring a pack delivery according to an embodiment of the present invention.
Fig. 8 is a schematic diagram showing a flow of a method for binding a face and a mobile phone number according to an embodiment of the present invention.
Fig. 9 is a schematic diagram showing the flow of a method for warehousing a pack according to an embodiment of the present invention.
Fig. 10 is a schematic diagram showing a flow of an information processing method according to an embodiment of the present invention.
11 is a schematic diagram showing a flow of a method for releasing a pack according to an embodiment of the present invention.
12 is a schematic diagram showing the flow of a method for releasing a pack according to an embodiment of the present invention.
13 is a schematic diagram showing the configuration of an electronic device according to an embodiment of the present invention.
14 is a schematic diagram showing the configuration of a terminal device provided by an embodiment of the present invention.
15 is a schematic diagram showing the configuration of an information processing apparatus provided by an embodiment of the present invention.
16 is a schematic diagram showing the configuration of an information processing apparatus provided by an embodiment of the present invention.
17 is a schematic diagram showing the configuration of a package delivery device provided by an embodiment of the present invention.
18 is a schematic diagram showing the configuration of a package delivery device provided by an embodiment of the present invention.
19 is a schematic diagram showing the configuration of a package delivery device provided by an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, in order to enable those skilled in the art to better understand the technical solutions of the present invention, the technical solutions of the embodiments of the present invention will be clearly and completely described with reference to the drawings of the embodiments of the present invention. Of course, the described embodiments are only some and not all of the embodiments of the present invention. All other embodiments that can be obtained by those skilled in the art based on the embodiments of the present invention without creative labor are included in the protection scope of the present invention.

In the specification, claims, and drawings of the present invention, terms such as “first” and “second” do not describe a specific order, but are used to distinguish different objects. On the other hand, the terms “including” and “including” and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device comprising a series of steps or units is not limited to the steps or units listed, but optionally includes steps or units not listed, or optionally this It further includes other steps or units specific to the process, method, product, or device.

Reference in this specification to “an embodiment” means that a particular feature, configuration, or characteristic described in conjunction with the embodiment may be included in at least one embodiment of the present invention. The appearance of the phrase in each position in the specification is not necessarily referring to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive from other embodiments. Those skilled in the art can clearly and implicitly understand that the embodiments described herein may be combined with other embodiments.

Usually, for packaged goods placed in a package collection place, an employee first inputs package information such as a number and a user's mobile phone number into the system, and then sends an SMS to the user to notify the user of the receipt code. The user receives the product using the redemption code. After the user arrives at the package collection point, the user informs the employee of the receipt code, and the employee goes to the warehouse to find the package and delivers the package to the user.

In view of this, an embodiment of the present invention provides an information processing method. Hereinafter, embodiments of the present invention will be described in detail.

Embodiments of the present invention may be implemented by a terminal device, wherein the terminal device is an information processing apparatus (package terminal) applied to package management, a portable device having a touch-sensitive surface (eg, a touch screen display and/or a touch pad) other portable devices such as, but not limited to, phones, laptop computers or tablet computers. It should be further understood that in some embodiments, the terminal device may not be a portable communication device, but may be a desktop computer with a touch sensitive surface (eg, a touchscreen display and/or a touch pad).

1 is a schematic diagram showing a flow of an information processing method according to an embodiment of the present invention, and the method may be applied to a pack-ship terminal. As shown in FIG. 1 , the method may include the following steps.

In step 101, a first packed image corresponding to the first packed vesicle is collected.

Here, the first packaged image can be understood as an image including the first packaged parcel, for example, it may be an image collected when the first packaged parcel is within the camera range, specifically, the packaged parcel It may be an image collected at the time of shipment/warehousing, or an image collected when a user receives a packed parcel. A packed parcel waiting to be shipped may be referred to as a first packed parcel. When the user stands in the pack-packed terminal image collection area holding the first pack-packed parcel, the pack-packed terminal may collect the pack-fold image for the first pack-packed parcel, and the collected image may be referred to as a first pack-fold image.

In step 102, pack-fold document information of the first packaged parcel included in the first packaged image is acquired, wherein the pack-fold document information includes at least one of recipient information and pack-fold identification information of the first packaged parcel.

Usually, a pack document is attached to the first pack package, and the pack document information on the first pack package can be recognized by processing the first pack image. For example, the package delivery document information includes information on the recipient of the first packaged parcel (eg, name of the recipient, mobile phone number, etc.) number) and the like. At least one of recipient information and packer identification information may be acquired. On the other hand, the packet-folded document information recognition may be executed by the pack-fold terminal, and by transmitting the first pack-fold image collected by the pack-fold terminal to the server, the server can receive the pack-fold document information obtained by recognizing it, an embodiment of the present invention is not limited to these.

In step 103, a first face image of the recipient of the first packaged parcel is collected.

The recipient is a user who receives the first pack delivery parcel, and collects the recipient's face image using the pack delivery terminal, and the face image may be referred to as a first face image.

The packbae terminal of the embodiment of the present invention periodically collects images, and optionally includes a face recognition function, and detects whether a face is included in the first face image collected by using a face recognition technology, or includes A face can be recognized, or a face in a scene can be tracked using a camera installed in a facsimile terminal.

Face recognition according to an embodiment of the present invention analyzes a still image or a video sequence using image processing technology, finds a face among them, and outputs one or a plurality of valid information among the number, location and size of the face, identity, etc. do. In addition, in some embodiments, it is possible to track a face, that is, on the assumption that a face is detected in the previous image frame, information such as the position and size of the face in subsequent frames is continuously captured can do. Illustratively, the collection of images may be performed on a periodic basis, for example, the packer terminal camera may acquire an image every 2 seconds, execute a process of determining whether a face is included or not, and acquire a face image. If a face is not included in the acquired image, the memory space can be saved by deleting the acquired image or deleting it after saving it for a certain period of time.

In an exemplary embodiment, the packer terminal may include, but is not limited to, a first camera, a second camera, a transceiver, and a display screen. Here, the first face image may be collected using the first camera of the pack-bae terminal, and the first face image may be collected using the second camera of the pack-bae terminal. In an embodiment of the present invention, the first camera for collecting face images and the second camera for collecting face images may be the same or different cameras. Illustratively, the second camera for collecting the first packed image may be an industrial camera, and by collecting black and white or color images using the industrial camera, subsequent pack-fold document information (eg, one of pack-fold barcodes, pack-fold text, etc.) or a plurality of pieces of information) are recognized and acquired. Also, the collection order of the first pack image and the first face image is not limited. For example, after the user sends a pack delivery instruction, the first pack image and the first face image may be collected, wherein the first pack image and the first face image are separately collected, or The pack image and the first face image may be included in one image. For example, when a user holds a packaged parcel in front of him and takes an image, or when a person's approach is detected, the first camera is activated to collect a first face image, or when it is detected that a product is placed in the parcel detection area, a second Since the first pack image may be collected by activating the camera, the embodiment of the present invention is not limited thereto.

In step 104, a pack delivery operation of the first packed parcel is executed based on the pack delivery document information of the first packed parcel and the first face image.

Before releasing the first packaged parcel, the above-described document information and the first face image are used to verify the identity of the recipient, i.e., the shipment verification is executed. For example, if the first identification information matched with the first face image is determined, and the first identification information and the recipient information of the first packaged parcel are identical, it is possible to confirm the passing verification pass of the first packaged parcel delivery . Further, for example, if the first account information corresponding to the recipient information of the first pack delivery parcel is determined, and the first biological characteristic information corresponding to the first face image and the first account information have a bind relationship, the first pack delivery time You can confirm that the parcel has passed the delivery verification. Also, for example, determining the first account information matched with the first face image, inquiring the package information on the waiting list corresponding to the first account information, the package information on the waiting list and the identification information on the first package parcel If they match, it is possible to confirm the delivery verification pass for the first packaged parcel. Embodiments of the present invention do not limit the specific realization of identity verification.

Illustratively, after obtaining the pack-fold document information included in the first pack-fold image and the first face image, the pack-ship shipment operation can be immediately executed, and record this information to determine whether there is an abnormality in the shipment of the first pack-fold parcel can check whether Here, in some embodiments, when the first face image and the pack document information match, it can be determined that the shipment of the first pack package is normal, and when the first face image and the pack document information do not match, It is determined that there is an abnormality in the shipment of the first pack-shipped parcel, and as an option, an alarm is sounded when an abnormality is found.

The information processing method of the embodiment of the present invention collects the first face image corresponding to the recipient of the packed parcel and the first packed image of the packed parcel, and based on the packaged document information and the first face image obtained from the first packaged image, Determining whether or not to ship the packaged parcel, and executing verification between the recipient and the parcel information when the parcel is released .

2 is a schematic diagram showing a flow of an information processing method according to an embodiment of the present invention, wherein the flow of receiving a pack-shipped parcel using a pack-ship terminal is described. In addition, in the embodiment of the present invention, by comparing whether the identity information matched with the first face image of the recipient and the recipient information of the packed parcel match, the parcel delivery verification is executed. As shown in FIG. 2 , the method may include the following steps.

In step 201, a first packaged image corresponding to the first packaged parcel is collected, and packaged document information of the first packaged parcel included in the first packaged image is acquired.

In step 202, a first facial image of the recipient of the first packaged parcel is collected.

In step 203, first identification information matching the first face image is acquired.

A plurality of face templates and a face database including identification information corresponding to the face templates are stored in the pack-bae terminal or server, wherein the face templates may include a face image and/or feature information of the face image, , the identification information may include one or a plurality of the user's name, contact number, address, and the like. That is, the user may bind his/her face and identity information using a mobile phone application or the like. In some embodiments, the face database is stored in the pack-bae terminal, the pack-bae terminal determines the user identity through face recognition processing for the first face image, and returns the first identity information matching the first face image. can be obtained In some embodiments, when a face database is stored in the server, the packbae terminal transmits the first face image and/or feature information of the first face image to the server, and based on the face database stored by the server 1 The first identification information matching the face image may be determined and returned to the packbae terminal.

In one embodiment, the packer terminal sends a first face image to the server, the server recognizes the first face image, and determines a face template matching the first face image from among face template sets, and further, The first identification information corresponding to the face template matching the first face image may be inquired.

Here, the server in the embodiment of the present invention is also called a servo unit, is a computing service device, and allows access to a plurality of terminals. The packbae terminal can communicate with the server through a transceiver, for example, by transmitting the first face image and/or feature information of the first face image to the server through the transceiver, the server causes the first face image and search for the first identification information that matches the

Hereinafter, an example in which the server searches for the first identification information matching the first face image will be described, but those skilled in the art can understand that the description may also be applied to a pack-bae terminal.

Specifically, the server may determine whether a face template matching the face template set exists by comparing the first face image or feature information of the first face image with the face template one by one. In some embodiments, the face template includes a face image, so that the server determines a degree of similarity between the first face image and each face image in the set of face templates, respectively, and based on the degree of similarity, the server selects the first face image in the set of face templates. 1 It is possible to determine a face template that matches the face image. In some embodiments, the face template includes facial feature information, so that the server acquires the feature information of the first face image sent by the pack-time terminal, or features for the first face image sent by the pack-time terminal By performing extraction to obtain feature information of the first face image, and comparing the feature information of the first face image with the facial feature information included in each face template, it is possible to determine a face template that matches the first face image However, embodiments of the present invention are not limited thereto.

Meanwhile, in another embodiment, the acquisition of the first identity information matching the first face image may be performed based on other information that can uniquely identify the user identity other than the feature, for example, based on the iris feature. can be run by Illustratively, the server obtains the iris characteristics of the recipient of the packaged parcel based on the first face image, compares it with the template in the iris characteristic library to obtain a matched person, and also obtains identification information such as a mobile phone number corresponding to the person. After obtaining, it is possible to compare the mobile phone number with the mobile phone number in the package delivery document information of the packaged parcel to determine whether or not the recipient is the actual recipient.

In some embodiments, it is determined whether the similarity between the first face image or feature information of the first face image and the face template is greater than a predetermined threshold, and a face template greater than the predetermined threshold is selected as the first face image. It can be confirmed with a face template that matches with . In some selectable embodiments, the server stores the predetermined threshold, for example 95% or 90%, but embodiments of the present invention are not limited thereto.

In some embodiments, if a face template matching the first face image is detected in the face database, step 204 may be executed. If a face template matching the first face image is not detected in the face database, verification failure may be confirmed, or the user may be prompted to enter account information.

In step 204, it is determined whether or not the first identification information and the recipient information of the first packaged parcel match.

After obtaining the recipient information and the first identification information of the first packed parcel, the pack shipping terminal may compare the first identification information with the recipient information to determine whether the two are identical. Specifically, a plurality of arbitrary pieces of information such as a user name or account name, a contact number, and an address may be compared respectively. Here, in some embodiments, a relatively strict verification may be performed. Accordingly, if one piece of information does not match, it may be determined as a user identity verification failure, and if the comparison of a plurality of pieces of information all match, , it is possible to confirm the success of user identity verification. Or a relatively loose comparison can be performed, for example, only one piece of information can be compared, for example, one of a name, an account name, or a contact number is compared, and if the information matches, the user You can confirm the success of the identity verification. In addition, for example, when a plurality of pieces of information are compared, and if one piece of information is identical, the user identity verification success can be confirmed, but the embodiment of the present invention is not limited thereto.

If the determination result is consistent, the execution of step 205 is continued; otherwise, the execution of step 206 is continued.

In step 205, if the first identification information and the recipient information of the first packaged parcel match, confirming that the first packaged parcel has passed the packaging verification pass, and/or storage corresponding to the first packaged parcel Update the status to the delivered status.

In this step, when the first identification information and the recipient information of the first packaged parcel match, it may be confirmed that the first packaged parcel has passed the shipment verification, and in this case, the recipient may receive the packaged parcel. In addition, the storage state corresponding to the pack identification information of the first packed parcel may be updated to the released state.

In an embodiment, when the first identification information and the recipient information match, pack delivery information including the first pack delivery document information and the first face image of the first pack delivery package is generated, and the pack delivery management system is provided with the pack delivery information. By sending the shipment information, it is possible to indicate the receipt details of the recorded parcel. Here, in some embodiments, the pack-ship shipment information may further include related information such as shipment (reception) time, but the present disclosure is not limited thereto.

The pack delivery terminal according to the embodiment of the present invention may communicate with the pack delivery management system through the business interface service. In the case of a delivery or receipt scene, the pack delivery management can be updated by transmitting and registering the pack delivery information to the pack delivery management system and recording the delivery or receipt of the pack delivery. In some embodiments, the pack management system may be a third-party inventory management system, but embodiments of the present invention are not limited thereto.

In step 206, if the first identification information and the recipient information of the first packed parcel do not match, warning information is output, or the packaged parcel is put into the pack and locked device, or the user is prompted to enter verification information.

If the first identification information and the recipient information of the first parcel delivery do not match, the verification fails, it means that the user who fell after receiving the parcel is not the actual recipient of the parcel delivery, and the warning information may be output. The warning information may include voice information, for example, "recipient does not match, please check!" or a predetermined voice prompt may be generated. Exemplarily, a plurality of warning methods such as a method of displaying text information on a display interface may be further included, but the present disclosure is not limited thereto.

In addition to the output of the above warning information, in another embodiment, the pack delivery terminal may put the first pack delivery parcel into the pack delivery lock device. For example, the pack and unload device may be a storage space communicating with a pack and unload terminal bearing platform (used for placing a pack and parcel). When there is an abnormality in the identity comparison, the pack delivery terminal automatically turns on the storage space, controls the pack parcel on the bearing platform to automatically enter the storage space, and does not permit the recipient to receive the packaged parcel, By protecting your package, you can avoid receiving fraudulent items. In another embodiment, when an error occurs in the identity comparison, the packer terminal may prompt the recipient to input user verification information, for example, when the user enters other identification information such as a mobile phone number or ID number. You may be prompted for input. In actual implementation, when an abnormality occurs in the identity comparison, other processing methods may be employed, and the present embodiment is not limited thereto.

In an embodiment of the present invention, the pack delivery terminal may determine whether the first identification information corresponding to the recipient and the recipient information of the first packed parcel match, and executes the delivery verification of the packed parcel. In some other possible embodiments, the pack-fold terminal sends both the collected first pack-fold image and the first face image to the server side, the server recognizes the pack-fold document information based on the first pack-fold image, and the pack-fold document information After verifying whether the first face image and the first face image match, the verification result may be returned to the packbae terminal. Or in some other possible embodiments, the pack times terminal sends one of the first pack images and the first face images to the server, and the server acquires image information, for example, pack times in the first pack images. Document information is recognized or corresponding person identification information is obtained based on the first face image, and the recognized information is returned to the pack-time terminal so that the pack-time terminal can continuously perform verification and comparison. Or in some other possible embodiments, the pack-time terminal sends both images, such as the first pack-fold image and the first face image, to the server, so that the server acquires the corresponding identity information or pack-fold document information based on the image. After that, the acquired information is returned to the pack-time terminal, and the pack-time terminal can perform information comparison and verification. No further embodiments are enumerated. Those skilled in the art can understand that the server and the pack delivery terminal can cooperate to carry out the process of verifying the delivery of the packed parcel, and the server and the pack delivery terminal can cooperate with each other to perform other processing of the verification flow, respectively, according to a plurality of embodiments. .

The information processing method of the embodiment of the present invention compares the identity information corresponding to the face image of the recipient with the recipient information of the packed parcel, and only when both match, confirms the delivery verification pass of the packed parcel, thereby securing the shipment of the packaged parcel Strengthen control, and package parcels can avoid fraudulent receipt.

3 is a schematic diagram showing a flow of another information processing method according to an embodiment of the present invention, wherein the flow of receiving a pack-shipped parcel using another pack-shipment terminal is described. In addition, in the embodiment of the present invention, by comparing whether or not the biological features corresponding to the first face image of the recipient and the first account information included in the recipient information of the packaged parcel have a bind relationship, the shipment verification of the packaged parcel is executed. do. As shown in FIG. 3 , the method may include the following steps.

In step 301, a first face image corresponding to the recipient of the first packaged parcel is collected.

In step 302, it is determined whether a bind relationship between the first biological feature corresponding to the first face image and the first account information is established. The first biological characteristic may be obtained by performing facial recognition on a first facial image, and the first biological characteristic may include a characteristic that can uniquely recognize a user, such as a facial characteristic and/or an iris characteristic. .

In some embodiments, after collecting the first biological characteristic, based on the collected document image on the packed package, detection and recognition may be automatically performed on the packed document image to obtain packaged document information. The package document information may include first account information. In this way, the bind relationship between the first biological feature and the first account information can be confirmed without a special operation by the user.

In some embodiments, the first account information includes at least one of a mobile communication identification, an instant communication identification, and an identity identification. Here, the mobile communication identification includes, but is not limited to, a mobile phone number. The instant communication identification may include accounts of various instant communication applications, for example, WeChat ID, Weibo ID, Fetion ID, and the like. The identification includes, but is not limited to, an identification number and a passport number on an identification card.

In some embodiments, the first account information corresponding to the package document information may be obtained by inquiring the account database based on the package document information of the pack package, for example, the first account information may include an identification number, Including, but not limited to, WeChat ID. Also, the corresponding face registration data may be inquired based on the first account information. The face registration data may be a relation between the user's first account information and the face registration data established in advance, and the face registration data may be, for example, a face registration image and/or facial features. After that, it is compared whether the first face image of the recipient of the packed parcel and the above face registration data match, and if there is a match, it can be confirmed that the recipient is the actual recipient of the packed parcel, and confirm the delivery verification pass of the packaged parcel can

In another embodiment, based on the first biological characteristic corresponding to the first face image, the account information corresponding to the biological characteristic may be inquired, and the user may check the relation between the user's account information and the biological characteristic. You can register in advance. After the account information is obtained, the package information on the waiting list corresponding to the account information is obtained, and it is judged whether there is a package that can be received at present in the package information on the waiting list. That is, it is determined whether or not the pack times information in the waiting list matches the pack times document information of the first pack times image. For example, it may be determined whether or not the pack times number of at least one package waiting to be received included in the pack pack information of the pack pack waiting to be received matches the pack pack identifier included in the pack pack document information, the embodiment of the present invention is limited thereto I never do that.

In step 303, when the first biological characteristic and the first account information have a bind relationship, it is determined that the execution of a predetermined operation for the collection or warehousing operation has passed the verification. For example, if a bind relationship exists, it is possible to consider that the current recipient's identity characteristic is verification pass, confirm the release verification pass for the first packed parcel, and execute a predetermined operation. The predetermined operation may include releasing a document or releasing a package in which the document is located. For example, the document may be a pack document, and the pack document is usually attached to a pack package. If the first biological characteristic and the first account information have a bind relationship, it means that the current recipient of the pack ship has come to receive the pack ship, and since the recipient has passed the identification verification and is the actual recipient, the delivery operation of the pack package cannot be executed. there is. Executing the discharging operation of the packed parcel includes opening a counter of a storage cabinet in which the packed parcel is placed. In another embodiment, in case of verification pass, the pack delivery terminal may generate a prompt sound such as "verification pass", and then the recipient can receive the pack delivery parcel.

In an exemplary embodiment, the method further includes outputting a verification prompt for inputting verification information when the bind relationship is not established between the first biological characteristic and the first account information. Based on the input verification information, the verification pass for executing the warehousing or shipment operation for the collection target is confirmed, for example, the packaging shipment operation for the first parcel shipment is executed based on the verification information.

In an embodiment of the present invention, execution verification of a predetermined operation is executed based on the collected first image information of the recipient and also based on a previously established bind relationship. By doing so, there is no need to input a document number, receipt number, or own account information by the user, and user operation is simplified.

As shown in Fig. 4, the embodiment of the present invention provides an information processing method, wherein the method describes the flow of the binding relationship between the biological features of a face image and account information. The method may include the following steps.

In step 401, face images are collected. In an embodiment of the present invention, the collection of the face image may be realized in the process of warehousing and/or releasing a document or package, or may be executed in the face registration process. For example, the user may use the operation interface of the display screen of the packer terminal or his/her mobile phone APP to execute face registration, and bind the biological characteristics of the face image and account information in the registration process.

In step 402, account information of the pack-fold document is acquired.

In step 403, based on the biological feature corresponding to the face image and the account information, the biological feature is associated with the account information to obtain a relation.

The biological feature may be a biological feature extracted from a face image, for example, a feature of the user's face and/or a feature of the user's iris. In other words, the biological characteristic may uniquely identify the biological characteristic information of the user. In an embodiment of the present invention, in the process of issuing and/or warehousing a document or pack, the camera may be activated during the writing process or registration process of the document thereon to execute collection of the face image. By acquiring biological characteristics from the collected face images and correlating them with account information on documents to be received or shipped, a related relationship can be established. In some embodiments, the account information includes at least one of a mobile communication identification, an instant communication identification, and an identity identification.

In some embodiments, during the registration process, the user may establish a relation between his or her account information and facial registration data, wherein the facial registration data includes, but is not limited to, facial features and/or iris features and the like. doesn't happen Subsequently, corresponding face registration data may be obtained based on the account information and the relevant relation, and used for comparison with the face image of the recipient. On the other hand, in the registration process, by storing the correspondence relationship between account information and pack-ship document information in the account database, it is possible to search for corresponding account information based on the document information of the pack-shipped parcel at the subsequent time of shipment verification of the pack-shipped parcel.

In step 404, if the number of associations between the biological feature and the account information satisfies a predetermined bind condition, a bind relationship between the biological feature and the account information is established based on the relevant relationship.

Each time the steps S401 to 403 are executed, 1 is added to the relevant number of times, and when the relevant number reaches a predetermined number, it is considered that the relevant number satisfies the predetermined bind condition, and is added to the user account. A corresponding real user biological characteristic may be regarded as the above biological characteristic, and in this case, the related relationship may be converted into a bind relationship.

In some embodiments, the method further comprises: determining a confidence value of the association relationship based on the number of associations; The method may include converting the related relationship into a bind relationship when the reliability value reaches a predetermined value. For example, the confidence value is determined to be 40% when establishing the first association relationship, the confidence value is determined to be 60% when establishing the same association relationship for the second time, and the confidence value is determined as 60% when establishing the same association relationship for the third time. Increase the reliability value to 70%. The greater the number of associations of the association relationship, the higher the reliability value, and when the reliability value of the association relationship reaches a predetermined value, the relationship is directly converted into a bind relationship.

There are several methods for converting the related relationship into the bind relationship, and two selectable methods are provided below. The related relationship is added to the relationship table including the bind relationship, and the type field of the related relationship is changed to the type field of the bind relationship.

As described above, when the factory verification is performed on the packed parcel, detection recognition is performed on the first packed image collected corresponding to the packed parcel to obtain the packaged document information included in the first packaged image. Hereinafter, a description will be given of how to perform the recognition processing of the packed document information for the first packed image. After detecting and obtaining the packed document information, shipment verification based on the packed document information and the face image of the above-described embodiment is executed. The method described below may be adopted for the process of obtaining pack-fold document information based on the pack-fold image in any of the above-described embodiments of the present invention.

5 is a schematic diagram showing the flow of an information processing method according to an embodiment of the present invention, and the method can be applied to a terminal device for various document processing or an information system configured by a terminal device and a cloud device, for example, a package It can be applied to the terminal. As shown in FIG. 5 , the method may include the following steps.

In step 501, a first packed image corresponding to a packed vesicle located within a predetermined depth of field range is collected.

In an embodiment of the present invention, the pack-time terminal may collect the first pack-fold image corresponding to the pack-packed parcel through the image collection module, and the depth of field range of the image collection module is determined in advance. If the packed vesicle is located within the area, the first packed image is clear. The upper limit of the predetermined depth of field range is greater than a predetermined value such as 50 cm or 60 cm. For example, the image collection module for collecting the first pack-fold image may include an industrial camera, and the industrial camera has a predetermined depth of field range set in advance, for example, 0-50 cm. When the distance between the packaged parcel and the industrial camera is 50 cm or less, the collected first packaged image is clear. By doing so, the problem of having to perform a focus adjustment operation caused by using a camera with a small depth-of-field range during the acquisition process was solved, and the user's operation was simplified. In addition, a delay in recognition due to focus adjustment is reduced. In this way, when collecting the first packed image, it is not necessary to perform focusing on the camera, and it is possible to avoid the phenomenon that the sharpness of the first packed image is insufficient due to lack of focus. At the same time, it is possible to avoid a phenomenon in which the acquisition delay due to focusing is large.

In an embodiment of the present invention, when collecting a document, it is not necessary to align most of the entire collection area with the barcode area of the document, so the time by manual focusing or automatic focusing can be shortened. Since it is only necessary to collect the first image including the clear document, the acquisition speed can be improved. In addition, when the pack delivery terminal collects the pack pack image corresponding to the pack pack package waiting to be shipped, the image of the pack pack document only needs to be included in the image, so it is positioned in the image area where most of the pack pack documents are located in the entire collection area Since there is no need to perform vesicles, it is possible to improve the collection efficiency for the packed vesicle images.

In an exemplary embodiment, before collecting the first packed-up image, the packed-time terminal may detect whether there is a collection target that falls within a predetermined depth of field range. When it is detected that the first packed parcel has entered the predetermined depth of field range, the pack delivery terminal may turn on the image collection function. After turning on the image collection function, the pack-time terminal may collect a first pack-fold image corresponding to a collection target (eg, a pack-packed parcel) located within the predetermined depth of field range.

For example, the distance sensor may be used to detect whether there is a collection object falling within the predetermined depth of field range. The distance sensor includes, but is not limited to, an infrared sensor, a visible light sensor, a laser sensor, and the like. It consumes a lot of energy to keep the camera on, but when image acquisition is executed by a user's trigger, execution is possible, but acquisition delay occurs. In an embodiment of the present invention, by collecting a distance using a sensor whose power consumption in the on state is less than the power consumption in the on state of the image acquisition module, trigger the image acquisition module to enter the acquisition state from the off state Alternatively, the image acquisition is executed by entering the acquisition state from the pause state. On the one hand, power consumption of the terminal can be saved, and on the other hand, collection of unnecessary images is reduced, and power consumption by processing unnecessary images is reduced.

In a scene where a packed parcel is stored in a collection container, a face image of the recipient of the packed parcel is collected using a camera having a larger predetermined depth of field range, so that the recipient is only within the predetermined depth of field range, and the packaged terminal camera to trigger the acquisition of face images. After the collection is completed, the verification may be completed by inquiring the bind relationship between the facial biometric features of the recipient and account information of the packaged parcel as described in the above embodiment. For example, based on the face image of the recipient and the information of each packed parcel memorized at the time of receipt, the packed parcel received by the recipient is determined to be a parcel at any location in the collection container (inquiry of the packaged parcel will be described in the following embodiment). ) can be viewed), so that in the process of the recipient accessing the pack terminal camera, it is possible to complete the shipment verification for the packaged parcel, and the storage location of the parcel to be received by the recipient on the display screen of the pack terminal can be displayed. can be marked (the archive location can be played back by voice). In this way, when the user approaches the pack delivery terminal, the verification is already completed, and the storage location of the pack delivery parcel can be acquired, and the user can easily receive the parcel directly in the corresponding collection container, simplifying user operation.

In some other embodiments, the recipient inquires the storage location of the packs received by the recipient in the packship terminal (similarly, the related inquiry can refer to the description of the subsequent embodiments), and arrives at the storage location After receiving the parcel, the recipient, in the process of approaching the pack terminal with the already received package, the camera of the pack terminal has a larger predetermined depth of field range, so it is triggered quickly, so that the face image of the recipient and the pack image of the packaged parcel automatically collects, executes the verification of agreement between the two through the method of any of the above-described embodiments, and after passing the verification, can prompt the parcel delivery verification pass by voice or the like, and the recipient can directly pick up the packed parcel In addition, the verification process at the time of shipping the parcel has been accelerated.

In step 502, a target area in which a packed document is located is acquired from the first packed image.

In some embodiments, a required target area may be determined based on the request for obtaining document information. For example, when the acquisition request is acquisition of a document number, a required target area is an imaging area of a barcode in a packed document. Further, for example, when the acquisition information is acquisition of a document number and information other than the document number, the required target area is the imaging area of the entire packed document. For example, when a document is received, it may be considered that the acquisition request includes document information other than the document number. Further, for example, when releasing a received document, it can be considered that the acquisition request includes only the document number. Of course, the above is merely an example, and specifically, it can be realized based on a request for obtaining document information to satisfy different needs of different scenes.

In some embodiments, the target area may be an imaging area of a document image formed by collecting the entire document, for example, an imaging area of a document (ie, a document image) and an imaging area of a document in the first packed image. It may be a background area other than that, and directly recognizes the whole of the first packed image. However, in this way, since the background area interferes with the recognition of the imaging area of the document, after recognizing the imaging area of the document (ie the document image), only the document imaging area can be further recognized, on the one hand, the recognition of the document Speed can be improved, and on the other hand, unnecessary interference can be reduced.

In some embodiments, the document image may be an image of a document. The document may be of various types of documents, for example, a package document, a bill, a ticket, a document, and the like. The document includes document information, and the document information includes a document number of the document, for example, at least one of a pack-fold number of a pack-fold document, a ticket number of a ticket, and an invoice number of an invoice. In some embodiments, the document information further includes information related to the owner of the document on the document, for example, contact information of the owner, address information of the owner, publication time information of the document, validity time information of the document, etc. It further includes other document information, and is not limited to the above document number.

In some other embodiments, the target area may be an imaging area of a barcode in the document. In this case, there is a possibility that the information on the document has already been recorded in the network device, but at least a document identifier corresponding to the barcode on the document is required for the current user to take the document and perform an operation, and also the document of the entire document in the network device. get information The barcode may include a one-dimensional code and/or a two-dimensional code. The two-dimensional code may include a rectangular two-dimensional code and/or a circular two-dimensional code. In some embodiments, the barcode may be one or plural.

In some embodiments, the document is a packed document corresponding to a packed package, and in this case, obtaining the target area in which the packed document is located from the first packed image may make the area corresponding to the entire packed document as the target area, , it may be regarded as a target area of at least a part of the area in which the packed document is located. For example, the pack delivery document information may include at least one of recipient information and pack delivery identification information of the first pack delivery parcel. Recognizing the recipient information and the pack-fold identification information may include: determining, as a target area, a text area, which is an imaging area of characters in the packed-fold document, as a target area in the first packed-fold image; and/or obtaining recipient information by recognizing the text area in question. Alternatively, the barcode area of the packed document is determined from the first packed image to the target area, wherein the barcode area is an imaging area of the barcode in the packed document, and the pack-fold identification information can be obtained by recognizing the barcode area. Meanwhile, the text included in the text area of the packed document is not limited to numbers, characters, and/or Chinese. In short, the imaging area in which such text is located is the text area. Accordingly, by recognizing the text area, it is possible to obtain pack-fold identification information represented by numbers. The format of the barcode area includes, but is not limited to, two-dimensional code / one-dimensional code, and the like. Also by recognizing the barcode area, pack identification information can be obtained.

Meanwhile, in some embodiments, detection of document information may be realized using a detection model. In order to improve the detection precision of the document information, the method includes performing transformation processing on a target region cut from the first packed image, so that the target region after transformation processing meets the image processing requirements of the detection model do. The deformation processing at least includes performing shape transformation such as stretching and/or compression on the target region of the first shape to obtain the target region of the second shape. Here, the second shape may be a standard shape and/or the first shape may be a non-standard shape. Pixel up-sampling is performed on a target area less than a predetermined image resolution to obtain a target area such as at least a predetermined image scenic spot. The target area facing the second direction may be obtained by performing direction change such as rotation and/or mirroring processing on the target area in the first direction. Flip to the target area that is facing in the direction it is facing. An inverse perspective transformation is performed on the target region to obtain the target region in which the depth of field of each sub-region coincides. For example, when collecting a packed document, if a certain part of the document is closer to the camera than another part, since the depth of field of each part of the collected document is different, a perspective effect appears in the first image. In the embodiment of the present invention, through the reverse processing of the perspective transformation, a target area without a difference in the perspective effect is obtained. By doing so, by inputting the target area after the deformation processing into the detection model, on the one hand, the detection model can detect the document information at high speed, and on the other hand, the detection accuracy can be improved.

In some embodiments, when the barcode area of the packed document is recognized, edge detection processing is performed on the first packed image to determine position information of the barcode area in the first packed image, and further, Based on the location information of the barcode area in the one-pack image, the first pack-fold image is cut to obtain the image of the barcode region, and the image of the barcode region is recognized to obtain the pack-fold identification information of the first pack-fold parcel can On the other hand, in some other embodiments, if the barcode area obtainable by cutting is inclined, after obtaining the barcode area image, normalization processing is performed on the image of the barcode area to recognize the image of the barcode area after normalization, You can get packer identification information.

Edge detection in accordance with embodiments of the present invention is a fundamental problem in image processing and computer vision recognition. The purpose of edge detection is to identify points with significant changes in luminance within the numeric image. Significant changes in image properties usually reflect events and changes in which the properties are important, for example (i) discontinuities in depth, (ii) discontinuities in surface direction, (iii) changes in material properties, and (iv) changes in scene lighting. include change. Edge detection is a field of study in image processing and computer vision recognition, particularly feature extraction. The barcode region in the first packed-fold image is extracted through edge detection, intercepted after normalization through the affine transformation method, and an image of the barcode region after normalization is obtained, and then the OCR recognition is performed.

As described above, by determining the target area from the first packed image, the target area including the packed document information and the background area can be separated. By doing so, only the target area can be detected, on the one hand, unnecessary detection can be reduced, and the acquisition speed of document information can be improved, and on the other hand, by detecting only the target area after recognizing the target area in advance, the target area It is possible to reduce interference with the detection of document information in the background area other than the background area, reduce a phenomenon of deterioration in detection accuracy due to interference, and improve detection accuracy.

In step 503, the image of the target area is detected to obtain packed document information included in the packed document.

In some embodiments, an image of a target region may be input to a detection model, and document information may be output using a method such as extraction of a feature by the detection model. For example, the detection model may be a machine learning model or a deep learning model. For example, the pack time document information may include a record of wearing the pack, the wearing record may include the document information and the wearing information, and the wearing information includes information such as a wearing time, a wearing place, a wearing device, and the like. may include In addition, for example, the pack ship document information may include a shipment record of the pack ship, the shipment record may include the document information and the shipment information, and the shipment information includes information such as a shipment time, a shipment place, a shipment device, and the like. may include. Also, for example, when the detection target is a bill, the document information of recognition may further include electronic stock information of the bill.

In one exemplary scene, the pack time document information may include at least one of recipient information and pack ship identification information. The process of acquiring the recipient information and the pack identification information includes: recognizing a barcode area in the first pack image to obtain pack pack identification information of the first pack package; and performing image text recognition on the first packaged image to obtain recipient information of the first packaged parcel. By performing image text recognition on the collected first packaged image, it is possible to obtain recipient information and package identification information of the first packaged parcel described in the first packaged image.

Image text recognition in an embodiment of the present invention can be realized based on optical character identification, and the optical character recognition (Optical Character RecOgnition, OCR) is generally performed on paper using an electronic device (eg, a scanner or a digital camera). It means the process of checking printed characters, detecting dark and bright patterns to determine their shape, and then converting the shape into computer characters using a character identification method, that is, in the case of printed characters, optical It is a technique for converting document text on paper into a black-and-white dot matrix image file, converting the text in the image into a text format through recognition software, and further editing and processing using text processing software. Executing image text recognition on the collected first packaged image can be obtained mainly by performing OCR recognition on information on the packaging (parcel) of the first packaged image, and may include recognition of a packaged document. there is. Here, the barcode area of the packaged document is recognized, and information on the recipient of the first packaged parcel described in the first packaged image and the packaging identification information of the first packaged parcel are obtained. The recipient information of the first package delivery package may include the recipient's name, contact number, address, and the like.

In some embodiments, when recognizing the pack-fold identification information of the barcode region of the pack-fold document, the barcode region in the first pack-fold image is cut to obtain an image of the barcode region, and normalization processing is performed on the barcode region image Then, the image of the barcode area after normalization is recognized. after performing normalization processing on the image of the barcode area, verifying whether the image of the barcode area after the normalization is valid; If the image of the barcode area after the normalization is valid, the method further includes triggering the step of recognizing the image of the barcode area after the normalization. In addition, verifying whether the barcode information is valid includes: determining whether a barcode length in the barcode area is the same as a length limit value; when the barcode length in the barcode area is equal to the length limit value, determining whether the image of the barcode area after normalization is valid, or determining whether a barcode in the barcode area meets a barcode code rule ; and when the barcode in the barcode area satisfies the barcode code rule, determining that the image of the barcode area after the normalization is valid.

The pack times terminal determines whether the barcode in the first pack times image has a predetermined length limit value, and if it is not the predetermined length limit value, determines that the barcode is invalid. For example, it may be influenced by factors such as angle, and may output prompt information to collect images again. Illustratively, it may be determined whether the barcode satisfies a barcode code rule, and invalid barcode information may be filtered. The barcode code rule may be a barcode rule set according to the requirements of various existing packaging companies. You can filter invalid barcodes based on regular expressions. A regular expression is a matching filtering rule that is realized by following a regular expression. A regular expression is a logical expression of string manipulation. By using some specific characters defined in advance and a combination of these specific characters, a “rule string” is constructed, and the “rule string” expresses one filtering logic for the character string.

For example, the pack-bae terminal may verify the barcode information through the pack-bae inventory management interface. That is, the OCR recognition and/or the verification process may be completed using a cloud server, or may be completed locally in a packer terminal, and embodiments of the present invention are not limited thereto. In one embodiment, the model may be trained based on a sample image with a relatively fixed background (the input image is a gray scale image). In the embodiment of the present invention, a smaller algorithm model is adopted, and the face recognition algorithm and OCR algorithm are integrated, so that it can be executed on a low-profile open source board, compared with the case of running on the host and server, and the cost is greatly reduced and can reduce the difficulty of deployment.

In some embodiments, when information obtained by recognizing a text area of a packed document is called first recognition information, and information obtained by recognizing a barcode area of a packed document is called second recognition information, the first recognition information and the By performing a mutual comparison based on the second recognition information, the accuracy of information may be secured through the mutual comparison. Specifically, in the embodiment of the present invention, the first recognition information may be obtained by recognizing the text area by optical character recognition (OCR). For example, the first recognition information may be obtained by recognizing text information in an image using OCR technology or the like. In some embodiments, the text area may be transmitted to the cloud device, and first recognition information obtained by recognizing the text area by the cloud device may be received. In some other embodiments, it is also possible to transmit the barcode region to the cloud device, and receive second recognition information obtained by recognizing the barcode region by the cloud device. Of course, in some embodiments, the terminal device may recognize the text area and the barcode area by itself to obtain the first recognition information and the second recognition information.

When the first recognition information and the second recognition information satisfy a predetermined matching condition, the packed document information included in the packed document is obtained based on the first recognition information and/or the second recognition information. For example, when the degree of matching between the first recognition information and the second recognition information reaches a predetermined matching value, it is considered that the first recognition information and the second recognition information satisfy the predetermined matching condition. For example, the document number in the first recognition information and the second document number in the second recognition information are compared one by one, the number of matches is calculated, and the degree of matching is determined based on the total number of characters of the number of matches. can be confirmed For example, when the degree of matching reaches 90% or 95% or more, it is determined that the degree of matching between the first recognition information and the second recognition information has reached a predetermined matching degree value.

When the first recognition information and the second recognition information completely match, the packed document information of the packed document is determined based on the first recognition information or the second recognition information. When the first recognition information and the second recognition information do not completely match, pack-fold document information is determined based on the recognition information of the first recognition information and the second recognition information. For example, the number of characters included in the document number is constant, or the code of the document number satisfies a certain rule. When one of the first recognition information and the second recognition information does not satisfy the document number matching rule, such as when the number of characters is small or large, the pack-folded document information is determined according to the other. In some new embodiments, based on the context information of the text area and the barcode area, determining whether to determine the packed document information based on the first recognition information or to determine the packed document information based on the second recognition information do. For example, the sharpness of the text area and the barcode area is compared, the one with higher sharpness is determined, and finally, pack-fold document information is obtained based on the recognition information corresponding to the one with the higher sharpness.

In some embodiments, the method further includes outputting prompt information for re-collecting when the first recognition information and the second recognition information do not satisfy a predetermined matching condition. If the first recognition information and the second recognition information do not satisfy a predetermined matching condition, prompt information is output, and the prompt information triggers collection again. In this way, when accurate pack-fold document information cannot be obtained in one collection, it is automatically triggered to collect accurate pack-fold document information again.

After recognizing the packaged document information, based on the packaged document information and the first face image of the recipient of the packaged parcel, shipment verification of the packaged parcel may be executed, and for details, refer to the above-described embodiment.

6 is a schematic diagram showing a flow of an information processing method according to an embodiment of the present invention, and when the method of the embodiment of the present invention is applied to a pack-ahead terminal, the pack-ship terminal may include a first camera, a transceiver, and a display screen, but this not limited The method describes the flow of pack-time inquiry. For example, the recipient may inquire whether or not he or she has a parcel delivery waiting to be received through the pack delivery terminal. As shown in Fig. 6, the information processing method includes the following steps. Here, with respect to the content that has already been described in any of the above-described embodiments, the embodiments of the present invention will not be repeatedly described, but reference may be made to the above-described embodiments.

In step 601, a second face image is collected.

In an embodiment of the present invention, the packbae terminal may include a face recognition system and may periodically collect images. For example, it is possible to collect the second face image corresponding to the user who came to the inquiry of the pack-shipped parcel.

In step 602, the second face image is sent to the server through the transceiver, and the first face image is used to instruct the server to retrieve second identity information matching the second face image.

In step 603, the server receives, through the transceiver, information on the package to be received, which is determined based on the second identification information.

Here, the pack delivery information on the waiting list that matches the second identification information determined by the server may include storage location information of the pack delivery parcel. For example, the storage location information indicates shelf information in a warehouse in which the packaged parcel is arranged, and enables a high-speed search for the packaged storage location. In one embodiment, when generating the storage location information of the packed parcel, the identification information of the user to which the packaged parcel belongs may be bound, and the packaged parcel waiting to be received may be searched based on the identification information, and , it is possible to determine the storage location of the package and parcel.

In an embodiment, the second identification information may be a target mobile phone number, and the server may inquire information about a package to be received that is bound to the target mobile phone number. The pack delivery information waiting to be received may include pack delivery information that the user has not received. After determining the target mobile phone number, the server may inquire the package delivery waiting-to-package information created in association with the target mobile phone number, and also obtain information on the storage location of the pack delivery parcel. After obtaining the storage location information of the packed parcel matched with the second identification information, the server may transmit the storage location information to the pack delivery terminal.

In step 604, the package delivery information waiting to be received is displayed on the display screen.

Here, the storage location information may include at least one of warehouse identification information, shelf identification information, identification information of storage compartments in the shelf, and pack identification information.

The warehouse identification information is used to indicate the warehouse in which the pack is stored, the shelf identification information is used to indicate the shelf in which the pack is stored, and the identification information of the storage compartment in the shelf indicates the storage compartment in which the pack is stored. It is used to bet, and the pack times identification information may include information for recognizing the pack times, such as a pack times number and a pack times barcode, but is not limited thereto.

The pack ship terminal receives the storage location information through the transceiver, and then displays the storage location information on the display screen of the pack ship terminal to indicate to the user the searched pack ship and the stored location, and allows for quick retrieval of the pack ship and shipment or receipt can be conveniently made.

Using the embodiment of the present invention, after the user obtains the storage location information, the employee does not need to go to the warehouse to find the pack, and he can go to the corresponding storage location to receive the pack by himself. On the one hand, it is possible to search the storage location of the pack at high speed, and on the other hand, it is possible to save the labor cost, and it is possible to improve the processing efficiency in the process of distributing the pack. In addition, since the storage location information is information obtained after the user's identity is verified and passed, the user can realize identification in the process of receiving the pack, thereby enhancing the security of pack management.

7 is a schematic diagram showing the flow of the pack times inquiry method. As shown in FIG. 7 , the pack times terminal can communicate with the server and other business servers, and the pack times inquiry method may include the following steps.

In step 701, the packer terminal detects an image change using the first camera. That is, the first camera may periodically acquire an image and detect whether a user, a face, or the like appears in a scene.

In step 702, the face image is acquired and transmitted to the module 1 of the server. Specifically, the acquired face image may be sent to the server, and the module 1 may be a business service module for executing face image processing, and specifically may be a face recognition software program. In some embodiments, module 1 may be a set of several development tools used by a software engineer to build application software, such as a specific software package, software frame, hardware platform, operating system, or the like. That is, a software product provided by a third-party service provider may be a toolkit for realizing a specific function.

In step 703, based on the face image group returned by the server, one face image with the highest probability is filtered and selected. The module 1 provides a face recognition function, searches for and returns a group of face images that satisfy the similarity request (the similarity is greater than or equal to a predetermined threshold), and the packbae terminal determines one face image as the face recognition result. can do.

In step 704, the face image is sent to the module 2 of the server, and the mobile phone number bound to the face is retrieved. As described above, the already memorized face image and the mobile phone number have a bind relationship, the module 2 may be a cloud business service that provides identification information inquiry in the server, and the server uses the cloud business service to The target mobile phone number can be determined and fed back to the packer terminal.

In step 705, a list of packages waiting to be received of the mobile phone number is retrieved by inquiring through the business server of the other company. The packer terminal sends an inquiry command including the target mobile phone number to a third-party business server (for example, a third-party inventory management system server), and the third-party business server acquires a list of packages waiting to receive the target mobile phone number, It can feed back to the packbae terminal.

In an embodiment, a plurality of pack-time terminals may be arranged in a plurality of areas. Here, after uploading the face data to the cloud platform, it is possible to classify it by device number, etc., make the matching range of facial features as small as possible, improve the matching speed, and reduce the false recognition rate. Exemplarily, the binding relationship between the face template image and the identity information may be released or changed as needed. The device number can be set in the machine number of the packer terminal collected by default, and if the machine number does not exist, the device number can be created when the application is run by starting the packer terminal for the first time, and the uniqueness of the device number can be ensured.

Illustratively, other user terminal devices may also communicate with the packer terminal through a network. In a specific method, the user may communicate with the pack-bae terminal through an application (APP) installed in a terminal device (eg, a mobile phone).

In general, in the case of a pack, only the shipment of the pack can be recorded, and neither confirming the identity of the recipient of the pack nor recording specific information of the recipient of the pack is possible. In addition, there are currently many pack ships in various places, and the burden on the staff is high due to the large number of pack ships. does not exist. An embodiment of the present invention can collect a face image and a pack-packed parcel image, respectively, by using two cameras, perform identification on the recipient, and record pack-ship shipment information in a pack-ship shipment scene, and abnormalities in the reception scene It can alert the clerk when it occurs, record the recipient's information, and reduce fraudulent receipts.

For example, in the case of a package recipient of a receiving or shipping scene, if there is no corresponding face image information, prompt information indicating that personal registration information is insufficient may be output. When performing a pack inquiry by inputting identification information, for a user who has never registered, the user may be prompted to collect face and bind face image information and identification information, specifically, the related description of the embodiment of FIG. 8 can refer to

Specifically, the binding between the face and the identity information may be performed using the pack-bae terminal. If there is no corresponding face image information, prompt information indicating that personal registration information is insufficient can be output. For an absent user, the user may be prompted to perform face collection and binding of face image information and identity information.

That is, in one embodiment, the method includes: receiving an inquiry command including third identity information; in response to the inquiry command, acquiring a face template image corresponding to the third identification information; collecting a third face image using the first camera when face template image information corresponding to the third identification information is not obtained; and sending the third identification information and the corresponding third face image to the server via the transceiver.

The user may manually inquire by using the pack ship terminal, and may trigger the inquiry command by inputting third identification information. The pack-time terminal acquires a face template image corresponding to the third identification information. As described above, for example, the acquisition of the face template image corresponding to the third identification information may be executed in a pack-time terminal or a cloud server, and thus, it will not be repeatedly described herein. If the face template image corresponding to the third identification information is not found, that is, when the user has not registered the face information, the packbae terminal may collect the third face image of the user through the first camera. In addition, the third identification information and the corresponding third face image may be transmitted to the server through the transceiver, and the server may record the information to register the user information. After that, the user can execute the function to inquire and receive the pack by face recognition. Specifically, the pack-bae terminal may receive and inquire the information input by the user. For example, the user may input the third identification information in the packer terminal to inquire whether there is a packer waiting to be received.

The packbae terminal may display the bound packbae information to the user by inquiring based on the mobile phone number input by the user. Specifically, reference can be made to the schematic diagram showing the flow of the binding method between the face and the mobile phone number shown in Fig. 8 . The method may include the following steps, wherein the steps already described in the above examples among the following steps will not be repeatedly described herein.

In step 801, the first camera detects an image change.

In step 802, a face image is acquired and transmitted. Here, the server may realize face recognition using the module 3 .

In step 803, one face with the highest probability is filtered and selected based on the returned face group.

In step 804, the mobile phone number and the face image are sent to the module 4 of the server to execute the bind. As described above, it is possible to determine the target mobile phone number of the user by the cloud business service of the module 4 having a correspondence relationship between the already stored face image and the mobile phone number.

In step 805, the bind information is transmitted to the business server of the other company. The packbae terminal may send the bind information to a third-party business server (for example, a packbae management system), and the third-party business server may memorize the user's bind information, and then the user may use the above-described method (facial recognition Including) can execute receipt and inquiry.

In the scene, the user inputs a mobile phone number to manually inquire, and when a corresponding package document is inquired, the bind interface may be called to execute face binding.

In one embodiment, the pack ship terminal in the embodiment of the present invention is also applied to information registration of the pack ship wearing scene. The method includes collecting a packed image of a packed parcel by using a packed terminal camera, and acquiring information about the recipient of the packed parcel and packaged parcel identification information described in the packed image; generating pack pack wearing information including recipient information and pack pack identification information described in the pack pack image; and sending the pack delivery information to a third-party management system to execute wearing registration.

Specifically, the pack image can be understood as an image including a pack package, for example, an image collected when the pack ship is put into stock and the pack ship enters the camera range. For example, when wearing a pack, it may be an image collected when an employee advances the pack. The pack pack terminal includes a camera for collecting the pack pack image, that is, the employee can stand in the pack pack terminal image collection area with the pack ship, and the pack pack terminal can collect and recognize the pack pack image using the camera. .

For the method of extracting the image information, reference may be made to the description of any of the above-described embodiments, and a description thereof will not be repeated here.

Illustratively, by combining the facial recognition described above, the identity of the employee in charge of wearing the pack can be confirmed and registered, and similarly, the acquisition of a face image and verification of the identity can be performed using the camera. Packbae wearing information includes the face image of the employee. In addition, through face recognition, it is also possible to inquire information about wearing packs in charge of different employees, and the process may refer to packing pack receipt inquiry, which will not be repeated here. Through the above technical solution, the warehousing packbae is more standardized, more secure, and easy to check.

9 is a schematic diagram showing the flow of a method for storing packs according to an embodiment of the present invention, and the execution subject in the embodiment of the present invention may be the packbae terminal, and may communicate with the server and other business servers. As shown in FIG. 9 , the method may include the following steps.

In step 901, the second camera detects an image change, and transmits camera frame data. Here, specifically, reference may be made to the description of any of the above-described embodiments. Since the second camera is different from the first camera for face recognition, it may be an industrial camera, and since it can acquire a black and white image, it is convenient for barcode recognition and the like. The camera frame data is a collected packed image, and can be transmitted to the module 5 in the drawing (eg, packed document image cutting SDK) to execute processing.

In step 902, the barcode area is cut through the image processing service provided by the module 5, the image is normalized, and returned to the pack terminal.

In step 903, the normalized packed document is transmitted. The normalized packed document may be sent to the server, and the server may use the module 6, for example, using a cloud service having a packed document recognition function, to perform cloud recognition of the packed document, and Packed documents Get packer information.

In step 904, the mobile phone number, barcode, other OCR information, and the like are returned to the packer terminal.

In step 905, it is stocked (package shipping number, recipient's mobile phone number). The packer terminal transmits the stock information including the packer number and the recipient's mobile phone number to a third-party business server (eg, a third-party inventory management system server). Third-party business servers enable accurate and secure inventory management by registering.

The packer terminal may also execute advertisement recommendation. In one embodiment, the pack-time terminal acquires, from the server, a target feature label matching the first face image of the recipient, and at least one target recommendation information corresponding to the target feature label, and is further displayed on the display screen of the pack-time terminal. The at least one piece of target recommendation information may be displayed.

In an embodiment, the packer terminal may acquire a target feature label matching the first facial image of the recipient from the server, and the server stores feature labels for describing a plurality of facial feature attributes. Illustratively, facial feature information of the first facial image can be obtained by using a trained neural network model, that is, by extracting the facial feature and determining a target feature label that matches the first facial image, directivity information recommendations can be implemented.

Through facial recognition, facial features can be more accurately extracted and analyzed, and a user's feature label can be determined. For example, the feature label may include user attributes (eg, gender, age, race, etc.) and user behavior (smile, composure, etc.). By determining one or a plurality of target feature labels corresponding to the first face image information, acquiring and displaying the corresponding at least one piece of recommended information, thereby realizing a directional recommendation to the user, and advertising that satisfies its identity and status. can recommend

In an embodiment, a plurality of feature labels and a mapping relationship between feature labels and recommendation information may be set in advance, and at least one piece of target recommendation information may be determined based on the target feature label. The recommendation of the target information may be executed when the user is inquiring about the pack or when receiving the pack. For example, the pack-bae terminal may display the storage location information to the user and display the target recommendation information.

Illustratively, by recognizing the user's clothing and determining the characteristic label, a corresponding advertisement may be recommended, for example, similar style clothing may be recommended, but the present invention is not limited thereto.

The information recommendation is realized using a cloud service (eg Advertising Software Development Kit). By way of example, an advertisement pool is realized using an existing transmission application, and an advertisement corresponding to the terminal pack is finally displayed.

The method realizes directional information recommendation to the user by tracing and capturing the face features of the recipient at high speed and acquiring accurate feature labels on the premise of a general general-purpose camera.

In another embodiment, based on the face information, multimedia information corresponding to a user image corresponding to the face information is output. One or a plurality of pieces of information for identifying a user's identity may be extracted from the face information. In an embodiment of the present invention, a user image of a user currently processing a document may be obtained based on the face information. The user image may represent at least one of a user's preference, a user's disgust, a user's consumption request, a user's consumption habit, a user's payment ability, a user's aesthetic ability, and the like.

In an embodiment of the present invention, the multimedia information is output based on the user image. The terminal device may have a waiting time for information input or the like in the process of putting in or out of the document, and may use the time to output multimedia information suitable for a user image, thereby improving the user experience. The multimedia information includes various kinds of promotion information, for example, advertisements of products and/or services may be included.

An embodiment of the present invention further provides an information processing method applied to a server. 10 is a schematic diagram showing a flow of another information processing method, and as shown in FIG. 10 , the method may include the following steps.

In 1001, a second face image transmitted by the pack-bae terminal is received.

In 1002, second identification information matching the second face image is retrieved.

The method of 1003, wherein the storage location information of the pack boat matched with the second identification information is determined, and the storage location information is transmitted to the pack boat terminal, wherein the storage location information indicates the location information of the pack boat.

In an embodiment, the storage location information may include at least one of warehouse identification information, shelf identification information, identification information of a storage compartment in the shelf, and packer identification information.

Here, the detailed process of the information processing method executed on the server side may refer to the description of the server in the above embodiment, and will not be repeated here.

The above has mainly described the technical solutions of the embodiments of the present invention in terms of the implementation process of the method. It can be understood that the information processing apparatus includes a corresponding hardware configuration and/or software module for executing each function in order to realize the above functions. Those skilled in the art should understand that each exemplary unit and algorithm step described in the embodiments disclosed herein may be implemented in hardware or a combination of hardware and computer software. Whether a specific function is executed in hardware or computer software is executed by driving the hardware depends on specific application and design constraints. Skilled artisans may implement the described functions using different methods for each particular application, but such realization should not be considered as exceeding the scope of the invention.

An embodiment of the present invention may divide the information processing apparatus into functional units according to the example of the method. For example, each functional unit may be divided corresponding to each function, and two or more functions may be integrated into one processing unit. The integrated unit may be realized by adopting the form of hardware, or may be realized by adopting the form of a software function unit. It is necessary to explain that the unit division in the embodiment of the present invention is schematic and is only a logical function division, and that there may be other division methods in actual implementation.

Hereinafter, in combination with any of the above examples, two specific examples are provided.

In Example 1, this example provides an information processing method, and this technical solution mainly uses packed OCR recognition to extract all text information on a packed document. Here, since the recognition of the pack number uses both character OCR recognition and barcode recognition, and also employs a cross check method, a high accuracy rate in the complex scene can be ensured.

At the same time, by performing verification through the methods of face recognition and document recognition, it is possible to ensure accurate and efficient receipt of packs.

Pack number recognition: In this scene, the following steps are mainly performed using the pack number number.

First, the advertiser (Android) detects the packed document, takes a picture, and cuts a part of the packed document. The advertiser returns some images of the packed document to the cloud, executes OCR detection by the cloud server to detect the barcode area and the packed number area, and performs barcode recognition and OCR recognition, respectively. At the same time, one piece of recognition information is obtained for the barcode, and another piece of recognition information is obtained based on OCR recognition. By comparing these two pieces of recognition information, a comparison result of this pack times number is obtained.

Since the cloud compares the two results, a result with high reliability is obtained, and if the comparison result does not match, the reliability is lower, so detection, imaging and recognition are performed again.

Facial Recognition Verification: When shipped, the user scans the document identification number and mobile phone number, simultaneously recognizes the user's face using the all-in-one machine, and based on the bind relationship between the generated face and mobile phone number , the user account (ie, mobile phone number) is detected, compared with the mobile phone number of the recipient of the package delivery document, and the verification is passed if the comparison is correct. This method can significantly improve the efficiency of pack-packing. Although the conventional method takes about 15 to 30 s to manually sign and remove, the automatic delivery method takes only 1 to 2 s, so that the processing efficiency can be significantly improved.

In Example 2, this example provides a method of unguided binding between a mobile phone number and a face, and may specifically include the following steps.

Since there is no relation between the user's face and mobile phone number in the initial stage, a set of associative identification mechanisms is required. This product adopts a non-guided bind method, and since there is a strong relationship between the user's identity and the package received by the user, by tracking the user's receiving of the package, the relationship between the user's face and mobile phone number is gradually improved. can be strengthened For example, if user 1 receives one pack (mobile phone number is A), set the related relationship to be 60%, and next time user 1 receives another pack pack with mobile phone number A, 90 %, and if it occurs again, it can be considered as 99%. This parameter is a hypothetical parameter and is actually a predicted value by big data. After that, if the predetermined threshold is set as the threshold of the relation (corresponding to the predetermined value described above), the bind relationship between the user's face and the mobile phone number can be completed.

After obtaining user identification information such as user's facial feature information, and then obtaining a user image based on the user identity, it is possible to realize directional transmission of target recommendation information.

Fig. 11 is a schematic diagram showing a flow of a method for releasing a pack according to an exemplary embodiment, and the method can be executed by any device. For example, it may be executed by a packer terminal or a server. 11 , the method includes the following processing, but in a specific implementation, the execution order between each step is not limited, and processing that has already been described in any embodiment above is not repeatedly described. does not

In step 1101, a packaged image of the collected parcel is acquired using at least one camera of the terminal device, wherein the packaged image is used to acquire information about the packaged document of the packaged parcel.

For example, the terminal device of the embodiment of the present invention may include, but is not limited to, a packed terminal. The terminal device may collect the pack image and the first face image by using the same camera, and may collect the pack image and the first face image by using different cameras, respectively. The pack-shipped parcel may be a parcel waiting to be shipped, and the pack-ship document information includes, but is not limited to, at least one of recipient information and pack-time identification information of the pack-shipped parcel.

In step 1102, a first face image collected using the at least one camera is acquired. For example, the first face image may be a face image of the recipient of the packaged parcel.

In step 1103, the delivery operation of the packaged parcel is executed based on the packaged image and the first face image.

For example, when executing the shipping operation of the packed parcel based on the packed image and the first face image, by determining whether the first face image and the packed document information acquired in the packed image match or not, the You can run a release job.

The method may be applied to a terminal device, and the terminal device may collect a first face image and a pack image by using a camera, and execute the delivery operation of the pack package based on the pack image and the first face image. For example, the terminal device may verify the packaged image and the first face image, and may execute a shipping operation for the packaged parcel based on the verification result. Further, for example, the terminal device transmits a shipment request to the server, the server verifies based on the shipment request to obtain a verification result, and returns the verification result to the terminal device, and the terminal device performs verification based on the verification result. It is possible to run a release operation for a pack parcel. The release request may include the first face image and the packed image, or the terminal device may select one or any plurality of features extraction, document detection, text recognition, barcode recognition, etc. for the first face image and packed image. It is possible to transmit the release request included in the result obtained by executing the processing of the process to the server, but the embodiment of the present invention is not limited thereto.

The method may be applied to a server, wherein the server receives a shipment request including the first face image and the pack image sent by the terminal device, and verifies the first face image and the pack image to obtain a verification result, based on this to determine the shipping operation to be executed for the packed parcel, or the server returns an instruction for executing the shipping operation for the packed parcel to the terminal device, and causes the terminal device to execute the shipping operation for the packed parcel.

When it is determined whether the first face image and the pack-fold document information acquired in the pack-fold image match, the first account information is obtained by inquiring the account database based on the pack-fold document information, and the first face image and the second By judging whether the face registration data corresponding to the account information match 1, it is possible to determine whether or not the pack-shipped parcel has been shipped out. For example, the first account information may include, but is not limited to, information such as a mobile phone number and identification number. The face registration data corresponding to the first account information may be obtained based on a bind relationship between the account information previously bound by the user and the face data. If the first face image and the face registration data match, the verification pass can be shipped out. Here, the face registration data may be information that can uniquely identify a person's identity, such as facial features/iris features, and by comparing the face registration data with the face image of the recipient, it is determined whether the recipient is the actual recipient. can be confirmed

In some other embodiments, when determining whether or not the first face image and the packed document information acquired in the packed image match, a face database is searched based on the first face image to query the first face Obtaining the person identification information of the image, whether the face identification information and the recipient information included in the pack delivery document information match, and/or, in the pack delivery information corresponding to the face identification information and the pack delivery document information By judging whether the included pack identification information matches, it can be determined whether the packed parcel has been shipped out.

For example, the facial identification information may be a mobile phone number, and in this case, the mobile phone number is obtained based on the recipient's face image, and the mobile phone number and the recipient's mobile phone number written in the parcel delivery document on the package. to determine whether they match. Or look up the corresponding mobile phone number based on the recipient's face image, look up the corresponding pick-up package based on the mobile phone number, and check whether the pack ship waiting for receipt and the pack ship identification on the currently accepted package match match determine whether If the comparison is consistent, the verification pass can be confirmed, and the packaged parcel can be shipped out. On the other hand, by realizing pack delivery through a method of comparing whether or not the pack pack information on the waiting list corresponding to the face identification information and the pack pack identification information match, there is no need to execute text recognition, so that the pack pack recipient information is not actually Even if it is not the name of the company, it can be published.

In some embodiments, when the first face image and the pack-ship document information acquired from the pack-shipped parcel image match, it is determined that the pack-shipped parcel has been delivered. In addition, it is possible to update the state of the pack-shipped parcel to the state of completion of shipment. Of course, whether or not to update the shipment status may be a selectable operation.

In some embodiments, when the first face image and the acquired pack-ship document information do not match, it is determined that an abnormality has occurred in the delivery of the pack-shipped parcel. When an abnormality occurs in shipment, warning information may be output (eg, a voice prompt), or the package may be placed in a pack-and-box device, or the user may be prompted to enter verification information. For example, if the recipient puts the received parcel on the pack delivery terminal bearing platform, and the verification face image and the pack delivery document information do not match, the pack delivery locking device on the pack delivery terminal is opened. For example, the pack and unload device may be a storage space communicating with the bearing platform, and automatically open the storage space so that the packed parcel automatically enters the storage space, thereby playing a role in protecting the packaged parcel, Avoid receiving scams.

In some embodiments, document recognition processing is performed on at least a portion of the packaged image to obtain the packaged document information, wherein the packaged document information includes at least one of recipient information of the packaged parcel and identification information of the pack. Executes a shipping operation for the packed parcel based on the pack-ship document information and the first face image. For example, performing barcode recognition processing on the barcode area of the packed image to obtain the pack identification information, and/or executing text recognition processing on the text area of the pack image to identify the recipient information and the pack times Get at least one of the information.

Executing document recognition processing for at least a part of the packed image to obtain the packed document information includes: performing edge detection processing on at least a part of the packed image to obtain position information of a barcode area; performing a cutting process on at least a part of the packed image to obtain an image of the barcode area; and recognizing the image of the barcode area to obtain the pack-fold identification information.

Before recognizing the image of the barcode area, by comparing at least one of a barcode length and barcode content included in the image of the barcode area, verifying whether the image of the barcode area is valid or not, Recognizing the image of the area includes executing recognition of the barcode area image when it is determined that the image of the barcode area is valid.

For example, it is verified whether the image of the barcode area is valid by comparing the barcode length and the length limit value included in the image of the barcode area. Alternatively, by determining whether a barcode in the image of the barcode area satisfies the barcode code rule, it is verified whether the image of the barcode area is valid. For specific determination rules, reference may be made to the above-described embodiments.

Executing document recognition processing for at least a part of the packed image to obtain the packed document information includes: performing packed document detection on the packed image to obtain position information of the packed document in the packed image; acquiring a target area image including at least a part of the packed document in the packed image based on the location information of the packed document; and performing recognition processing on the target area image to obtain the packed document information.

The pack-fold identification information includes first pack-fold identification information obtained by performing text recognition processing on at least a portion of the pack-fold image and second pack-fold identification information obtained by performing barcode recognition processing on at least a portion of the pack-fold image, Executing the shipping operation for the packed parcel based on the pack-fold document information and the first face image may include: determining whether the first pack-fold identification information and the second pack-fold identification information match; and when the first pack identification information and the second pack identification information match, the first pack identification information or the first identification information and the first face image to perform a shipping operation for the packaged parcel include that The comparison of the second pack times identification information with the first pack times identification information herein may refer to the comparison between the first identification information and the second identification information in the above-described embodiment, and will not be repeatedly described.

Executing the shipping operation for the packed parcel based on the pack-fold document information and the first face image may include: obtaining first account information by inquiring an account database based on the pack-folding document information; and determining whether the first face image and the face registration data corresponding to the first account information match, thereby determining whether or not the pack-shipped parcel has been shipped.

Executing the shipping operation for the packed parcel based on the pack-ship document information and the first face image includes querying a face database based on the first face image to obtain face identification information of the first face image ; and whether the face identification information and the recipient information included in the pack delivery document information match, and/or whether the pack delivery information on the waiting list corresponding to the face identification information and the pack delivery identification information included in the pack delivery document information match By judging whether or not, it includes determining whether or not the package has been shipped out.

When the method is applied to the server, acquiring the pack image and the first face image of the packed parcel collected by using at least one camera of the terminal device includes receiving the pack delivery request message sent by the terminal device. and, the pack times shipment request message includes at least one of the pack times image and the first face image. For example, in such a scene, the recipient puts a packed parcel waiting to be picked up on the pack delivery terminal, and the pack delivery terminal may collect the packed image of the packed parcel and the first face image of the recipient. Here, the pack-fold terminal transmits these two images to the server through the pack-fold request message, the server extracts the pack-fold document information in the pack-fold image, and verifies that the first face image and the pack-fold document information match, and , the unfamiliar mother, the pack-ahead terminal, sends the pack-ahead image to the server, returns the pack-fold document information recognized by the server to the pack-bae terminal, and the pack-bae terminal can verify the correspondence between the first face image and the pack-fold document information there is. Alternatively, the packbae terminal transmits the first face image to the server, the server returns the identity information of the recipient recognized to the packbae terminal, and the packbae terminal compares its identity information with the packbae document information recognized from the packbae image . In actual implementation, it is not limited to the above method, and there may be other methods. In other words, the packbae terminal may transmit at least one of the collected packbae image and the first face image to the server, and the server may cooperate to execute processing such as image recognition or matching verification.

The method includes: in response to receiving a packet inquiry request, acquiring a second face image collected using the at least one camera; obtaining storage location information of a pack vessel waiting to be received by the user based on the second face image; and displaying the storage location information on a display screen of the terminal device.

For example, when the method is executed by the pack-time terminal, the pack-time terminal receives the pack-time inquiry request, collects the recipient's second face image, and obtains information on the storage location of the pack-pack waiting for the user to receive. The second face image may be transmitted to the server and storage location information returned by the server may be received. When the method is executed by the server, after the pack delivery terminal receives the recipient's pack delivery inquiry request, it sends the pack delivery inquiry request to the server, and also sends the collected second face image to the server, and is stored by the server The information is obtained and transmitted to the pack terminal, and the pack ship terminal displays the storage location information.

The method includes: acquiring a target feature label matching the first facial image, and acquiring at least one target recommendation information corresponding to the target feature label; and displaying the at least one target recommendation information on a display screen of the terminal device.

When the method is applied to a terminal device, executing the shipping job of the packed parcel based on the pack image and the first face image is to send the first face data and the pack data to the server, so that the server is determining whether the face image and the pack-fold image match, the first face data includes the first face image and/or feature information of the first face image, and the pack-fold data includes the pack-fold image including at least a part of and/or the packed document information acquired within the packed image; and receiving instruction information sent by the server, wherein the instruction information is used to indicate whether or not the packed parcel has been shipped out.

That is, in this case, the server executes the shipment verification, that is, the server executes the matching verification between the packed document information and the first face image. The face image and the first face image are collected and acquired by the face image terminal, and when specifically implemented, the face image terminal directly transmits the first face image to the server, or a face obtained by performing feature extraction on the first face image The feature data may be transmitted, or the first facial image and the facial feature data may be transmitted. The pack data may be at least a part of the pack image corresponding to the pack pack, or at least a part of the pack image and/or pack document information. The package document information may be package identification information obtained by recognizing the barcode area, or may be recipient information obtained by performing text detection on the text area.

In some embodiments, the pack delivery terminal or server may send a pack delivery notification message to the pack delivery management system after the pack delivery terminal or server is shipped out, wherein the pack delivery notification message includes information on the pack delivery package and a first face image may include, wherein the information of the packaged parcel may include at least a part of the packaged image and/or the packaged document information corresponding to the packaged parcel, so that the pack management system executes the shipment record.

The pack delivery method of the embodiment of the present invention may be executed by a terminal device or a server. Further, the processing described in the embodiment of the information processing method described above may also be flexibly executed on the terminal device side or on the server side, so the embodiment of the present invention does not limit the device specifically executing the method. . It is good if the terminal device and the server cooperate to realize the delivery control of the packaged parcel. For example, a process related to recognition of packed document information in a packed image may be executed by the terminal device, may be executed on the server side, or may be executed cooperatively by both. In addition, for example, recognition processing for a face image, or matching verification between a face image and packaged document information, may be similarly executed in an arbitrary device.

According to the pack delivery method of the embodiment of the present invention, by verifying the pack image of the packed parcel and the face image of the recipient, the delivery control for the packed parcel is executed, so that identity verification is performed on the recipient, and the recipient performs the actual packed parcel You can verify whether you are a recipient of

Fig. 12 is a schematic diagram showing a flow of a method for releasing a pack in one exemplary embodiment, the method can be executed by a server, and as shown in Fig. 12 , the method can include the following steps.

In step 1201, a pack times shipment request message sent by the terminal device is received, wherein the pack times shipment request message includes first face data and pack times data, and the first face data is the first face data collected by the terminal device. 1 face image and/or feature information of the first face image, and includes at least a part of the pack image of the pack data package and/or pack document information acquired in the pack fold image.

In step 1202, based on the first face data and the pack data, delivery verification of the packed parcel is executed.

In step 1203, a pack delivery response indicating whether the delivery verification has been passed is transmitted to the terminal device.

Here, in step 1202, the execution verification of the parcel delivery based on the first face data and the pack-fold data is included in the face identification information corresponding to the first face data determination and the pack-fold document information corresponding to the pack-fold data. Based on whether the received recipient information matches, and/or whether the pack delivery information on the waiting list corresponding to the face identification information and the pack delivery identification information included in the pack delivery document information match, whether or not to ship the packaged parcel includes assuring Alternatively, by judging whether the face registration data corresponding to the first account information obtained based on the first face image and the pack delivery data match, it is possible to determine whether the pack delivery parcel is shipped. Specific processing may refer to any embodiment of the present invention.

In some embodiments, when the packed data received by the server is at least a part of the packed image, the method further includes executing packed document detection on the packed image to obtain position information of the packed document in the packed image. A target area image including at least a part of the packed document in the packed image is acquired based on the location information of the packed document, and recognition processing is performed on the target area image to obtain packed document information.

On the other hand, the server may also execute processing for acquiring the corresponding person identification information based on the first face image, and when recognizing the packed document information, the detection of the text area, the detection of the barcode area, the validation of the barcode area , a plurality of processes such as a normalization process of a barcode image may be executed, and specific reference may be made to any embodiment of the present invention.

According to the pack shipping method of the embodiment of the present invention, by verifying the pack shipping data and the recipient's face data of the pack shipping package, and executing release control on the pack shipping parcel, identity verification can be performed on the recipient, and the recipient can actually verify the pack shipping Verifies whether you are the recipient of the parcel, and makes the outgoing of the packed parcel more secure.

As shown in FIG. 13 , an embodiment of the present invention provides an electronic device, which includes a processor 1301 and a memory 1302 . Here, the electronic device 1300 may further include a bus 1303 , and the processor 1301 and the memory 1302 are connected to each other through the bus 1303 . The bus 1303 may be a Peripheral COMpOnent IntercOnnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus 1303 may be divided into an address bus, a data bus, a control bus, and the like. For ease of expression, only one thick line is used in FIG. 13, but this does not mean that there is only one bus or one type of bus. Here, the electronic device 1300 may further include an input/output device 1304, and the input/output device 1304 may include a display screen, such as a liquid crystal monitor screen, etc. The memory 1302 is configured to Storing one or a plurality of programs including, the processor 1301 calls the instructions stored in the memory 1302 to execute some or all of the method steps according to any embodiment of the present invention.

For example, the memory may be various types of memory, such as random memory, read-only memory, flash memory, and the like. The memory is used to store information, for example, to store computer executable instructions and the like. The computer executable instructions may be various program instructions, for example, target program instructions and/or source program instructions.

The processor may be of various types of processors, for example, a central processing unit, a microprocessor, a digital signal processor, a programmable array, a digital signal processor, a specific purpose integrated circuit, or an image processor.

The processor is connected to the memory via a bus. The bus may be an integrated circuit bus or the like.

In some embodiments, the electronic device may further include a communication interface. The communication interface may include a network interface such as a local area network interface and a transceiver antenna. The communication interface is likewise connected to the processor and can be used for transmitting and receiving information.

In some embodiments, the electronic device further comprises a human-computer interaction interface, for example, the human-computer interaction interface may include various input/output devices such as a keyboard, a touch screen, etc. .

In one possible embodiment, by implementing the above electronic device, collecting a second facial image using a camera; sending the second facial image to a server via a transceiver; receiving the storage location information via a transceiver; and displaying the storage location information on the display screen, wherein the second face image is retrieved by the server for second identity information matching the second face image, and the package delivered with the second identity information matching the second face image. is used to determine storage location information of

In another possible embodiment, by executing the above-described electronic device, receiving the second face image transmitted by the facsimile terminal; retrieving second identification information matching the second facial image; determining storage location information of the packed parcel matched with the second identification information; and transmitting the storage location information to the pack delivery terminal, wherein the storage location information is used to indicate warehouse shelf information on which the pack delivery parcel is placed.

In another possible embodiment, the electronic device may be a terminal device (eg, a packer terminal) shown in FIG. 14 . The terminal device includes a top camera, wherein the top camera can scan the packaged parcel arranged in the arrangement area to obtain a first packaged image, and can also scan the packaged document on the parcel to obtain a packaged document image. The terminal device may further include a camera for recognizing a face, and the camera may collect a face image and extract biological features. The terminal device may further include a human-computer interaction interface such as a touch display screen, and the interface may receive a user operation and execute processing based on the user operation. The touch display screen can carry out human-computer interaction when receiving or leaving a packed parcel.

In some embodiments, the device shown in FIG. 14 above may be a network terminal connected to a network, that is, the terminal device has a communication module. After the communication device discovers that the parcel to which the document is attached by the package distributor is being distributed to the terminal device, the terminal device automatically scans the document information on the package document in the process of receiving the parcel. After obtaining the account information in the document information, the product receipt information is transmitted to the user terminal in which a bind relationship with the account information is established based on the account information. The product receipt information may remind the user of receipt of the product. The product receiving information includes at least a product receiving address. In some embodiments, the product receipt information may further include product receipt proof.

If the user does not have time to receive the product on their own, someone can help you receive the product. can receive In this way, document warehousing staff such as packers can place and scan the document in the arrangement area to simply complete document warehousing, and there is no need to manually edit a message to notify the corresponding customer of receipt of the product. . In some embodiments, in order to sharpen the packed parcel image and/or the face image, by further installing a fill light on the top of the terminal device, turning on the fill light or adjusting the brightness when the ambient light is insufficient, Packed vesicle images and/or face images of sufficient brightness can be collected.

15 is a block diagram of an information processing apparatus provided by an embodiment of the present invention, and as shown in FIG. 15 , the apparatus includes an image collection module 1501; An information acquisition module 1502 and an operation execution module 1503 may be provided. Here, the image collection module 1501 collects a first packed image corresponding to the first packaged parcel, and collects a first face image of the recipient of the first packaged parcel. The information acquisition module 1502 acquires pack-fold document information of the first packaged parcel included in the first packaged image, wherein the pack-fold document information includes at least one of recipient information and pack-fold identification information of the first packaged parcel do. The operation execution module 1503 executes a pack delivery operation of the first packed parcel based on the pack delivery document information of the first packed parcel and the first face image.

In some embodiments, the operation execution module 1503 is specifically configured to acquire first identification information consistent with the first face image, and the first identification information matches the recipient information of the first packaged parcel In this case, it confirms the passing verification pass of the first pack-shipped parcel, and/or updates the storage state corresponding to the first-packed parcel to the shipment completion state.

In some embodiments, the operation execution module 1503 also outputs warning information when the first identification information does not match the recipient information of the first packaged parcel.

In some embodiments, as shown in FIG. 16 , the apparatus may further include an information display module 1504 . Here, the image collection module 1501 also collects a second face image. The information obtaining module 1502 is further configured to: send, by the server, the second face image to the server for retrieving second identification information matching the second face image; The server receives the information on the package to be received, which is determined based on the second identification information. The information display module 1504 includes displaying the package information of the waiting to be received on the display screen.

In some embodiments, the information acquisition module 1502, when acquiring pack-fold document information of the first pack-packed parcel included in the first pack-fold image, executes edge detection processing on the first pack-fold image to perform the first pack-fold image. Determine the location information of the barcode area in the 1-pack image, and cut the first packed-fold image based on the location information of the barcode area in the first pack-fold image to obtain an image of the barcode area, Recognize to obtain pack-fold identification information of the first pack-packed parcel.

In some embodiments, the information acquisition module 1502 acquires the target area in which the packaged document is located in the first packaged image when acquiring the packaged document information of the first packaged parcel included in the first packaged image. and detecting the image of the target area to obtain pack-fold document information included in the pack-fold document, wherein the pack-fold document information includes at least one of the recipient information and the pack-fold identification information.

In some embodiments, as shown in FIG. 16 , the device detects whether there is a collection object that falls within a predetermined depth of field range before the image collection module collects the first packed image, and and a collection trigger module 1505 for turning on an image collection function of the image collection module when it is detected that the single-pack parcel has entered the predetermined depth of field range.

In some embodiments, when the information acquisition module 1502 acquires a target area in which a packed document is located in the first packed image, a text area that is an imaging area of a character in the packed document in the first packed image is determined as a target area, and/or a barcode area that is an imaging area of a barcode in the packed document in the first packed image is determined as the target area.

In some embodiments, when the information acquisition module 1502 detects the image of the target area and obtains the packed document information included in the packed document, the first recognition information obtained by detecting the text area of the packed document and second recognition information obtained by detecting a barcode area of the packed document is obtained, and when the first recognition information and the second recognition information satisfy a predetermined matching condition, the first recognition information and/or The pack-fold document information included in the pack-fold document is obtained based on the second recognition information.

In some embodiments, the manipulation execution module 1503 is specifically configured to, when it is determined that the first account information and the first biological feature corresponding to the first face image have a bind relationship, the To confirm the delivery verification pass, the recipient information of the first pack-shipped parcel includes the first account information.

In some embodiments, the operation execution module 1503 is further configured to output a verification prompt for inputting verification information when the bind relationship is not established between the first biological characteristic and the first account information, and Based on the verification information, a pack-ship shipment operation for the first parcel-packed parcel is executed.

17 is a block diagram of the apparatus for sending out a pack provided by an embodiment of the present invention, and as shown in FIG. 17 , the apparatus may include an image acquisition module 1701 and a shipment processing module 1702 . Here, the image acquisition module 1701 acquires the pack-fold image of the packed parcel collected using at least one camera of the terminal device, and acquires the first face image collected using the at least one camera, The image is used to acquire the pack document information of the pack package. The shipping processing module 1702 executes the shipping job of the packed parcel based on the pack image and the first face image.

In some embodiments, the delivery processing module 1702 specifically determines whether the first face image and the pack-fold document information acquired in the pack-fold image match, thereby executing the dispatching operation of the pack-shipped parcel.

In some embodiments, when the apparatus is applied to a terminal device, the shipment processing module 1702 executes the shipment operation of the packaged parcel based on the packaged image and the first face image, the first face data and By sending the pack data to the server, the server determines whether the first face image and the pack face image match, and receives the instruction information sent by the server, wherein the first face data is the first face image and/or feature information of the first face image, wherein the pack data includes at least a part of the pack image and/or the pack fold document information acquired in the pack fold image, and the instruction information includes the pack fold package It is used to indicate whether the product has passed the release or not.

In some embodiments, the shipping processing module 1702 executes document recognition processing for at least a portion of the packed image when executing the shipping operation of the packed parcel based on the packed image and the first face image, Obtaining the packed document information, and executing a shipping operation for the packed parcel based on the packed document information and the first face image, wherein the packed document information includes at least one of recipient information of the packed parcel and identification information include

In some embodiments, when the shipment processing module 1702 executes document recognition processing for at least a part of the packed image to obtain the packed document information, it performs barcode recognition processing on the barcode area of the packed image, Obtaining the package identification information and/or performing text recognition processing on the text area of the pack image to obtain at least one of the recipient information and the pack identification information.

In some embodiments, when the shipment processing module 1702 executes document recognition processing for at least a part of the packed image to obtain the packed document information, it performs edge detection processing on at least a part of the packed image to The location information of the barcode area is obtained, the cutting process is performed on at least a part of the pack-fold image to obtain an image of the barcode area, and the image of the barcode area is recognized to obtain the pack-fold identification information.

In some embodiments, the shipment processing module 1702 is further configured to compare, before recognizing the image of the barcode area, at least one of a barcode length and a barcode content included in the image of the barcode area, such that the barcode area Verifying whether the image of is valid and recognizing the image of the barcode area includes executing recognition of the barcode area image when it is determined that the image of the barcode area is valid.

In some embodiments, when the shipment processing module 1702 executes document recognition processing for at least a part of the packed image to obtain the packed document information, the pack-folded image is detected by detecting the packed-folded document. Obtaining location information in the packed image, acquiring a target area image including at least a part of a packed document in the packed image based on the location information of the packed document, and performing recognition processing on the target area image, Get package information.

In some embodiments, when the shipping processing module 1702 executes the shipping operation for the packed parcel based on the packed document information and the first face image, the first pack identification information and the second pack identification information are It is determined whether the first pack identification information matches the second pack fold identification information, and when the first pack fold identification information matches the second pack fold identification information, it is sent to the pack pack based on the first pack fold identification information or the first identification information and the first face image. Execute a shipment operation for the package, wherein the pack-fold identification information is the first pack-fold identification information obtained by performing text recognition processing on at least a portion of the pack-fold image and the barcode recognition process obtained by performing barcode recognition processing on at least a part of the pack-fold image It includes second pack ship identification information.

In some embodiments, when the shipping processing module 1702 executes the shipping job for the packed parcel based on the pack document information and the first face image, the account database is searched based on the pack delivery document information. By obtaining the first account information and determining whether the first face image and the face registration data corresponding to the first account information match, it is determined whether or not the parcel delivery has been passed.

In some embodiments, the shipping processing module 1702 queries the face database based on the first face image when executing the shipping job for the packed parcel based on the packed document information and the first face image. to obtain the face identification information of the first face image, whether the face identification information and the recipient information included in the pack delivery document information match, and/or whether the face identification information matches the pack delivery information corresponding to the face identification information and the By determining whether or not the pack identification information included in the pack delivery document information matches, it is determined whether the pack delivery package has been shipped out.

In some embodiments, when the apparatus is applied to the server, the image acquisition module 1701 receives the pack delivery request message sent by the terminal device when acquiring the pack image and the first face image, wherein the The shipment request message includes at least one of the pack image and the first face image.

In some embodiments, as shown in FIG. 18 , the device acquires a second face image collected by using the at least one camera in response to a packet inquiry request being received, and the second face image The method may further include an inquiry processing module (1) 703 configured to obtain storage location information of a pack vessel waiting to be received by the user based on , and display the storage location information on a display screen of the terminal device.

In some embodiments, as shown in FIG. 18 , the device acquires a target feature label matching the first face image, and acquires at least one target recommendation information corresponding to the target feature label, the terminal and an information recommendation module 1704 for displaying the at least one target recommendation information on a display screen of the device.

19 is a block diagram of a device for sending out a pack provided by an embodiment of the present invention, and as shown in FIG. 19, the device includes a message receiving module 1901; verification processing module 1902; and a response transmission module 1903 . Here, the message receiving module 1901 receives the pack times shipment request message sent by the terminal device, wherein the pack times shipment request message includes first face data and pack times data, and the first face data collects the terminal device It includes a first face image of a recipient and/or characteristic information of the first face image, and includes at least a part of the pack-fold image of the pack-fold data package and/or pack-fold document information acquired within the pack-fold image. The verification processing module 1902 executes outgoing verification of the packed parcel based on the first face data and the pack-fold data. The response transmission module 1903 transmits to the terminal device a pack-time shipment response indicating whether the shipment verification has been passed.

In some embodiments, the verification processing module 1902 is specifically configured to query a face database based on the first face image to obtain person identity information of the first face image, and include the face identity information and the pack-fold document. By judging whether the recipient information included in the information matches and/or whether the pack delivery information corresponding to the face identification information matches the pack delivery information included in the pack delivery document information, the packed parcel Confirms whether the delivery has been accepted or not.

In some embodiments, the verification processing module 1902 is specifically configured to query an account database based on the pack-fold document information to obtain first account information, By judging whether or not the face registration data match, it is determined whether or not the pack delivery parcel has been shipped out.

In some embodiments, when the verification processing module 1902 executes the shipment verification of the packed parcel based on the first face data and the pack-fold data, the pack-folded document is detected by detecting the pack-folded image with respect to the packed-folded document. Obtaining location information in an image, acquiring a target area image including at least a portion of a packed document in the packed image based on the location information of the packed document, and performing recognition processing on the target area image to perform a recognition process on the packed document get information

An embodiment of the present invention provides a computer recording medium, in which computer executable instructions are stored, and when the computer executable instructions are executed, information provided by one or more embodiments described above It is possible to implement a processing method or a pack-shipping method.

The computer recording medium includes various recording media having a recording function, for example, a CD, a floppy disk, a hard disk drive, a magnetic tape, an optical disk, a U disk or various recording media such as a mobile hard disk. The selectable computer recording medium may be a non-transitory recording medium. The computer recording medium is read by the processor, and the computer executable instructions stored in the computer recording medium are acquired and executed by the processor, and the information processing method or package delivery method provided by any one of the above-described technical solutions. This is implemented.

Embodiments of the present invention further provide a computer program product, wherein the computer program product includes computer-executable instructions, and when the computer-executable instructions are executed, information processing provided by one or more of the above-described embodiments A method or a pack release method is implemented.

The above includes a computer program specifically contained in a computer storage medium, the computer program includes program code for executing the method shown in the flowchart, and the program code includes the steps of the method provided by the embodiment of the present invention. contains corresponding instructions for execution.

The devices and methods provided by the present invention may be realized through other methods. The embodiments of the devices described above are merely schematic. For example, the division of the unit is nothing more than division of a logical function, and a separate division method may be followed in actual implementation. For example, a plurality of units or components may be combined, or integrated into one system, or some features may be ignored or not implemented. Further, the coupling or direct coupling or communication connection between each component shown or described and the indirect coupling or communication connection of the device or unit may be in electrical, mechanical or other form.

The unit described as the separated component may or may not be physically separated, and the component indicated as a unit may be a physical unit that may be disposed in one place or distributed in a plurality of network units. By selecting some or all of the units according to actual needs, the objectives of the technical solutions of the embodiments of the present invention can be realized.

In addition, each functional unit in each embodiment of the present invention can be integrated into one processing module, each unit can be used individually, and two or more units can be integrated into one unit. . The above-described integrated unit is realized in the form of hardware or a functional unit of hardware and software.

The technical features disclosed in any embodiment of the present invention may be arbitrarily combined to form an embodiment of a new method or an embodiment of a device, as long as they are not in competition. Examples of methods disclosed by any embodiment of the present invention may be arbitrarily combined to form a new method embodiment, as long as they are not in competition. Embodiments of devices disclosed by any embodiment of the present invention may be arbitrarily combined to form a new device embodiment, as long as they do not compete.

A person skilled in the art can understand that all or some steps of the embodiment of the method may be implemented by hardware related to program instructions. The above-described program is stored in a computer-readable recording medium, and when the program is executed, the steps of the embodiment of the method are executed. The aforementioned recording medium includes a medium capable of storing various program codes, such as a mobile storage device, a read-only memory (ROM), a random access memory (RAM), a floppy disk, an optical disk, and the like. .

The above is only a specific embodiment of the present invention, and the protection scope of the present invention is not limited thereto. Any changes or substitutions that those skilled in the art can easily come up with within the technical scope disclosed in the present invention are covered within the protection scope of the present invention. Therefore, the protection scope of the present invention shall follow the protection scope of the above claims.

Claims (60)

In the information processing method applied to the pack-bae terminal,
collecting a first packed image corresponding to the first packed vesicle;
acquiring pack-fold document information of the first pack-packed parcel included in the first pack-fold image;
collecting a first facial image of the recipient of the first packaged parcel; and
Comprising executing a pack-shipping operation of the first pack-packed parcel based on the pack-ship document information of the first pack-shipped parcel and the first face image,
The pack delivery document information includes at least one of recipient information and pack delivery identification information of the first pack delivery parcel
Information processing method, characterized in that. According to claim 1,
Executing a pack delivery job based on the pack delivery document information of the first pack delivery parcel and the first face image includes:
obtaining first identification information consistent with the first facial image; and
If the first identification information and the recipient information of the first packaged parcel match, confirming that the first packaged parcel delivery verification pass is passed, and/or the storage state corresponding to the first packaged parcel delivery is completed including updating the state
Information processing method, characterized in that. 3. The method of claim 2,
When the first identification information and the recipient information of the first package delivery do not match, the method further comprises outputting warning information.
Information processing method, characterized in that. 4. The method according to any one of claims 1 to 3,
collecting a second facial image;
sending, by the server, the second face image to the server for retrieving second identification information matching the second face image;
receiving, by the server, information on the package waiting to be received, which is determined based on the second identification information; and
The method further comprising displaying information on the package waiting to be received on a display screen
Information processing method, characterized in that. 5. The method according to any one of claims 1 to 4,
Acquiring pack-fold document information of the first pack-packed parcel included in the first pack-fold image includes:
performing edge detection processing on the first packed image to determine position information of a barcode area in the first packed image;
cutting the first packed-fold image based on location information of the barcode area in the first packed-fold image to obtain an image of the barcode area; and
Recognizing the image of the barcode area comprises obtaining pack-fold identification information of the first pack-fold parcel
Information processing method, characterized in that. 6. The method according to any one of claims 1 to 5,
Acquiring pack-fold document information of the first pack-packed parcel included in the first pack-fold image includes:
acquiring a target area in which a packed document is located in the first packed image; and
Comprising detecting the image of the target area to obtain the packed document information included in the packed document,
The pack-time document information includes at least one of the recipient information and the pack-time identification information
Information processing method, characterized in that. 7. The method of claim 6,
Before collecting the first packed-fold image, it is detected whether there is a collection target that has entered the predetermined depth of field range, and when it is detected that the first packed-folded vesicle has entered the predetermined depth of field range, the image collection function is turned on further including doing
Information processing method, characterized in that. 8. The method of claim 6 or 7,
Acquiring the target area where the packed document is located in the first packed image includes:
determining a text area, which is an imaging area of characters in the packed document, as a target area in the first packed image; and/or;
determining, as the target area, a barcode area, which is an imaging area of a barcode in the packed document, as the target area in the first packed image
Information processing method, characterized in that. 9. The method according to any one of claims 6 to 8,
Detecting the image of the target area to obtain packed document information included in the packed document,
acquiring first recognition information obtained by detecting a text area of the packed document;
acquiring second recognition information obtained by detecting a barcode area of the packed document; and
When the first recognition information and the second recognition information satisfy a predetermined matching condition, obtaining the packed document information included in the packed document based on the first recognition information and/or the second recognition information containing
Information processing method, characterized in that. 7. The method of claim 6,
The recipient information of the first packaged parcel includes first account information,
Executing the pack-shipping operation of the first pack-packed parcel based on the pack-ship document information and the second face image of the first pack-packed parcel,
When it is determined that the first biological feature corresponding to the first face image and the first account information have a bind relationship, the method comprising:
Information processing method, characterized in that. 11. The method of claim 10,
outputting a verification prompt for inputting verification information when the bind relationship is not established between the first biological characteristic and the first account information; and
Based on the input verification information, the method further comprises executing a pack-ship shipment operation for the first parcel-packed parcel.
Information processing method, characterized in that. In the pack-ship shipping method,
acquiring a packed image of the packed parcel collected by using at least one camera of the terminal device, wherein the packed image is used to acquire packed document information of the packed parcel;
acquiring a first face image collected using the at least one camera; and
Based on the pack image and the first face image, it comprises executing a shipment operation of the pack pack
A method of shipping a pack, characterized in that. 13. The method of claim 12,
Executing the shipping operation of the pack-packed parcel based on the pack-packed image and the first face image,
By judging whether or not the first face image and the pack-fold document information acquired in the pack-fold image match, executing the dispatch operation of the pack-folded parcel
A method of shipping a pack, characterized in that. 14. The method of claim 12 or 13,
The pack-ship shipment method is applied to the terminal device,
Executing the shipping operation of the pack-packed parcel based on the pack-packed image and the first face image,
sending the first face data and the face data to the server, so that the server determines whether the first face image and the face image match, the first face data being the first face image and/or the face data including feature information of a first face image, wherein the pack-fold data includes at least a part of the pack-fold image and/or the pack-fold document information acquired within the pack-fold image; and
Receiving the instruction information sent by the server, the instruction information is used to indicate whether the packed parcel has been shipped or not, including
A method of shipping a pack, characterized in that. 14. The method of claim 12 or 13,
Executing the shipping operation of the pack-packed parcel based on the pack-packed image and the first face image,
performing document recognition processing on at least a part of the pack image to obtain the pack document information, wherein the pack document information includes at least one of recipient information and pack pack identification information of the pack pack; and
Based on the pack-ship document information and the first face image, including executing a shipping operation for the pack-shipped parcel
A method of shipping a pack, characterized in that. 16. The method of claim 15,
Obtaining the packed document information by performing document recognition processing on at least a part of the packed image,
performing barcode recognition processing on the barcode area of the pack-fold image to obtain the pack-fold identification information; and/or;
performing text recognition processing on the text area of the pack image to obtain at least one of the recipient information and the pack fold identification information
A method of shipping a pack, characterized in that. 17. The method of claim 15 or 16,
Obtaining the packed document information by performing document recognition processing on at least a part of the packed image,
performing edge detection processing on at least a part of the packed image to obtain position information of a barcode area;
performing a cutting process on at least a part of the packed image to obtain an image of the barcode area; and
Recognizing an image of the barcode area to obtain the pack-fold identification information
A method of shipping a pack, characterized in that. 18. The method of claim 17,
Before recognizing the image of the barcode area,
Comparing at least one of a barcode length and barcode content included in the image of the barcode region, further comprising verifying whether the image of the barcode region is valid,
Recognizing the image of the barcode area is,
When it is determined that the image of the barcode area is valid, performing recognition of the barcode area image
A method of shipping a pack, characterized in that. 19. The method according to any one of claims 15 to 18,
Obtaining the packed document information by executing document recognition processing on at least a part of the packed image,
performing packed-fold document detection on the packed-fold image to obtain location information of the packed-fold document in the packed-fold image;
acquiring a target area image including at least a part of the packed document in the packed image based on the location information of the packed document; and
performing recognition processing on the target area image to obtain the packed document information
A method of shipping a pack, characterized in that. 20. The method according to any one of claims 15 to 19,
The pack-fold identification information includes first pack-fold identification information obtained by performing text recognition processing on at least a portion of the pack-fold image and second pack-fold identification information obtained by performing barcode recognition processing on at least a portion of the pack-fold image,
Executing the shipping operation for the packed parcel based on the packed document information and the first face image,
determining whether the first pack times identification information and the second pack times identification information match; and
When the first pack identification information and the second pack identification information match, the first pack identification information or the first identification information and the first face image to execute a shipping operation for the packaged parcel containing
A method of shipping a pack, characterized in that. 21. The method according to any one of claims 15 to 20,
Executing the shipping operation for the packed parcel based on the packed document information and the first face image,
obtaining first account information by inquiring an account database based on the pack time document information; and
Determining whether or not the face registration data corresponding to the first face image and the first account information match, and determining whether the parcel delivery package has been shipped
A method of shipping a pack, characterized in that. 21. The method according to any one of claims 15 to 20,
Executing the shipping operation for the packed parcel based on the packed document information and the first face image,
querying a face database based on the first face image to obtain face identification information of the first face image; and
Whether the face identification information and the recipient information included in the pack delivery document information match and/or whether the pack delivery information on the waiting list corresponding to the face identification information matches the pack delivery information included in the pack delivery document information By judging, comprising determining whether the package delivery parcel has been shipped
A method of shipping a pack, characterized in that. 13. The method of claim 12,
The above shipping method is applied to the server,
Acquiring the packed image and the first face image of the packed parcel collected by using at least one camera of the terminal device,
Comprising receiving the package release request message sent by the terminal device,
The pack times shipment request message includes at least one of the pack times image and the first face image
A method of shipping a pack, characterized in that. 23. The method according to any one of claims 12 to 22,
acquiring a second face image collected by using the at least one camera in response to the packet inquiry request being received;
obtaining storage location information of a pack vessel waiting to be received by the user based on the second face image; and
Displaying the storage location information on a display screen of the terminal device further comprising
A method of shipping a pack, characterized in that. 25. The method according to any one of claims 12 to 24,
acquiring a target feature label matching the first facial image, and acquiring at least one target recommendation information corresponding to the target feature label; and
Displaying the at least one target recommendation information on a display screen of the terminal device
A method of shipping a pack, characterized in that. In the pack-ship shipping method,
Receiving the pack delivery request message sent by the terminal device, wherein the pack delivery request message includes first face data and pack times data, wherein the first face data includes a first face image of the recipient collected by the terminal device and / or including characteristic information of the first face image, including at least a part of the pack image of the pack data pack and/or package and/or pack fold document information acquired in the pack fold image;
executing shipment verification of the pack-packed parcel based on the first face data and the pack-fold data; and
Comprising transmitting a pack delivery response to the terminal device for indicating whether the delivery verification has been passed
A method of shipping a pack, characterized in that. 27. The method of claim 26,
Executing the shipment verification of the pack-packed parcel based on the first face data and the pack-fold data,
querying a face database based on the first face image to obtain person identification information of the first face image; and
Whether the face identification information and the recipient information included in the pack delivery document information match and/or whether the pack delivery information on the waiting list corresponding to the face identification information matches the pack delivery information included in the pack delivery document information By judging, comprising determining whether the package delivery parcel has been shipped
A method of shipping a pack, characterized in that. 27. The method of claim 26,
Executing the shipment verification of the pack-packed parcel based on the first face data and the pack-fold data,
obtaining first account information by inquiring an account database based on the pack time document information; and
Determining whether or not the face registration data corresponding to the first face image and the first account information match, and determining whether the parcel delivery package has been shipped
A method of shipping a pack, characterized in that. 27. The method of claim 26,
Executing the shipment verification of the pack-packed parcel based on the first face data and the pack-fold data,
performing packed-fold document detection on the packed-fold image to obtain location information of the packed-fold document in the packed-fold image;
acquiring a target area image including at least a part of the packed document in the packed image based on the location information of the packed document; and
performing recognition processing on the target area image to obtain the packed document information
A method of shipping a pack, characterized in that. In an electronic device,
a processor and memory;
The memory stores one or a plurality of programs,
The one or more programs are configured to be executed by the processor, wherein the program performs the method according to any one of claims 1 to 11, 12 to 25 and 26 to 29. running
Electronic device, characterized in that. An information processing apparatus applied to a pack ship terminal, comprising:
an image collecting module configured to collect a first packed image corresponding to the first packaged parcel, and collect a first face image of a recipient of the first packaged parcel;
an information acquisition module for acquiring pack-fold document information of the first pack-packed parcel included in the first pack-fold image; and
and an operation execution module for executing a pack delivery operation of the first pack delivery package based on the pack delivery document information of the first pack delivery parcel and the first face image,
The pack delivery document information includes at least one of recipient information and pack delivery identification information of the first pack delivery parcel
An information processing device, characterized in that. 32. The method of claim 31,
The operation execution module is specifically configured to obtain first identification information consistent with the first face image, and when the first identification information matches the recipient information of the first packaged parcel, Confirming the delivery verification pass, and / or updating the storage state corresponding to the first pack-shipped parcel to the released state
An information processing device, characterized in that. 33. The method of claim 32,
The operation execution module is further configured to output warning information when the first identification information and the recipient information of the first package do not match.
An information processing device, characterized in that. 34. The method according to any one of claims 31 to 33,
The image collection module also collects a second face image,
The information obtaining module is further configured to send, by the server, the second face image for retrieving second identity information matching the second face image to the server, and the server determines based on the second identity information Receive the information of the pack ship of one waiting list,
The information processing device further comprises an information display module for displaying the information on the package to be received on a display screen.
An information processing device, characterized in that. 35. The method according to any one of claims 31 to 34,
When the information acquisition module acquires pack-fold document information of the first pack-folded parcel included in the first pack-fold image, it performs edge detection processing on the first pack-fold image to position information of a barcode area in the first pack-fold image to determine, based on the location information of the barcode area in the first pack-fold image, cut the first pack-fold image to obtain an image of the barcode region, and recognize the image of the barcode region to pack the first pack-fold parcel obtaining identification information
An information processing device, characterized in that. 36. The method according to any one of claims 31 to 35,
The information acquisition module acquires, when acquiring pack-fold document information of a first pack-packed parcel included in the first pack-fold image, a target area in which the pack-fold document is located in the first pack-fold image, and detects the image of the target area to obtain pack times document information included in the pack times document, and the pack times document information includes at least one of the recipient information and the pack times identification information
An information processing device, characterized in that. 37. The method of claim 36,
Before the image collection module collects the first packed-fold image, it is detected whether there is a collection target that has entered a predetermined depth of field range, and when it is detected that the first packed-folded parcel has entered the predetermined depth of field range, Further comprising a collection trigger module for turning on the image collection function of the image collection module
An information processing device, characterized in that. 38. The method of claim 36 or 37,
the information acquisition module, when acquiring a target area in which a packed document is located in the first packed image, determines a text area, which is an imaging area of a character in the packed document, as a target area in the first packed image, and/ or, determining, as the target area, a barcode area, which is an imaging area of a barcode in the packed document, as the target area in the first packed image.
An information processing device, characterized in that. 39. The method according to any one of claims 36 to 38,
When the information acquisition module detects the image of the target area to obtain the packed document information included in the packed document, the information acquisition module acquires first recognition information obtained by detecting the text area of the packed document, the barcode area of the packed document acquires second recognition information obtained by detecting To obtain the pack-fold document information included in the pack-fold document
An information processing device, characterized in that. 37. The method of claim 36,
The operation execution module is specifically configured to, when it is determined that the first biological feature corresponding to the first face image and the first account information have a bind relationship, determine the shipment verification pass for the first pack delivery package, Recipient information of the first packaged parcel includes the first account information
An information processing device, characterized in that. 41. The method of claim 40,
The manipulation execution module is further configured to output a verification prompt for inputting verification information when the bind relationship is not established between the first biological characteristic and the first account information, and based on the entered verification information, the first To run a pack-to-ship job for pack-to-pack parcels.
An information processing device, characterized in that. In the package delivery device,
an image acquisition module for acquiring a packed image of a packed parcel collected by using at least one camera of a terminal device, and acquiring a first face image collected by using the at least one camera; and
and a shipment processing module for executing the package shipment parcel shipment operation based on the packaging image and the first face image,
The pack-fold image is used to acquire the pack-fold document information of the pack-packed parcel
Packed shipment device, characterized in that. 43. The method of claim 42,
Specifically, the shipping processing module executes the shipping operation of the packed parcel by determining whether or not the first face image and the packed document information acquired in the packed image match
Packed shipment device, characterized in that. 44. The method of claim 42 or 43,
The pack delivery device is applied to a terminal device,
The shipping processing module transmits the first face data and the pack data to the server when executing the shipping job of the packed parcel based on the pack image and the first face image, so that the server stores the first face image and the face image. determine whether or not the packed images match, and receive the instruction information sent by the server, wherein the first face data includes the first face image and/or feature information of the first face image, The data includes at least a part of the packed image and/or the packed document information acquired within the packed image, and the indication information is used to indicate whether or not the packed parcel has been shipped.
Packed shipment device, characterized in that. 44. The method of claim 42 or 43,
The shipping processing module performs document recognition processing on at least a part of the pack-folded image to obtain the pack-fold document information, when executing the shipping operation of the pack-folded parcel based on the pack-fold image and the first face image, the pack-fold document information Executes a shipping operation for the packaged parcel based on document information and the first face image, wherein the pack-shipped document information includes at least one of recipient information and pack-ship identification information of the pack-shipped parcel
Packed shipment device, characterized in that. 46. The method of claim 45,
When the shipment processing module executes document recognition processing for at least a part of the packed image to obtain the packed document information, it performs barcode recognition processing on the barcode area of the packed image to obtain the packed identification information and/or , to obtain at least one of the recipient information and the pack identification information by executing text recognition processing on the text area of the packed image
Packed shipment device, characterized in that. 47. The method of claim 45 or 46,
When the shipment processing module executes document recognition processing for at least a part of the packed image to obtain the packed document information, it performs edge detection processing on at least a part of the packed image to obtain the location information of the barcode area, and To obtain an image of the barcode area by performing a cutting process on at least a part of the pack-fold image, and to obtain the pack-fold identification information by recognizing the image of the barcode area
Packed shipment device, characterized in that. 48. The method of claim 47,
The shipment processing module also verifies whether the image of the barcode area is valid by comparing at least one of the barcode length and barcode content included in the image of the barcode area before recognizing the image of the barcode area, ,
Recognizing the image of the barcode area includes executing recognition of the barcode area image when it is determined that the image of the barcode area is valid
Packed shipment device, characterized in that. 49. The method according to any one of claims 45 to 48,
When the shipment processing module executes document recognition processing for at least a part of the packed image to obtain the packed document information, the packed document is detected for the packed image to obtain position information of the packed document in the packed image, Obtaining a target area image including at least a part of a packed document in the packed image based on the location information of the packed document, and performing recognition processing on the target area image to obtain the packed document information
Packed shipment device, characterized in that. 50. The method according to any one of claims 45 to 49,
The shipping processing module is configured to determine whether or not the first pack identification information and the second pack identification information match when executing the shipping operation for the pack package based on the pack document information and the first face image, and When the one-pack identification information and the second pack-fold identification information match, the first pack-fold identification information or the first identification information and the first face image perform a shipping operation for the pack-packed parcel, The identification information includes the first pack-fold identification information obtained by performing text recognition processing on at least a part of the packed image, and the second pack-fold identification information obtained by performing barcode recognition processing on at least a part of the packed image.
Packed shipment device, characterized in that. 51. The method according to any one of claims 45 to 50,
The shipping processing module obtains first account information by inquiring an account database based on the pack-folding document information to obtain first account information when executing a shipping operation for the pack-shipped parcel based on the pack-fold document information and the first face image; 1 Determining whether the face image and face registration data corresponding to the first account information match, determining whether the parcel delivery has been passed
Packed shipment device, characterized in that. 51. The method according to any one of claims 45 to 50,
The shipping processing module is configured to query a face database based on the first face image when executing a shipping job for the packed parcel based on the pack-ship document information and the first face image to identify the face of the first face image. obtaining information, whether the face identification information and the recipient information included in the pack delivery document information match, and/or, the pack delivery information corresponding to the face identification information and the pack delivery identification information included in the pack delivery document information By judging whether or not is matched, to determine whether the package delivery parcel has been shipped
Packed shipment device, characterized in that. 43. The method of claim 42,
The above pack delivery device is applied to the server,
The image acquisition module receives the pack times shipment request message sent by the terminal device when acquiring the pack times image and the first face image, wherein the pack times delivery request message includes at least one of the pack times image and the first face image. containing
Packed shipment device, characterized in that. 53. The method according to any one of claims 42 to 52,
In response to the reception of the pack ship inquiry request, a second face image collected using the at least one camera is acquired, and storage location information of a pack ship waiting to be received by the user is acquired based on the second face image, and the Further comprising an inquiry processing module for displaying the storage location information on the display screen of the terminal device
Packed shipment device, characterized in that. 55. The method according to any one of claims 42 to 54,
acquiring a target feature label matching the first face image, acquiring at least one target recommendation information corresponding to the target feature label, and displaying the at least one target recommendation information on a display screen of a terminal device; further comprising an information recommendation module
Packed shipment device, characterized in that. In the package delivery device,
a message receiving module for receiving a pack delivery request message sent by the terminal device;
a verification processing module for executing shipment verification of the packed parcel based on the first face data and the pack-fold data; and
and a response transmission module for transmitting a pack-ship shipment response for indicating whether the shipment verification has been passed to the terminal device,
The pack times shipment request message includes first face data and pack times data, the first face data includes a first face image of the recipient collected by the terminal device and/or feature information of the first face image, Packed data comprising at least a part of the pack image of the pack and/or pack and/or document information acquired in the pack image
Packed shipment device, characterized in that. 57. The method of claim 56,
Specifically, the verification processing module searches a face database based on the first face image to obtain person identification information of the first face image, and the face identification information and recipient information included in the pack document information match Determining whether or not the pack delivery has passed the shipment by determining whether or not and/or whether the pack pack information on the waiting list corresponding to the face identification information and the pack pack identification information included in the pack pack document information match
Packed shipment device, characterized in that. 57. The method of claim 56,
Specifically, the verification processing module obtains first account information by inquiring an account database based on the pack-fold document information, and determines whether the first face image and face registration data corresponding to the first account information match By doing so, to determine whether the pack delivery parcel has been shipped
Packed shipment device, characterized in that. 57. The method of claim 56,
The verification processing module executes pack-folded document detection for the packed-fold image when performing shipment verification of the pack-folded parcel based on the first face data and the pack-fold data, to obtain location information of the pack-fold document in the pack-fold image, and Obtaining a target area image including at least a part of a packed document in the packed image based on the location information of the document, and performing recognition processing on the target area image to obtain the packed document information
Packed shipment device, characterized in that. A computer-readable recording medium for recording a computer program, comprising:
The computer program causes a computer to execute the method according to any one of claims 1 to 11, 12 to 25 and 26 to 29.
A computer-readable recording medium, characterized in that.

Images