CN106529500A - Information processing method and system - Google Patents
Information processing method and system Download PDFInfo
- Publication number
- CN106529500A CN106529500A CN201611071095.1A CN201611071095A CN106529500A CN 106529500 A CN106529500 A CN 106529500A CN 201611071095 A CN201611071095 A CN 201611071095A CN 106529500 A CN106529500 A CN 106529500A
- Authority
- CN
- China
- Prior art keywords
- physiological
- image
- unmanned aerial
- aerial vehicle
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/70—Multimodal biometrics, e.g. combining information from different biometric modalities
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The embodiments of the invention disclose an information processing method and system for acquiring a physiological image of a target person via an unmanned aerial vehicle. The method is applied to the information processing system, the information processing system comprises the unmanned aerial vehicle and an analysis device, the unmanned aerial vehicle is provided with an image acquisition device, and the method comprises: the unmanned aerial vehicle acquiring a physiological image of a target person via the image acquisition device thereon; the unmanned aerial vehicle sending the physiological image to the analysis device; the analysis device extracting physiological feature information of the physiological image; and the analysis device analyzing physiological information of the target person according to the physiological feature information. The physiological image of the target person can be acquired via the image acquisition device of the unmanned aerial vehicle, and the analysis device can automatically recognize the physiological information of the target person after acquiring the physiological image.
Description
Technical Field
The present invention relates to the field of information processing, and in particular, to an information processing method and system.
Background
Because of the restraint that unmanned aerial vehicle received is little, its mobility can be excellent, and more users use unmanned aerial vehicle to take photo by plane and image acquisition.
However, the user simply acquires the image or video information through the drone, and the image acquisition function of the drone cannot be utilized more fully.
Disclosure of Invention
The embodiment of the invention provides an information processing method and an information processing system, which are used for acquiring a physiological image of a target person through an unmanned aerial vehicle and automatically identifying the physiological information of the target person.
In order to solve the above technical problem, an embodiment of the present invention provides the following technical solutions:
an information processing method is applied to an information processing system, the information processing system comprises an unmanned aerial vehicle and an analysis device, an image acquisition device is arranged on the unmanned aerial vehicle, and the method comprises the following steps:
the unmanned aerial vehicle acquires a physiological image of a target person through the image acquisition device on the unmanned aerial vehicle;
the unmanned aerial vehicle sends the physiological image to the analysis device;
the analysis device extracts physiological characteristic information of the physiological image;
the analysis device analyzes the physiological information of the target person according to the physiological characteristic information.
In order to solve the above technical problem, an embodiment of the present invention further provides the following technical solutions:
an information processing system comprises an unmanned aerial vehicle and an analysis device, wherein the unmanned aerial vehicle is provided with an image acquisition device and comprises an image acquisition module and a communication module, the analysis device comprises an extraction module and an analysis module,
the image acquisition module is used for acquiring a physiological image of a target person through the image acquisition device on the unmanned aerial vehicle;
the communication module is used for sending the physiological image to the analysis device;
the extraction module is used for extracting physiological characteristic information of the physiological image;
the analysis module is used for analyzing the physiological information of the target person according to the physiological characteristic information.
According to the technical scheme, the embodiment of the invention has the following advantages:
on an information processing system comprising an unmanned aerial vehicle and an analysis device, after the unmanned aerial vehicle acquires a physiological image of a target person through an image acquisition device arranged on the unmanned aerial vehicle, the unmanned aerial vehicle sends the physiological image to the analysis device; the analysis device extracts physiological characteristic information of the physiological image; the analysis device analyzes the physiological information of the target person according to the physiological characteristic information. Through unmanned aerial vehicle's image acquisition device, can acquire the physiology image of target personage, after analytical equipment acquires this physiology image, can discern the physiology information of target personage automatically.
Drawings
Fig. 1 is a schematic hardware configuration diagram of an information processing system according to an embodiment of the present invention;
fig. 2 is a flowchart of an information processing method according to another embodiment of the present invention;
fig. 3 is a flowchart of an information processing method according to another embodiment of the present invention;
fig. 4 is a schematic structural diagram of an information processing system according to another embodiment of the present invention.
Detailed Description
The embodiment of the invention provides an information processing method and an information processing system, which are used for acquiring a physiological image of a target person through an unmanned aerial vehicle and automatically identifying the physiological information of the target person.
Fig. 1 is a schematic diagram of a hardware structure of an information processing system according to an embodiment of the present invention. Referring to fig. 1, the information processing system of the embodiment of the present invention includes a drone 101, an analysis device 102, and a cloud database 103. The unmanned aerial vehicle is provided with an image acquisition device 104 for acquiring images, a communication module 105 for communicating with an analysis device, and a flight control module 106 for controlling the unmanned aerial vehicle to fly. The analysis device is provided with an analysis platform 107 for processing data, a control platform 108 in communication with the drone, and a local database 109. The analysis device 102 may communicate with a cloud database to obtain data stored on the cloud database.
After the unmanned aerial vehicle 101 acquires an image through the image acquisition device 104 thereon, the image may be sent to the control platform 108 of the analysis device 102 through the communication module 105, and the analysis device sends the image from the control platform 108 to the analysis platform 107, so that the analysis platform 107 analyzes the image, for example, the analysis platform 107 acquires a feature template from the local database 109 or the cloud database 103, and the analysis platform 107 matches the extracted feature of the image with the feature template to determine information of the image.
On an information processing system comprising an unmanned aerial vehicle and an analysis device, after the unmanned aerial vehicle acquires a physiological image of a target person through an image acquisition device arranged on the unmanned aerial vehicle, the unmanned aerial vehicle sends the physiological image to the analysis device; the analysis device extracts physiological characteristic information of the physiological image; the analysis device analyzes the physiological information of the target person according to the physiological characteristic information. Through unmanned aerial vehicle's image acquisition device, can acquire the physiology image of target personage, after analytical equipment acquires this physiology image, can discern the physiology information of target personage automatically.
In some embodiments of the present invention, the analysis platform may send some analysis results to the control platform, and the control platform generates related instructions to return to the drone, instructing the drone to perform corresponding operations, such as tracking a target person, initiating an alarm, and the like.
In some embodiments of the present invention, the cloud database or the local database may not be provided, as long as one of them is provided on the information processing system. Of course, in some embodiments, neither the cloud database nor the local database may be provided, and at this time, the information processing apparatus may still recognize some physiological information of the target person.
In some embodiments of the invention, the analysis device may be provided separately from the unmanned aerial vehicle, and in other embodiments, the analysis device may be provided on the unmanned aerial vehicle, and at this time, the unmanned aerial vehicle may not need to be provided with a communication module, and the analysis device may not be provided with a control platform.
In some embodiments of the present invention, the cloud database and the local database may store various information, such as a feature template for matching with image feature information, personal information of a target person, a preset flight trajectory for controlling the drone, and the like. The cloud database can store files with large data capacity, and the local database can store files with small data capacity. The information of the cloud database may be partially overlapped, different, or the same as the information of the local database, which is not specifically limited in this embodiment of the present invention.
Fig. 2 is a flowchart of an information processing method according to an embodiment of the present invention, where the method is applied to an information processing system, where the information processing system includes an unmanned aerial vehicle and an analysis device, and the unmanned aerial vehicle is provided with an image acquisition device, and referring to the above embodiment and the hardware structure embodiment shown in fig. 1, taking an angle of the information processing system executing the method according to the embodiment of the present invention as an example, referring to fig. 2, a flow of the method according to the embodiment of the present invention includes:
step 201: the unmanned aerial vehicle acquires a physiological image of a target person through an image acquisition device on the unmanned aerial vehicle;
step 202: the unmanned aerial vehicle sends a physiological image to the analysis device;
step 203: the analysis device extracts physiological characteristic information of the physiological image;
step 204: the analysis device analyzes the physiological information of the target person according to the physiological characteristic information.
Alternatively,
the analysis device analyzes the physiological information of the target person according to the physiological characteristic information, and comprises the following steps:
the analysis device uses a pre-stored characteristic template to match with the physiological characteristic information;
the analysis device determines the physiological information of the target person according to the characteristic template successfully matched with the physiological characteristic information.
Alternatively,
the physiological image comprises a human body image, and the physiological information comprises at least one of body type and hair style; or,
the physiological image comprises a face image, and the physiological information comprises at least one of age, gender and mask.
Alternatively,
the physiological image includes an image of a human body,
the method further comprises the following steps:
when the unmanned aerial vehicle acquires a human body image of a target person, the unmanned aerial vehicle acquires the current acquisition height of the unmanned aerial vehicle and the acquisition distance between the unmanned aerial vehicle and the target person;
the unmanned aerial vehicle sends the acquisition height and the acquisition distance to the analysis device;
the analysis device analyzes the physiological information of the target person according to the physiological characteristic information, and comprises the following steps:
the analysis device calculates the height of the target person according to the image height, the acquisition height and the acquisition distance of the target person reflected by the physiological characteristic information.
Alternatively,
unmanned aerial vehicle obtains the physiology image of target personage through the image acquisition device on it, includes:
the unmanned aerial vehicle acquires a plurality of human body images of a target person through an image acquisition device on the unmanned aerial vehicle;
the analysis device extracts physiological characteristic information of the physiological image, and comprises the following steps:
the analysis device extracts physiological characteristic information of a plurality of human body images to obtain a plurality of groups of physiological characteristic points reflecting action changes of target characters;
the analysis device uses the pre-stored characteristic template to match with the physiological characteristic information, and comprises the following steps:
the analysis device uses a pre-stored behavior characteristic template to match with a plurality of groups of physiological characteristic points;
the analysis device determines the physiological information of the target person according to the characteristic template successfully matched with the physiological characteristic information, and comprises:
the analysis device determines the behavior information of the target person according to the behavior characteristic template successfully matched with the multiple groups of physiological characteristic information.
Alternatively,
unmanned aerial vehicle obtains the physiology image of target personage through the image acquisition device on it, includes:
the unmanned aerial vehicle acquires a human body image of a target person through an image acquisition device on the unmanned aerial vehicle;
the unmanned aerial vehicle determines a face area according to the human body image;
the unmanned aerial vehicle controls the image acquisition device to focus according to the face area;
the unmanned aerial vehicle acquires the face image of the target person through the image acquisition device which finishes focusing.
Alternatively,
unmanned aerial vehicle obtains the physiology image of target personage through the image acquisition device on it, includes:
the unmanned aerial vehicle acquires physiological images of a plurality of target people in a target crowd through an image acquisition device on the unmanned aerial vehicle;
after the analysis device analyzes the physiological information of the target person according to the physiological characteristic information, the method further comprises the following steps:
the analysis device carries out statistical analysis on the physiological information of a plurality of target persons to obtain the crowd characteristic information of the target persons.
Alternatively,
after the analysis device analyzes the physiological information of the target person according to the physiological characteristic information, the method further comprises the following steps:
when the analysis device detects that the physiological information comprises preset information, the analysis device sends a control instruction to the unmanned aerial vehicle so that the unmanned aerial vehicle can give an alarm or track a target person.
Alternatively,
the image acquisition device comprises a thermal induction camera, a black-and-white camera and a color camera,
unmanned aerial vehicle obtains the physiology image of target personage through the image acquisition device on it, includes:
when the current ambient light intensity is larger than a preset light intensity threshold value, the unmanned aerial vehicle acquires a physiological image of a target person through a black-and-white camera and a color camera on the unmanned aerial vehicle;
when the current ambient light intensity is smaller than a preset light intensity threshold value, the unmanned aerial vehicle acquires a physiological image of a target person through a black-and-white camera and a thermal induction camera on the unmanned aerial vehicle;
when the current ambient light intensity is greater than the preset light intensity threshold value and the physiological image quality set by the information processing system is greater than the preset quality threshold value, the unmanned aerial vehicle acquires the physiological image of the target person through the thermal induction camera, the black-and-white camera and the color camera on the unmanned aerial vehicle.
In summary, in the information processing system including the unmanned aerial vehicle and the analysis device, after the unmanned aerial vehicle acquires the physiological image of the target person through the image acquisition device arranged on the unmanned aerial vehicle, the unmanned aerial vehicle sends the physiological image to the analysis device; the analysis device extracts physiological characteristic information of the physiological image; the analysis device analyzes the physiological information of the target person according to the physiological characteristic information. Through unmanned aerial vehicle's image acquisition device, can acquire the physiology image of target personage, after analytical equipment acquires this physiology image, can discern the physiology information of target personage automatically.
Fig. 3 is a flowchart of an information processing method according to an embodiment of the present invention, where the method is applied to an information processing system, where the information processing system includes an unmanned aerial vehicle and an analysis device, and the unmanned aerial vehicle is provided with an image acquisition device, and referring to the above embodiment and the hardware structure embodiment shown in fig. 1, taking an angle of the information processing system executing the method according to the embodiment of the present invention as an example, referring to fig. 3, a flow of the method according to the embodiment of the present invention includes:
step 301: the unmanned aerial vehicle obtains the physiological image of the target person through the image acquisition device on the unmanned aerial vehicle.
Wherein, the physiological image comprises a human body image and/or a human face image. The unmanned aerial vehicle can obtain the face image and/or the human body image of the target person through the image acquisition device arranged on the unmanned aerial vehicle.
For example, the unmanned aerial vehicle detects or positions a human body in the air, and after the comprehensive image data is acquired through the image acquisition device, the image data is detected to judge whether the human body exists. If the human body exists on the image data, information such as position coordinates of the human body, the size of the human face area and the like is determined so as to extract human body characteristic data and human face characteristic data. That is, after the unmanned aerial vehicle detects the target person through the image acquisition device, the human face image and/or the human body image of the target person can be acquired through the image acquisition device.
Wherein, in order to acquire clear image, the image acquisition device on the unmanned aerial vehicle can be a high-definition human physiological characteristic acquisition device group. The image acquisition device can comprise a thermal induction camera, a black-and-white camera and a color camera, and is used by matching different cameras to acquire high-definition image information.
For example:
when the current ambient light intensity is larger than a preset light intensity threshold value, the unmanned aerial vehicle acquires a physiological image of a target person through a black-and-white camera and a color camera on the unmanned aerial vehicle;
when the current ambient light intensity is smaller than a preset light intensity threshold value, the unmanned aerial vehicle acquires a physiological image of a target person through a black-and-white camera and a thermal induction camera on the unmanned aerial vehicle;
when the current ambient light intensity is greater than the preset light intensity threshold value and the physiological image quality set by the information processing system is greater than the preset quality threshold value, the unmanned aerial vehicle acquires the physiological image of the target person through the thermal induction camera, the black-and-white camera and the color camera on the unmanned aerial vehicle.
For example, in the daytime or in the case of sufficient ambient light, the unmanned aerial vehicle acquires image data through the black-and-white camera and the color camera thereon to detect whether a human body exists in the image data. When the requirement is high, the accuracy can be improved by using the thermal sensing camera under the condition of sufficient light. And evening or when light is darker, then use thermoinduction camera and black and white camera as the main for unmanned aerial vehicle collection image data.
At night, when the light is dark, the unmanned aerial vehicle firstly utilizes the thermal sensing camera to acquire image data, judges whether a human body exists or not, controls the black-and-white camera to be opened at the moment if the image data exists the human body, and opens the auxiliary light source to acquire a near-infrared face image.
When the physiological image comprises a human body image and a human face image, the specific acquisition mode can be that after the unmanned aerial vehicle acquires the human body image of the target person through the image acquisition device on the unmanned aerial vehicle, the unmanned aerial vehicle determines a human face area according to the human body image; therefore, the unmanned aerial vehicle controls the image acquisition device to focus according to the face area, and the unmanned aerial vehicle acquires the face image of the target person through the image acquisition device which finishes focusing. Therefore, the human body image which is easy to detect is obtained firstly, the human face area is analyzed according to the human body image, the focusing of the image acquisition device is carried out, and the clear human face image is obtained.
For example, the unmanned aerial vehicle performs fixed-track patrol in an unopened important area (such as a private villa, a military base, and the like), performs human body feature extraction, human face feature extraction and data analysis on past personnel, and provides the situation of the site and the detected personnel in real time. After a high-definition human body acquisition device group on the unmanned aerial vehicle detects that a human body exists, human body images and human face images of target personnel are acquired in sequence.
Step 302: the unmanned aerial vehicle sends a physiological image to the analysis device;
for example, after the unmanned aerial vehicle acquires a physiological image, the unmanned aerial vehicle sends the physiological image to a control platform of the analysis device through a communication module on the unmanned aerial vehicle, and after the analysis device acquires the physiological image from the control platform, the physiological image can be analyzed through an analysis platform on the analysis device.
In the information processing system of the embodiment of the invention, the unmanned aerial vehicle and the analysis device can be in communication connection, so that a plurality of unmanned aerial vehicles can be configured in the information processing system, and can be in communication connection with one analysis device, so that the analysis device can analyze physiological images sent by the plurality of unmanned aerial vehicles, and the analysis device can also send control instructions to the unmanned aerial vehicle to control the operation of the unmanned aerial vehicle. According to the layout framework, one analysis device serves a plurality of unmanned aerial vehicles, the cost of the information processing system can be reduced, and a user can conveniently control the plurality of unmanned aerial vehicles through the analysis device.
Step 303: the analysis device extracts physiological characteristic information of the physiological image;
after the analysis device acquires the physiological image, the analysis device extracts physiological characteristic information of the physiological image to prepare for analysis of the physiological image.
The physiological characteristic information is information representing physiological characteristics of a person on a physiological image, and the physiological characteristic information can include any combination of face characteristic information, skin color characteristic information, age characteristic information, body type characteristic information, hair style characteristic information and the like of the person. The physiological characteristic information can be expressed in the form of physiological characteristic points, that is, characteristic points reflecting the physiological characteristics of a person can be extracted from the physiological image.
Step 304: the analysis device analyzes the physiological information of the target person according to the physiological characteristic information.
According to the extracted physiological characteristic information, the analysis device can analyze the physiological information of the target person.
When the physiological image comprises a human body image, the physiological information comprises at least one of height, body type, hair style and behavior; when the physiological image includes a face image, the physiological information includes at least one of age, gender, and mask. In some embodiments, physiological information such as skin color and face can be acquired from the human body image and the human face image.
The specific analysis method may be different according to different physiological information. Several examples are given below.
Template matching method
When the physiological image comprises a human body image and the physiological information comprises at least one of body type and hair style; alternatively, when the physiological image includes a face image and the physiological information includes at least one of age, gender, and mask, the template matching method may be used to analyze the physiological information of the target person. Namely, the physiological characteristic information of the physiological image is matched with the characteristic template, and the physiological information of the target person is determined according to the matching result. The specific form of the feature template may be a feature point, an image, and the like, which is not particularly limited in this embodiment of the present invention.
That is, the analysis device analyzes the physiological information of the target person from the physiological characteristic information, and includes: the analysis device uses a pre-stored characteristic template to match with the physiological characteristic information; the analysis device determines the physiological information of the target person according to the characteristic template successfully matched with the physiological characteristic information.
For example, the analysis module extracts physiological feature information of a human face from a human face image according to analysis needs, acquires a pre-established corresponding relationship between a human face feature template and the physiological information from a local database or a cloud database of the analysis device, matches the physiological feature information with the acquired feature template, determines the physiological information corresponding to the feature template successfully matched with the physiological feature information according to the corresponding relationship between the human face feature template and the physiological information if the matching is successful, and uses the determined physiological information as the physiological information of the target person. Or the analysis device sends the extracted human face physiological characteristic information to a cloud database, the cloud database matches a corresponding characteristic template according to the human face physiological characteristic information, corresponding physiological information is determined according to the characteristic template, and the cloud database returns the physiological information to the analysis device.
For example, the analysis device extracts age physiological feature points reflecting the age from the face image according to physiological textures such as wrinkles of the face, then the analysis device matches the age physiological feature points with the age feature templates in the local database according to the age physiological feature points, and if there is an age feature template successfully matched, and the age corresponding to the age feature template successfully matched is middle age or 30 to 45 years, the analysis device can determine that the age of the target person is middle age or 30 to 45 years.
Similarly, the analysis device extracts human body physiological feature information from the human body image according to the analysis requirement, and then analyzes the features such as body type, hair style and the like according to the similar method.
When the physiological information is behavior information, the unmanned aerial vehicle acquires a plurality of human body images of the target person through the image acquisition device on the unmanned aerial vehicle, so that data of the target person are dynamically captured. Therefore, the analysis device extracts physiological characteristic information of a plurality of human body images to obtain a plurality of groups of physiological characteristic points reflecting the action change of the target person; then, the analysis device matches the multiple groups of physiological characteristic points by using a pre-stored behavior characteristic template; the analysis device determines the behavior information of the target person according to the behavior characteristic template successfully matched with the multiple groups of physiological characteristic information.
And storing various behavior characteristic templates in a cloud database or a local database, matching the behavior characteristic templates with the multiple groups of physiological characteristic information, and if the matching is successful, determining behavior information corresponding to the behavior characteristic templates which are successfully matched according to the corresponding relation between the behavior characteristic templates and the behavior information which is established in advance, wherein the behavior information is the behavior information of the target person. The behavior information may be simple behavior information such as whether or not a weapon is held, etc.
Second, calculation method
Some physiological information cannot be obtained through template matching, but can be obtained through data calculation. For example, the height of the target person is calculated.
At the moment, when the unmanned aerial vehicle acquires the human body image of the target person, the unmanned aerial vehicle acquires the current acquisition height of the unmanned aerial vehicle and the acquisition distance between the unmanned aerial vehicle and the target person; then, the unmanned aerial vehicle sends the acquisition height and the acquisition distance to the analysis device, and the analysis device obtains the height of the target person according to the image height, the acquisition height and the acquisition distance of the target person reflected by the physiological characteristic information.
In the process of analyzing the face image, the face can be identified. For example, after the analysis device acquires a face image, the analysis device extracts facial feature information from the face image, matches the facial feature information in the database on the analysis platform, if the facial feature information is already stored in the database, matches the facial feature information extracted from the face image with a facial feature template stored in the face database, and if the matching is successful, calls corresponding personal information from the cloud database or the local database according to the stored facial feature information. So that the staff acquires the personal information of the target person. The information processing system may also mark information such as location coordinates, time, etc. of the presence of the target person.
The method provided by the embodiment of the invention can be used for identifying a target person and also can be used for identifying the physiological characteristics of a target group.
That is, the unmanned aerial vehicle obtains the physiology image of target person through the image acquisition device thereon, includes: the unmanned aerial vehicle acquires physiological images of a plurality of target people in a target crowd through an image acquisition device on the unmanned aerial vehicle;
the method is carried out on the acquired physiological image of each target person, and then the physiological information of a plurality of target persons can be analyzed. Such as the age, sex, behavior, skin color (race), face, etc., of the plurality of target persons.
In order to obtain information in a target group and feed back more data to a user, after the analysis device analyzes physiological information of a target person according to the physiological characteristic information, that is, after the physiological information of a plurality of target persons is analyzed, the method of the embodiment of the invention further comprises the following steps: the analysis device carries out statistical analysis on the physiological information of a plurality of target persons to obtain the crowd characteristic information of the target persons.
Thus, when data is collected according to the physiological image, statistical analysis of the data can be performed while the image data is acquired, for example, a related statistical table is formed on the analysis device, so that a user can collect people stream data at the first time and know the current people stream density and the distribution conditions of age, sex, behavior, skin color (race), face appearance and the like in the people stream in real time. The data collection is performed without the need for human screening analysis of the acquired image data.
For example, in a crowd gathering area, the main control board of the unmanned aerial vehicle calculates the self speed and displacement during flight and the flow speed of the stream of people, and continuously acquires stream of people data in the area corresponding to the camera. The human body images and the human face images of the past people flow are obtained and sent to the analysis device, and the analysis device extracts the human body features, the human face features and data of the images and provides the situations of the site and the detected people to the working personnel in real time. The information processing system can quickly acquire people stream information on a street or a square, such as people stream density, race (skin color) proportion, gender proportion and age proportion. If necessary, the information processing system of the embodiment of the invention can perform face matching analysis while collecting data, which is mostly used for searching people who have recorded templates in a large range of people streams.
It can be understood that, in some embodiments of the present invention, the analysis device may further perform corresponding control operations on the drone. For example, if desired, on the analysis device, the analysis platform sends a portion of the analysis results to the control platform, and the control platform generates relevant instructions back to the drone instructing the drone to perform self-positioning tracking, sound an alarm, or other operations.
That is, in some embodiments, after the analyzing device analyzes the physiological information of the target person according to the physiological characteristic information, the method further includes:
when the analysis device detects that the physiological information comprises preset information, the analysis device sends a control instruction to the unmanned aerial vehicle so that the unmanned aerial vehicle can give an alarm or track a target person.
The preset information may be, for example, the mask of the target person is detected, the target person holds a weapon, the target person is determined to be a suspect of crime according to personal information, the current crowd of the target person is too dense, and the like.
In summary, after the unmanned aerial vehicle acquires a physiological image of a target person, the unmanned aerial vehicle sends the physiological image to the analysis device, and the analysis device analyzes physiological information of the target person according to physiological characteristic information of the physiological image, the information processing system of the embodiment of the invention can also execute two types of operations, including:
1) and (5) early warning operation. That is, the analysis device sends out a warning on the analysis device to perform an early warning function if the analysis device judges that the target person has suspicious or dangerous behavior, the face has suspicious features (such as a mask) or specified features according to behavior information, whether the target person holds a weapon, facial features and the like in the physiological information. The unmanned aerial vehicle can also send an alarm instruction to the unmanned aerial vehicle, and the unmanned aerial vehicle sends an alarm signal.
2) And (5) data summarization operation. That is, the analysis device may form data based on the physiological information, particularly the physiological information of a plurality of target persons of the target group, analyze the data, generate a graph, and feed back the crowd characteristic information of the target group to the user, for example, may display the data analysis result obtained based on the physiological information on a display device in real time.
In summary, in the information processing system including the unmanned aerial vehicle and the analysis device, after the unmanned aerial vehicle acquires the physiological image of the target person through the image acquisition device arranged on the unmanned aerial vehicle, the unmanned aerial vehicle sends the physiological image to the analysis device; the analysis device extracts physiological characteristic information of the physiological image; the analysis device analyzes the physiological information of the target person according to the physiological characteristic information. Through unmanned aerial vehicle's image acquisition device, can acquire the physiology image of target personage, after analytical equipment acquires this physiology image, can discern the physiology information of target personage automatically.
Fig. 4 is a schematic diagram illustrating a structure of an information processing system according to an exemplary embodiment, where the information processing system is configured to execute functions performed by a terminal in any of the embodiments corresponding to fig. 2 to 4, and the structure of the information processing system illustrated in fig. 4 may be integrated with the information processing system illustrated in fig. 1.
Referring to fig. 4, the information processing system includes an unmanned aerial vehicle and an analysis device, the unmanned aerial vehicle is provided with an image acquisition device, the unmanned aerial vehicle includes an image acquisition module 401 and a communication module 402, the analysis device includes an extraction module 403 and an analysis module 404,
the image acquisition module 401 is configured to acquire a physiological image of a target person through an image acquisition device on the unmanned aerial vehicle;
a communication module 402 for sending the physiological image to an analysis device;
an extraction module 403, configured to extract physiological feature information of a physiological image;
and the analyzing module 404 is configured to analyze the physiological information of the target person according to the physiological characteristic information.
Alternatively,
a parsing module 404, comprising:
a matching unit 405, configured to match the physiological characteristic information with a pre-stored characteristic template;
and a determining unit 406, configured to determine the physiological information of the target person according to the feature template successfully matched with the physiological feature information.
Alternatively,
the physiological image comprises a human body image, and the physiological information comprises at least one of body type and hair style; or,
the physiological image comprises a face image, and the physiological information comprises at least one of age, gender and mask.
Alternatively,
the physiological image includes an image of a human body,
the drone further comprises a collected data acquisition module 407,
the acquisition data acquisition module 407 is used for acquiring the current acquisition height of the unmanned aerial vehicle and the acquisition distance between the unmanned aerial vehicle and the target person when the unmanned aerial vehicle acquires the human body image of the target person;
the communication module 402 is further configured to send the acquisition height and the acquisition distance to the analysis apparatus;
the analysis module 404 is further configured to calculate a height of the target person according to the image height, the acquisition height, and the acquisition distance of the target person reflected by the physiological characteristic information.
Alternatively,
the image acquisition module 401 is further configured to acquire a plurality of human body images of the target person through an image acquisition device thereon;
the extracting module 403 is further configured to extract physiological characteristic information of a plurality of human body images to obtain a plurality of sets of physiological characteristic points reflecting motion changes of the target person;
the matching unit 405 is further configured to match the plurality of sets of physiological characteristic points by using a pre-stored behavior characteristic template;
the determining unit 406 is further configured to determine the behavior information of the target person according to the behavior feature template successfully matched with the multiple sets of physiological feature information.
Alternatively,
an image acquisition module 401 comprising:
a human body image obtaining unit 408 for obtaining a human body image of the target person by an image capturing device thereon;
a face region determining unit 409 for determining a face region according to the human body image;
the focusing unit 410 is used for controlling the image acquisition device to focus according to the face area;
a face image obtaining unit 411, configured to obtain a face image of the target person through the image capturing device on which focusing is completed.
Alternatively,
the image acquisition module 401 is further configured to acquire physiological images of a plurality of target persons in the target group through an image acquisition device on the unmanned aerial vehicle;
the analysis device further includes:
the analysis unit 412 is configured to perform statistical analysis on the physiological information of the target persons to obtain the crowd characteristic information of the target crowd.
Alternatively,
the analysis device further includes:
a sending unit 413, configured to send a control instruction to the drone when the analysis device detects that the physiological information includes preset information, so that the drone initiates an alarm or tracks a target person.
Alternatively,
the image acquisition device comprises a thermal induction camera, a black-and-white camera and a color camera,
the image acquisition module 401 is further configured to:
when the current ambient light intensity is larger than a preset light intensity threshold value, acquiring a physiological image of a target person through a black-and-white camera and a color camera on the unmanned aerial vehicle;
when the current ambient light intensity is smaller than a preset light intensity threshold value, acquiring a physiological image of a target person through a black-and-white camera and a thermal induction camera on the unmanned aerial vehicle;
when the current ambient light intensity is larger than a preset light intensity threshold value and the physiological image quality set by the information processing system is larger than a preset quality threshold value, the physiological image of the target person is obtained through the thermal sensing camera, the black-and-white camera and the color camera on the unmanned aerial vehicle.
In summary, in an information processing system including an unmanned aerial vehicle and an analysis device, after an image acquisition module 401 of the unmanned aerial vehicle acquires a physiological image of a target person through an image acquisition device arranged on the unmanned aerial vehicle, a communication module 402 of the unmanned aerial vehicle sends the physiological image to the analysis device; an extraction module 403 of the analysis device extracts physiological characteristic information of the physiological image; the analyzing module 404 of the analyzing apparatus analyzes the physiological information of the target person according to the physiological characteristic information. Through unmanned aerial vehicle's image acquisition device, can acquire the physiology image of target personage, after analytical equipment acquires this physiology image, can discern the physiology information of target personage automatically.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (12)
1. An information processing method is applied to an information processing system, the information processing system comprises an unmanned aerial vehicle and an analysis device, an image acquisition device is arranged on the unmanned aerial vehicle, and the method comprises the following steps:
the unmanned aerial vehicle acquires a physiological image of a target person through the image acquisition device on the unmanned aerial vehicle;
the unmanned aerial vehicle sends the physiological image to the analysis device;
the analysis device extracts physiological characteristic information of the physiological image;
the analysis device analyzes the physiological information of the target person according to the physiological characteristic information.
2. The method of claim 1,
the analysis device analyzes the physiological information of the target person according to the physiological characteristic information, and comprises the following steps:
the analysis device matches the physiological characteristic information by using a pre-stored characteristic template;
and the analysis device determines the physiological information of the target person according to the characteristic template successfully matched with the physiological characteristic information.
3. The method of claim 2,
the physiological image comprises a human body image, and the physiological information comprises at least one of body type and hair style; or,
the physiological image comprises a face image, and the physiological information comprises at least one of age, gender and mask.
4. The method of claim 1,
the physiological image comprises an image of a human body,
the method further comprises the following steps:
when the unmanned aerial vehicle acquires the human body image of the target person, the unmanned aerial vehicle acquires the current acquisition height of the unmanned aerial vehicle and the acquisition distance between the unmanned aerial vehicle and the target person;
the unmanned aerial vehicle sends the acquisition height and the acquisition distance to the analysis device;
the analysis device analyzes the physiological information of the target person according to the physiological characteristic information, and comprises the following steps:
and the analysis device calculates the height of the target person according to the image height of the target person reflected by the physiological characteristic information, the acquisition height and the acquisition distance.
5. The method of claim 2,
the unmanned aerial vehicle is through its the image acquisition device acquires the physiological image of target personage, includes:
the unmanned aerial vehicle acquires a plurality of human body images of a target person through the image acquisition device on the unmanned aerial vehicle;
the analysis device extracts physiological characteristic information of the physiological image, and comprises:
the analysis device extracts physiological characteristic information of the plurality of human body images to obtain a plurality of groups of physiological characteristic points reflecting the action change of the target person;
the analysis device matches the physiological characteristic information by using a pre-stored characteristic template, and comprises the following steps:
the analysis device matches the multiple groups of physiological characteristic points by using a pre-stored behavior characteristic template;
the analysis device determines the physiological information of the target person according to the characteristic template successfully matched with the physiological characteristic information, and the analysis device comprises:
and the analysis device determines the behavior information of the target person according to the behavior characteristic template successfully matched with the multiple sets of physiological characteristic information.
6. The method of claim 1,
the unmanned aerial vehicle is through its the image acquisition device acquires the physiological image of target personage, includes:
the unmanned aerial vehicle acquires a human body image of a target person through the image acquisition device on the unmanned aerial vehicle;
the unmanned aerial vehicle determines a face area according to the human body image;
the unmanned aerial vehicle controls the image acquisition device to focus according to the face area;
and the unmanned aerial vehicle acquires the face image of the target person through the image acquisition device which finishes focusing.
7. The method of claim 1,
the unmanned aerial vehicle is through its the image acquisition device acquires the physiological image of target personage, includes:
the unmanned aerial vehicle acquires physiological images of a plurality of target persons in a target group through the image acquisition device on the unmanned aerial vehicle;
after the analysis device analyzes the physiological information of the target person according to the physiological characteristic information, the method further comprises the following steps:
the analysis device carries out statistical analysis on the physiological information of the target people to obtain the crowd characteristic information of the target people.
8. The method according to any one of claims 1 to 7,
after the analysis device analyzes the physiological information of the target person according to the physiological characteristic information, the method further comprises the following steps:
when the analysis device detects that the physiological information comprises preset information, the analysis device sends a control instruction to the unmanned aerial vehicle so that the unmanned aerial vehicle can give an alarm or track the target person.
9. The method according to any one of claims 1 to 7,
the image acquisition device comprises a thermal induction camera, a black-and-white camera and a color camera,
the unmanned aerial vehicle is through its the image acquisition device acquires the physiological image of target personage, includes:
when the current ambient light intensity is larger than a preset light intensity threshold value, the unmanned aerial vehicle acquires a physiological image of a target person through the black-and-white camera and the color camera on the unmanned aerial vehicle;
when the current ambient light intensity is smaller than a preset light intensity threshold value, the unmanned aerial vehicle acquires a physiological image of the target person through the black-and-white camera and the thermal induction camera on the unmanned aerial vehicle;
when the current ambient light intensity is greater than a preset light intensity threshold value and the physiological image quality set by the information processing system is greater than a preset quality threshold value, the unmanned aerial vehicle acquires the physiological image of the target person through the thermal induction camera, the black-and-white camera and the color camera on the unmanned aerial vehicle.
10. An information processing system is characterized by comprising an unmanned aerial vehicle and an analysis device, wherein the unmanned aerial vehicle is provided with an image acquisition device and comprises an image acquisition module and a communication module, the analysis device comprises an extraction module and an analysis module,
the image acquisition module is used for acquiring a physiological image of a target person through the image acquisition device on the unmanned aerial vehicle;
the communication module is used for sending the physiological image to the analysis device;
the extraction module is used for extracting physiological characteristic information of the physiological image;
the analysis module is used for analyzing the physiological information of the target person according to the physiological characteristic information.
11. The system of claim 10,
the analysis module comprises:
the matching unit is used for matching the physiological characteristic information with a pre-stored characteristic template;
and the determining unit is used for determining the physiological information of the target person according to the characteristic template successfully matched with the physiological characteristic information.
12. The system of claim 11,
the physiological image comprises a human body image, and the physiological information comprises at least one of body type and hair style; or,
the physiological image comprises a face image, and the physiological information comprises at least one of age, gender and mask.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611071095.1A CN106529500A (en) | 2016-11-28 | 2016-11-28 | Information processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611071095.1A CN106529500A (en) | 2016-11-28 | 2016-11-28 | Information processing method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106529500A true CN106529500A (en) | 2017-03-22 |
Family
ID=58353546
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611071095.1A Pending CN106529500A (en) | 2016-11-28 | 2016-11-28 | Information processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106529500A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107844780A (en) * | 2017-11-24 | 2018-03-27 | 中南大学 | A kind of the human health characteristic big data wisdom computational methods and device of fusion ZED visions |
| CN107995435A (en) * | 2017-12-11 | 2018-05-04 | 深圳市北航旭飞科技有限公司 | Unmanned plane image-pickup method, device, computer equipment and readable storage medium storing program for executing |
| US10427786B2 (en) | 2017-09-14 | 2019-10-01 | At&T Intellectual Property I, L.P. | Drone authentication system |
| CN110895709A (en) * | 2018-09-12 | 2020-03-20 | 庄连豪 | Special device, system and implementation method for anti-terrorism service |
| CN113539466A (en) * | 2021-05-31 | 2021-10-22 | 北京海赛医疗科技有限公司 | Detection system |
| CN114140775A (en) * | 2021-11-30 | 2022-03-04 | 上海商汤临港智能科技有限公司 | Data recording and physiological state detection method, device, equipment and storage medium |
| WO2023046191A1 (en) * | 2021-09-27 | 2023-03-30 | 深圳市道通智能航空技术股份有限公司 | Method and apparatus for performing monitoring and tracking by using unmanned aerial vehicle, and device and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101609589A (en) * | 2008-06-17 | 2009-12-23 | 侯荣琴 | Multi-frequency image fire detection system |
| CN204452947U (en) * | 2014-12-21 | 2015-07-08 | 邹耿彪 | A kind of multi-functional unmanned plane |
| CN104794468A (en) * | 2015-05-20 | 2015-07-22 | 成都通甲优博科技有限责任公司 | Human face detection and tracking method based on unmanned aerial vehicle mobile platform |
| CN105138126A (en) * | 2015-08-26 | 2015-12-09 | 小米科技有限责任公司 | Unmanned aerial vehicle shooting control method and device and electronic device |
| CN205139708U (en) * | 2015-10-28 | 2016-04-06 | 上海顺砾智能科技有限公司 | Unmanned aerial vehicle's action discernment remote control device |
| CN105528891A (en) * | 2016-01-13 | 2016-04-27 | 深圳市中盟科技有限公司 | Traffic flow density detection method and system based on unmanned aerial vehicle monitoring |
| CN105912980A (en) * | 2016-03-31 | 2016-08-31 | 深圳奥比中光科技有限公司 | Unmanned plane and unmanned plane system |
| CN105979147A (en) * | 2016-06-22 | 2016-09-28 | 上海顺砾智能科技有限公司 | Intelligent shooting method of unmanned aerial vehicle |
| CN106023251A (en) * | 2016-05-16 | 2016-10-12 | 西安斯凯智能科技有限公司 | Tracking system and tracking method |
| CN106054930A (en) * | 2016-07-11 | 2016-10-26 | 佛山杰致信息科技有限公司 | Unmanned plane having anaesthesia function and remote tracking system |
-
2016
- 2016-11-28 CN CN201611071095.1A patent/CN106529500A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101609589A (en) * | 2008-06-17 | 2009-12-23 | 侯荣琴 | Multi-frequency image fire detection system |
| CN204452947U (en) * | 2014-12-21 | 2015-07-08 | 邹耿彪 | A kind of multi-functional unmanned plane |
| CN104794468A (en) * | 2015-05-20 | 2015-07-22 | 成都通甲优博科技有限责任公司 | Human face detection and tracking method based on unmanned aerial vehicle mobile platform |
| CN105138126A (en) * | 2015-08-26 | 2015-12-09 | 小米科技有限责任公司 | Unmanned aerial vehicle shooting control method and device and electronic device |
| CN205139708U (en) * | 2015-10-28 | 2016-04-06 | 上海顺砾智能科技有限公司 | Unmanned aerial vehicle's action discernment remote control device |
| CN105528891A (en) * | 2016-01-13 | 2016-04-27 | 深圳市中盟科技有限公司 | Traffic flow density detection method and system based on unmanned aerial vehicle monitoring |
| CN105912980A (en) * | 2016-03-31 | 2016-08-31 | 深圳奥比中光科技有限公司 | Unmanned plane and unmanned plane system |
| CN106023251A (en) * | 2016-05-16 | 2016-10-12 | 西安斯凯智能科技有限公司 | Tracking system and tracking method |
| CN105979147A (en) * | 2016-06-22 | 2016-09-28 | 上海顺砾智能科技有限公司 | Intelligent shooting method of unmanned aerial vehicle |
| CN106054930A (en) * | 2016-07-11 | 2016-10-26 | 佛山杰致信息科技有限公司 | Unmanned plane having anaesthesia function and remote tracking system |
Non-Patent Citations (1)
| Title |
|---|
| 王斌 等: "《高校学生 社团建设的理论与实践》", 30 June 2014 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10427786B2 (en) | 2017-09-14 | 2019-10-01 | At&T Intellectual Property I, L.P. | Drone authentication system |
| US11040774B2 (en) | 2017-09-14 | 2021-06-22 | At&T Intellectual Property I, L.P. | Drone authentication system |
| CN107844780A (en) * | 2017-11-24 | 2018-03-27 | 中南大学 | A kind of the human health characteristic big data wisdom computational methods and device of fusion ZED visions |
| CN107995435A (en) * | 2017-12-11 | 2018-05-04 | 深圳市北航旭飞科技有限公司 | Unmanned plane image-pickup method, device, computer equipment and readable storage medium storing program for executing |
| CN110895709A (en) * | 2018-09-12 | 2020-03-20 | 庄连豪 | Special device, system and implementation method for anti-terrorism service |
| CN113539466A (en) * | 2021-05-31 | 2021-10-22 | 北京海赛医疗科技有限公司 | Detection system |
| WO2023046191A1 (en) * | 2021-09-27 | 2023-03-30 | 深圳市道通智能航空技术股份有限公司 | Method and apparatus for performing monitoring and tracking by using unmanned aerial vehicle, and device and storage medium |
| CN114140775A (en) * | 2021-11-30 | 2022-03-04 | 上海商汤临港智能科技有限公司 | Data recording and physiological state detection method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106529500A (en) | Information processing method and system | |
| CN109934176B (en) | Pedestrian recognition system, recognition method, and computer-readable storage medium | |
| US9224037B2 (en) | Apparatus and method for controlling presentation of information toward human object | |
| CN111539338B (en) | Pedestrian mask wearing control method, device, equipment and computer storage medium | |
| US9571726B2 (en) | Generating attention information from photos | |
| CN110688914A (en) | Gesture recognition method, intelligent device, storage medium and electronic device | |
| JP2021514548A (en) | Target object monitoring methods, devices and systems | |
| US20150186708A1 (en) | Biometric identification system | |
| WO2019071664A1 (en) | Human face recognition method and apparatus combined with depth information, and storage medium | |
| CN110073363B (en) | Track an object's head | |
| JP2010244089A (en) | Person detection device, person detection method, and person detection program | |
| CN105872456A (en) | Security protection method and apparatus based on smart television | |
| CN104883548B (en) | Monitor video face captures processing method and its system | |
| CN108875507B (en) | Pedestrian tracking method, apparatus, system, and computer-readable storage medium | |
| KR101640014B1 (en) | Iris recognition apparatus for detecting false face image | |
| CN105022999A (en) | Man code company real-time acquisition system | |
| CN111985348A (en) | Face recognition method and system | |
| CN107451527A (en) | A kind of large-scale public place hunting system based on unmanned plane | |
| CN113630721A (en) | Method and device for generating recommended tour route and computer readable storage medium | |
| US12046075B2 (en) | Information processing apparatus, information processing method, and program | |
| JP7435837B2 (en) | Information processing system, information processing device, information processing method, and program | |
| JP5718632B2 (en) | Part recognition device, part recognition method, and part recognition program | |
| CN111612815A (en) | Infrared thermal imaging behavior intention analysis method and system | |
| CN113449563B (en) | Personnel tracking and marking method, device, electronic device and storage medium | |
| KR102194511B1 (en) | Representative video frame determination system and method using same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170322 |