Disclosure of Invention
In order to overcome the defects in the prior art, the invention provides a method and a system for manufacturing a high-frequency radar ship target time-frequency domain detection data set, which utilize AIS information to generate a preselection labeling frame of a high-frequency radar time-frequency domain, provide reference for constructing the time-frequency domain target detection data set, and support the application of a deep neural network model in high-frequency radar target detection, thereby improving the detection performance of a frequency radar system on the ship target.
According to an aspect of the present disclosure, there is provided a method for producing a time-frequency domain detection data set of a high-frequency radar ship target, including:
According to the received data of the high-frequency radar, obtaining the start-stop time, the radar position and the distance-slow time spectrum of the high-frequency radar data field;
According to the distance-slow time spectrum, calculating to obtain a time spectrum of each distance element;
acquiring ship AIS information in a current starting and stopping time period according to the starting and stopping time of the high-frequency radar data field, calculating distance element and Doppler element information of a ship target according to the ship AIS information and the radar position, and establishing a ship AIS target database;
Reading the distance element and Doppler element information in the ship AIS target database, obtaining a time spectrum according to the distance element of the ship target, and generating a labeling preselection frame by taking the Doppler frequency of the ship target as the center according to the Doppler element of the ship target to obtain a primary screening labeling file;
rechecking the primary screening annotation file to form a secondary screening annotation file;
and processing a suspected target marking frame area which does not contain the preselected marking frame in the time spectrum of the ship target to form a new time spectrum, and deleting the suspected target marking frame which does not contain the preselected marking frame in the secondary screening marking file to obtain the final screening marking file.
As a further technical scheme, the method further comprises the step of storing the final screening annotation file and the corresponding time frequency spectrum to a time frequency domain detection data set of the high-frequency radar ship target.
As a further technical solution, after the distance-slow time spectrum is obtained, the method further includes:
generating a range-doppler spectrum using a fast fourier transform;
According to the distance-Doppler spectrum, combining with a sea clutter first-order Bragg scattering theorem, setting a signal-to-noise ratio threshold value, and calculating the Doppler range of the sea clutter first-order spectrum;
and according to the distance-Doppler spectrum, combining the ground clutter stationary characteristic to obtain a ground clutter Doppler range.
As a further technical solution, according to the ship AIS information and the radar position, the distance element and the doppler element information of the ship target are calculated, including:
According to the radar position and the ship target position, calculating to obtain the radial distance of the ship target, and calculating to obtain the distance element of the ship target according to the radial distance;
and calculating the radial speed of the ship target according to the radar position, the navigational speed and the navigational direction of the ship target, and calculating Doppler elements of the ship target according to the radial speed.
As a further technical scheme, the generation of the primary screening annotation file comprises the following steps:
reading distance element and Doppler element information of a ship target from an established ship AIS target database;
according to the distance element of the ship target, reading a time spectrum corresponding to the distance element;
and generating a ship target detection preselection annotation frame according to the Doppler element of the ship target, setting the category attribute of the preselection annotation frame, and storing the information of the preselection annotation frame into a primary screening annotation file.
As a further technical solution, rechecking the primary screening annotation file includes:
Judging whether a ship target time-frequency ridge exists in a preselected marking frame of the time spectrum, and if so, adjusting the size of the marking frame to enable all ship target time-frequency ridge lines to fall into the marking frame;
Judging whether a suspected target time-frequency ridge which does not contain a preselected label frame exists in the time frequency spectrum, if so, generating a target label frame and setting category attributes.
As a further technical scheme, after the secondary screening annotation file is obtained, the method further comprises the following steps:
setting 0 for a region with a non-ship marking frame category in the time spectrum to obtain a new time spectrum;
deleting the annotation frame with the annotation frame category of non-ship to obtain the final screening annotation file.
According to an aspect of the present invention, there is provided a high-frequency radar ship target time-frequency domain detection data set creation system including:
the first calculation module is used for obtaining the start-stop time, the radar position and the distance-slow time spectrum of the high-frequency radar data field according to the high-frequency radar receiving data;
The second calculation module is used for calculating the time spectrum of each distance element according to the distance-slow time spectrum;
the third calculation module is used for obtaining ship AIS information in the current starting and stopping time period according to the starting and stopping time of the high-frequency radar data field, calculating to obtain distance element and Doppler element information of a ship target according to the ship AIS information and the radar position, and establishing a ship AIS target database;
the first screening module is used for reading the distance element and Doppler element information in the ship AIS target database, obtaining a time spectrum according to the distance element of the ship target, and generating a marking preselection frame by taking the Doppler frequency of the ship target as the center according to the Doppler element of the ship target to obtain a primary screening marking file;
The second screening module is used for rechecking the primary screening annotation file to form a secondary screening annotation file;
And the third screening module is used for processing the suspected target marking frame area which does not contain the preselected marking frame in the time spectrum of the ship target to form a new time spectrum, and deleting the suspected target marking frame which does not contain the preselected marking frame in the secondary screening marking file to obtain the final screening marking file.
According to an aspect of the specification, the electronic device comprises at least one processor, at least one memory and a communication interface, wherein the processor, the memory and the communication interface are communicated with each other, the memory stores program instructions executed by the processor, and the processor calls the program instructions to execute the method.
According to an aspect of the present description, there is provided a non-transitory computer-readable storage medium storing computer instructions that cause the computer to perform the method.
Compared with the prior art, the invention has the beneficial effects that:
According to the method, firstly, AIS information is utilized to generate a preselected labeling frame for labeling the time-frequency ridge line of the high-frequency radar ship, and then, the time-frequency ridge of the ship target is rechecked by combining with manual experience, so that a high-frequency radar time-frequency target detection data set is constructed. The method designed by the invention has high accuracy, can improve the accuracy of target time-frequency ridge line marking by taking AIS information as a reference because a large amount of noise and interference exist in the time spectrum of the high-frequency radar echo, is convenient to operate, can reduce the workload of artificial marking according to a preselected marking frame generated by the AIS information, and provides powerful support for generating a high-quality high-frequency radar time-frequency target detection data set.
Detailed Description
It should be noted that:
The ship automatic identification system AIS (Automatic Identification System) can provide information such as a ship water Mobile communication service identification code MMSI (Maritime Mobile SERVICE IDENTITY), a position, a navigational speed, a course and the like, and is widely used as a reference mark in detecting the target detection performance of a radar system, so that the system can provide a basis for labeling the target detection of a high-frequency radar time-frequency domain. Based on the method, the AIS information-assisted high-frequency radar ship target time-frequency domain detection data set manufacturing method is designed, manual labeling labor and time cost can be reduced while labeling references are provided, the target labeling of the high-frequency radar time-frequency domain is facilitated, and powerful support is provided for manufacturing the high-frequency radar ship target time-frequency domain detection data set.
The terms "comprises" and "comprising," along with any variations thereof, in the description and claims of the invention and in the foregoing drawings, are intended to cover non-exclusive inclusion, such as a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements that are expressly listed or inherent to such process, method, article, or apparatus.
The block diagrams depicted in the figures are merely functional entities and do not necessarily correspond to physically separate entities. That is, the functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices. The flow diagrams depicted in the figures are exemplary only, and do not necessarily include all of the elements and operations/steps, nor must they be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the order of actual execution may be changed according to actual situations.
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention. In addition, the technical features of each embodiment or the single embodiment provided by the invention are combined with each other at will to form a new technical scheme, and the combination is not limited by the sequence of steps and/or the structural composition mode, but is necessarily based on the fact that the technical scheme can be realized by one of ordinary skill in the art, and when the technical scheme combination is contradictory or can not be realized, the technical scheme combination is considered to be absent and is not within the protection scope of the invention claimed.
The embodiment of the invention provides a method for manufacturing a high-frequency radar ship target time-frequency domain detection data set, which is shown in fig. 1 and comprises the following steps:
and step 1, obtaining the start-stop time, the radar position and the distance-slow time spectrum of the high-frequency radar data field according to the high-frequency radar receiving data.
Preferably, the distance-slow time spectrum is defined asThe dimension is as followsDimension(s), whereinIs the distance element to be observed at maximum,Is the frequency sweep cycle number, in the embodiment,。
And 2, calculating the time spectrum of each distance element according to the distance-slow time spectrum.
The method comprises the steps of (1) obtaining a range-slow time spectrum of each range element, firstly utilizing a multiple synchronous extrusion algorithm to generate a time spectrum of each range element, secondly utilizing fast Fourier transformation to generate a range-Doppler spectrum, thirdly, setting a signal-to-noise ratio threshold according to a sea clutter first-order Bragg scattering theorem based on the generated range-Doppler spectrum to calculate a Doppler range of a sea clutter first-order spectrum region, and finally obtaining a ground clutter Doppler range according to ground clutter static characteristics.
Further, after the Doppler range of the sea clutter first-order spectrum region and the ground clutter is obtained, 0 is set for the sea clutter first-order spectrum region and the ground clutter region of the time spectrum.
In the method according to the embodiment of the present invention, the time spectrum is defined asWhereinIs thatThe dimensions of the dimensions,Is the number of time-spectrum time-dimensional sampling points,Is the number of time-spectrum doppler frequency dimension samples,Representing the sequence number of the element of the observation distance,N is the maximum distance element to be observed, which, in embodiments,。
Preferably, the signal to noise ratio threshold described in step 2 is located as。
And 3, obtaining ship AIS information in the current starting and stopping time period according to the starting and stopping time of the high-frequency radar data field, calculating to obtain distance element and Doppler element information of a ship target according to the ship AIS information and the radar position, and establishing a ship AIS target database.
Preferably, according to the starting and ending time of the high-frequency radar data field obtained in the step 1, AIS data in the starting and ending time period are read, wherein the AIS data comprise MMSI, navigational speed, position, heading and other information of the ship.
Further, the building of the ship AIS target database provided by the embodiment of the invention comprises the following steps:
calculating to obtain the radial distance of the ship target according to the radar position obtained in the step 1 and the ship target position obtained based on the ship AIS information;
obtaining radial speed information of the ship target according to the radar position and the navigational speed and the navigational direction of the ship target obtained based on the ship AIS information in the step 1;
according to the radial distance and the radial speed of the ship target, respectively calculating the distance element and Doppler element information of the ship target;
And storing MMSI of the ship target, the target distance element and the target Doppler metadata into an AIS target information database.
It should be noted that, during a radar data field start-stop time period, AIS signals of a plurality of ships may be included. And respectively processing AIS signals of the plurality of ships to obtain distance element and Doppler element information of the plurality of ship targets, and storing the distance element and Doppler element information into a ship AIS target database.
And 4, reading the distance element and Doppler element information in the ship AIS target database, obtaining a time spectrum according to the distance element of the ship target, and generating a labeling preselection frame by taking the Doppler frequency of the ship target as the center according to the Doppler element of the ship target to obtain a primary screening labeling file.
Preferably, according to the AIS target information database obtained in the step 3, the distance meta information and Doppler meta information of the ship AIS are read one by one.
Further, according to the target distance meta information, reading the time spectrum corresponding to the target distance element obtained in the step 2, then according to the target Doppler information, taking the target Doppler as a center, generating a target detection pre-selection annotation frame, setting the annotation frame category attribute as 'vessel', as shown in fig. 3, and storing the pre-selection annotation frame information to the primary screening annotation file.
As a preferred embodiment, the pre-selected annotation frame size generated in step 4 isWhere L is the number of time-spectral time-dimensional sampling points,Is the number of doppler maxima of the target, which, in embodiments,。
And step 5, rechecking the primary screening annotation file to form a secondary screening annotation file.
Preferably, according to the time spectrum obtained in the step 2 and the primary screening annotation file in the step 4, firstly observing whether a ship echo time-frequency ridge exists in a preselection annotation frame in the time spectrum, if a target time-frequency ridge exists in the preselection frame, adjusting the size of the annotation frame so that the target time-frequency ridge completely falls into the annotation frame, if no target time-frequency ridge exists in the preselection frame, deleting the preselection annotation frame, then observing whether other suspected target time-frequency ridges which do not contain the preselection annotation frame exist in the frequency spectrum, if so, manually generating a target annotation frame, setting the annotation frame type as clear, as shown in fig. 4, and finally storing the annotation frame type to the secondary screening annotation file.
And 6, processing a suspected target labeling frame area which does not contain the preselected labeling frame in the time spectrum of the ship target to form a new time spectrum, and deleting the suspected target labeling frame which does not contain the preselected labeling frame in the secondary screening labeling to obtain a final screening labeling file. A suspected object that does not contain a preselected frame of label may be understood as a suspected object that resembles a time-frequency ridge of a ship object but does not contain AIS information.
Preferably, according to the secondary screening annotation file obtained in the step 5 and the Doppler range of the sea clutter first-order spectrum region and the ground clutter obtained in the step 2, firstly, setting 0 for a region with the class of the annotation frame being clear in the time spectrum, secondly, setting 0 for the time spectrum sea clutter first-order spectrum region and the ground clutter region, and storing the time spectrum of the operation of setting 0 as a preprocessed time spectrum, secondly, deleting the annotation frame with the class of clear, and finally storing the new annotation file to the final screening annotation file.
As an preferred embodiment, the method for manufacturing the time-frequency domain detection data set of the high-frequency radar ship target provided by the embodiment of the invention further includes:
And 7, judging whether the labeling file contains a target labeling frame (i.e. a labeling frame with a class of 'vessel') according to the final screening labeling file and the preprocessed time spectrum obtained in the step 6, if so, storing the final labeling file and the preprocessed time spectrum corresponding to the final labeling file into a data set, otherwise, deleting the final labeling file and the preprocessed time spectrum corresponding to the final labeling file.
The implementation basis of the embodiments of the present invention is realized by a device with a processor function to perform programmed processing. Therefore, in engineering practice, the technical solutions and the functions of the embodiments of the present invention are packaged into various modules. Based on this actual situation, on the basis of the above embodiments, an embodiment of the present invention provides a high-frequency radar ship target time-frequency domain detection data set creation system for executing a high-frequency radar ship target time-frequency domain detection data set creation method in the above method embodiment.
Referring to fig. 2, the system comprises a first calculation module, a second calculation module, a third calculation module and a third screening module, wherein the first calculation module is used for obtaining the starting and stopping time of high-frequency radar data, the radar position and the distance-slow time spectrum according to the high-frequency radar receiving data, the second calculation module is used for calculating the time spectrum of each distance element according to the distance-slow time spectrum, the third calculation module is used for obtaining ship AIS information in the current starting and stopping time period according to the starting and stopping time of the high-frequency radar data, the distance element and the Doppler element information of a ship target are calculated according to the ship AIS information and combined with the radar position, a ship AIS target database is established, the first screening module is used for reading the distance element and the Doppler element information in the ship AIS target database, obtaining the time spectrum according to the distance element of the ship target, generating a label preselecting frame with the Doppler frequency of the ship target as the center, the second screening module is used for checking the primary screening label file to form a secondary screening file, the third screening module is used for carrying out a new label-containing the label-containing frame of the ship target, and deleting the label-containing the pre-selected frame in the pre-selected frame is used for obtaining a final label-selected label frame.
According to the high-frequency radar ship target time-frequency domain detection data set manufacturing system provided by the embodiment of the invention, aiming at the problem that a high-frequency radar cannot perform target imaging and a target ridge line is required to be marked when the high-frequency radar cannot perform target imaging, the time-frequency ridge line is required to be determined to belong to a ship target and a large amount of manpower and time are required to be spent for manual marking, a plurality of modules in FIG. 2 are adopted, a preselection marking frame of the high-frequency radar time-frequency domain is generated by utilizing AIS information, reference is provided for constructing the target detection data set of the time-frequency domain, and the application of a deep neural network model in high-frequency radar target detection is supported, so that the detection performance of the high-frequency radar system on the ship target is improved.
It should be noted that, in addition to the method used for implementing the above method embodiment, the system embodiment provided by the present invention is also used for implementing the method in other method embodiments provided by the present invention, where the difference is merely that corresponding functional modules are provided, and the principle is basically the same as that of the above system embodiment provided by the present invention, so long as those skilled in the art obtain corresponding technical means by combining technical features with reference to specific technical solutions in other method embodiments on the basis of the above system embodiment, and the technical solutions formed by these technical means, and on the premise that the technical solutions are ensured to have practicability, the equipment in the above system embodiment is modified to obtain corresponding system class embodiments, and the method in other method class embodiments is implemented. For example:
Based on the foregoing content of the system embodiment, as a preferred embodiment, the system for producing a time-frequency domain detection dataset of a high-frequency radar ship target provided in the embodiment of the present invention further includes:
And the storage module is used for storing the final screening marking file and the corresponding time frequency spectrum to the time frequency domain detection data set of the high-frequency radar ship target.
Based on the foregoing content of the system embodiment, as a preferred embodiment, in the system for producing a time-frequency domain detection dataset of a high-frequency radar ship target provided in the embodiment of the present invention, the second calculation module is further configured to execute the following instructions:
generating a range-doppler spectrum using a fast fourier transform;
According to the distance-Doppler spectrum, combining with a sea clutter first-order Bragg scattering theorem, setting a signal-to-noise ratio threshold value, and calculating the Doppler range of the sea clutter first-order spectrum;
and according to the distance-Doppler spectrum, combining the ground clutter stationary characteristic to obtain a ground clutter Doppler range.
Further, after the Doppler range of the sea clutter first-order spectrum region and the ground clutter is obtained, 0 is set for the sea clutter first-order spectrum region and the ground clutter region of the time spectrum.
Based on the foregoing content of the system embodiment, as a preferred embodiment, in the system for producing a time-frequency domain detection dataset of a high-frequency radar ship target provided in the embodiment of the present invention, the third calculation module is further configured to execute the following instructions:
According to the radar position and the ship target position, calculating to obtain the radial distance of the ship target, and calculating to obtain the distance element of the ship target according to the radial distance;
and calculating the radial speed of the ship target according to the radar position, the navigational speed and the navigational direction of the ship target, and calculating Doppler elements of the ship target according to the radial speed.
Based on the foregoing content of the system embodiment, as a preferred embodiment, in the system for producing a time-frequency domain detection dataset of a high-frequency radar ship target provided in the embodiment of the present invention, the first screening module is further configured to execute the following instructions:
reading distance element and Doppler element information of a ship target from an established ship AIS target database;
according to the distance element of the ship target, reading a time spectrum corresponding to the distance element;
and generating a ship target detection preselection annotation frame according to the Doppler element of the ship target, setting the category attribute of the preselection annotation frame, and storing the information of the preselection annotation frame into a primary screening annotation file.
Based on the foregoing content of the system embodiment, as a preferred embodiment, in the system for producing a time-frequency domain detection dataset of a high-frequency radar ship target provided in the embodiment of the present invention, the second screening module is further configured to execute the following instructions:
Judging whether a ship target time-frequency ridge exists in a preselected marking frame of the time spectrum, and if so, adjusting the size of the marking frame to enable all ship target time-frequency ridge lines to fall into the marking frame;
Judging whether a suspected target time-frequency ridge which does not contain a preselected label frame exists in the time frequency spectrum, if so, generating a target label frame and setting category attributes.
Based on the foregoing content of the system embodiment, as a preferred embodiment, in the system for manufacturing a time-frequency domain detection dataset of a high-frequency radar ship target provided in the embodiment of the present invention, the third screening module is further configured to execute the following instructions:
setting 0 for a region with a non-ship marking frame category in the time spectrum to obtain a new time spectrum;
deleting the annotation frame with the annotation frame category of non-ship to obtain the final screening annotation file.
The method of the embodiment of the invention is realized by the electronic equipment, so that the related electronic equipment is necessary to be introduced. To this end, an embodiment of the present invention provides an electronic device, as shown in FIG. 5, comprising at least one processor (processor), a communication interface (Communications Interface), at least one memory (memory), and a communication bus, wherein the at least one processor, the communication interface, and the at least one memory communicate with each other via the communication bus. The at least one processor invokes the logic instructions in the at least one memory to perform all or part of the steps of the methods provided by the various method embodiments described above.
Further, the logic instructions in the at least one memory described above are implemented in the form of software functional units and stored in a computer-readable storage medium when sold or used as a stand-alone product. Based on this understanding, the technical solution of the present invention is essentially or what contributes to the prior art or that part of the technical solution is embodied in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (being a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. The storage medium includes a U disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk or an optical disk, and various media for storing program codes.
The system embodiments described above are merely illustrative, wherein the elements illustrated as separate elements are or are not physically separated, and the elements shown as elements are or are not physical elements, are located in one place, or are also distributed over a plurality of network elements. The purpose of the embodiment is achieved by actually selecting some or all of the modules. Those of ordinary skill in the art will understand and implement the invention without undue burden.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
According to the method, starting and stopping time, radar position and distance-slow time spectrum of field data are obtained according to high-frequency radar receiving data, distance-Doppler spectrum and time spectrum of each distance element are obtained according to distance-slow time spectrum calculation, doppler ranges of first-order spectrum and ground clutter are obtained according to distance-Doppler spectrum calculation, ship AIS information is obtained according to the starting and stopping time of the high-frequency radar data, radial distance and radial speed of an AIS ship target are calculated, target distance elements and target Doppler frequency are obtained through calculation, an AIS target database is built, a labeling preselect frame is generated at the time spectrum of the corresponding distance elements by taking the target Doppler as the center according to AIS target database information of the AIS ship, a target labeling file is stored, and target labeling is completed in a manual review mode according to the target time spectrum and the target labeling file, so that a time-frequency domain detection data set of the high-frequency radar ship target is manufactured. The method can reduce the manpower and time cost of manual marking on the premise of ensuring the accuracy of marking the target.
It should be noted that the above-mentioned embodiments are merely for illustrating the technical solution of the present invention, and not for limiting the same, and although the present invention has been described in detail with reference to the above-mentioned embodiments, it should be understood by those skilled in the art that the technical solution described in the above-mentioned embodiments may be modified or some or all of the technical features may be equivalently replaced, and these modifications or substitutions do not deviate from the essence of the corresponding technical solution from the technical solution of the embodiment of the present invention.