KR101466374B1 - Integrated monitoring and controlling system and method including privacy protecion and interest emphasis function - Google Patents

Abstract

Discloses an integrated control system and method having privacy protection and attention highlighting function. The present invention relates to a system comprising a plurality of field systems, each having at least one camera, for transmitting monitoring information comprising an image photographed by the at least one camera, and for receiving and storing the monitoring information from the plurality of field systems, The method according to claim 1, further comprising the steps of: combining the plurality of monitoring information to generate an integrated integrated image; analyzing the integrated image to generate at least one event of a preset privacy protection event or an attention enhancement event; And a control center system that performs a corresponding editing operation and outputs the same.

Description

[0001] INTEGRATED MONITORING AND CONTROLLING SYSTEM AND METHOD INCLUDING PRIVACY PROTECTION AND INTEREST EMPHASIS FUNCTION [0002]

The present invention relates to integrated control systems, and more particularly, to integrated control systems and methods having privacy protection and attention enhancement functions at low cost.

As demand for social safety nets has increased, surveillance cameras have been installed in various places such as roads and buildings. In many cases, one or two surveillance cameras have been used in many cases. Therefore, most of the surveillance camera images are simply stored or transmitted to a monitoring device or a monitoring device as they are. However, in recent years, the integrated control system that can simultaneously operate a plurality of surveillance cameras has been frequently used. This is because it is increasingly necessary for a small number of surveillance personnel to monitor various places at the same time for various purposes such as traffic situation analysis, security and crime prevention of high-rise buildings.

When operating the integrated control system, the monitoring personnel must watch multiple images transmitted simultaneously from multiple surveillance cameras. When the monitoring staff confirms the plurality of images, the concentration of the monitoring staff decreases more rapidly with time than when only one image is checked. This deterioration of the concentration causes the monitoring personnel to be unaware of the main situation to be confirmed by the image, which may cause the use of the integrated control system to fade.

Meanwhile, as surveillance cameras are being installed in various places, people are increasingly being photographed by surveillance cameras. In other words, the problem of infringing the personal privacy of the integrated control system frequently occurs. Particularly, unauthorized or unauthorized monitoring personnel in the integrated control system use a detection camera to detect a specific area (for example, a privacy zone such as a house), a specific content (for example, a face of a person having a portrait right) And behavior (personal behavior in which privacy is protected) may be intentionally observed.

In order to prevent such privacy invasion, a privacy protection technology has conventionally been adopted in which blind processing is separately performed for each image transmitted from a plurality of surveillance cameras to output to a monitoring device of the integrated surveillance system. However, A plurality of computers or a high-performance computer for performing image analysis and image processing are required, and the introduction cost is greatly increased. Therefore, there is a problem that the spread of the privacy protection technology is delayed due to an excessive increase in the introduction cost.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an integrated control system having privacy protection and attention enhancement functions that are highly portable and low cost.

Another object of the present invention is to provide an integrated control method having privacy protection and attention highlighting function.

According to an aspect of the present invention, there is provided an integrated control system including at least one camera, a plurality of field systems for transmitting surveillance information including images photographed by the at least one camera, And receiving and storing the monitoring information from the plurality of field systems, integrating the plurality of monitoring information to generate an integrated image, analyzing the integrated image, and analyzing the at least one of the preset privacy- And a control center system for performing an editing operation corresponding to an event generated for the integrated image and outputting the edited operation when one event occurs.

Wherein the control center system comprises: a communication unit for receiving the monitoring information from each of the plurality of field systems; A monitoring information storage unit for storing the plurality of monitoring information and the integrated image; A monitoring information integration unit for dividing the plurality of monitoring information into at least one group including a plurality of monitoring information, and integrating a plurality of monitoring information divided into at least one group to generate at least one integrated image; An integrated image analyzing unit analyzing each of the at least one integrated image to determine whether the privacy protection event or the monitoring information in which the attention enhancement event occurs is present in each of the at least one integrated image; An interest highlighting unit for performing predetermined interest highlight editing on a region of interest highlighted in the integrated image if it is determined that the monitoring information in which the attention highlighting event occurs is present in the integrated image; A privacy protection editor for performing privacy protection editing on a privacy protection area in the integrated image if it is determined that the monitoring information in which the privacy protection event occurs is present in the integrated image; And a user interface for outputting an edited image in which the attention highlight editing and privacy protection editing are performed according to whether the at least one event is generated or not, and receiving a user command.

 Wherein the monitoring information integration unit selects monitoring information to be included in the integrated image among the plurality of monitoring information in response to the integrated image setting and determines a position and size of the selected monitoring information to be placed in the integrated image.

The monitoring information integrating unit adjusts the size and resolution of each of the selected monitoring information in consideration of the size and resolution of the integrated image, and then integrates the combined image to generate the integrated image.

The monitoring information integrating unit integrates the selected monitoring information to generate the integrated image and then adjusts the size and resolution of the integrated image to a predetermined size and resolution.

And the attention emphasis editing unit performs the attention emphasis editing in a region where at least one monitoring information generated by the attention emphasis event is arranged in the integrated image.

The privacy protection editor compares the monitoring authority of the monitoring agent authenticated through the user interface and determines whether to perform the privacy protection editing according to the monitored authority.

And the privacy protection editing unit performs the privacy protection editing in an area where at least one monitoring information generated by the privacy protection event is arranged in the integrated image.

Wherein the control center system controls each of the plurality of field systems in response to the field control command if the user command is a field control command for controlling the plurality of field control systems; And a display control unit for receiving the screen control command through the user interface and generating the integrated image setting for specifying the number, arrangement position and size of the monitoring information to be included in the integrated image according to the received screen control command, And a monitoring screen control unit for transmitting the monitoring screen.

Wherein the monitoring screen control unit monitors the monitoring information selected from the plurality of monitoring information stored in the monitoring information storage unit, if the user command applied through the user interface is a monitoring command for an individual image of the plurality of monitoring information, To be output to the control unit.

 Wherein each of the attention emphasis editing part and the privacy protection editing part performs attention emphasis editing and privacy protection editing on the selected monitoring information if the user command is a monitoring command for the individual image.

Wherein the supervisory information storage unit stores the plurality of supervisory information and the original of the integrated image in which the attention emphasis editing or the privacy protection editing has not been performed by the attention emphasis editing unit and the privacy protection editing unit.

Wherein the event highlighting control unit obtains event detail information on the attention highlight event through the attention highlight editing and if the event detail information can not be obtained even by the attention highlight edit, To the control unit.

According to an aspect of the present invention, there is provided an integrated control method using an integrated control system including a plurality of on-site systems and a control center system each having at least one camera, Receiving and storing monitoring information from each of the plurality of field systems; Wherein the control center system divides the plurality of monitoring information into at least one group including a plurality of monitoring information and integrates a plurality of monitoring information divided into at least one group to generate at least one integrated image ; The control center system analyzes each of the at least one integrated image to determine whether the privacy protection event or the monitoring information in which the attention enhancement event occurs is present in each of the at least one integrated image; Performing predetermined attention highlight editing on a region of interest highlighted in the integrated image if the control center system determines that supervisory information on which the attention highlight event occurs is present in the integrated image; Performing a privacy editing process for the privacy protection area in the integrated image if the control center system determines that the monitoring information in which the privacy protection event occurs is present in the integrated image; And outputting an edited image in which the attention emphasis editing and the privacy protection editing are performed according to whether the control center system has generated the at least one event.

The integrated control method may include setting whether to activate interest editing, privacy editing, activating a privacy interest highlighting event, a privacy protection event, setting an authority of a monitoring agent, prior to the step of receiving the monitoring information, A system initialization step of setting the position and size of the sensing information included in the integrated image; And controlling the field system in response to a user command after outputting the edited image.

The generating of the at least one integrated image may include adjusting the size and resolution of each of the selected monitoring information in consideration of a predetermined size and resolution of the integrated image, and then combining the selected monitoring information to generate the integrated image.

The generating the at least one integrated image may include combining the selected monitoring information to generate the integrated image, and then adjusting the size and resolution of the integrated image to a predetermined size and resolution.

The integrated control method may further include outputting selected monitoring information among the plurality of monitoring information stored in the monitoring information storage unit when an individual image monitoring command for the plurality of monitoring information is applied.

Wherein the step of outputting the selected monitoring information includes performing interest highlight editing and privacy editing on the selected monitoring information; And outputting edited monitoring information in which attention highlight editing and the privacy protection editing are performed.

The integrated control method preserves an original of the plurality of monitoring information transmitted and stored in each of the plurality of field systems, and performs the attention highlight editing and the privacy protection editing only on the edited image to be output.

Accordingly, the integrated control system and method having privacy protection and attention enhancement functions at low cost of the present invention can be realized by grouping images transmitted from a plurality of surveillance cameras into an integrated image, performing image analysis and image processing on the integrated image By applying the attention emphasis function and the privacy protection function, a specific area is emphasized or blind processed on the integrated screen. Therefore, since each image is processed separately and processed for an integrated image, only one image per group is processed, so that the computing cost for image processing can be greatly reduced. Therefore, the spread of privacy protection technology can be expanded. In addition, since an integrated screen is generated by using images obtained from each of a plurality of surveillance cameras, and post-processing technology for applying attention enhancement and privacy protection is used, regardless of the device or method for acquiring and transmitting images, The portability and the flowability of the integrated control system that integrates and operates the system can be greatly increased. In addition, this attention and privacy protection function can be applied to smart TVs, computers, and various smart devices in addition to the integrated control center, thereby realizing technologies such as child protection image editing and the like at low cost.

1 is a view for explaining a concept of an integrated control system according to an embodiment of the present invention.
Fig. 2 shows an example configuration of the field system of Fig.
Fig. 3 shows an example of the configuration of the control center system of Fig.
4 shows an example of an integrated image according to the present invention.
FIG. 5 shows an integrated control method having privacy protection and attention enhancement functions according to an embodiment of the present invention.
FIG. 6 is a detailed view of the integrated image generation step of FIG.
FIG. 7 is a detailed view of the integrated image output step of FIG.

In order to fully understand the present invention, operational advantages of the present invention, and objects achieved by the practice of the present invention, reference should be made to the accompanying drawings and the accompanying drawings which illustrate preferred embodiments of the present invention.

Hereinafter, the present invention will be described in detail with reference to the preferred embodiments of the present invention with reference to the accompanying drawings. However, the present invention can be implemented in various different forms, and is not limited to the embodiments described. In order to clearly describe the present invention, parts that are not related to the description are omitted, and the same reference numerals in the drawings denote the same members.

Throughout the specification, when an element is referred to as " including " an element, it does not exclude other elements unless specifically stated to the contrary. The terms "part", "unit", "module", "block", and the like described in the specification mean units for processing at least one function or operation, And a combination of software.

1 is a view for explaining a concept of an integrated control system according to an embodiment of the present invention.

1 shows a road traffic control system as an example of the integrated control system. In the road traffic control system of FIG. 1, a plurality of field systems 100 installed in each monitoring area and a plurality of monitoring systems provided by the field system 100 are received, And an integrated center system 200 for monitoring the system.

In particular, in the present invention, the integration center system 200 groups a plurality of surveillance images into at least one group, and converts the surveillance images included in each group into one integrated image. And we apply image processing and masking technique to apply attention enhancement function and privacy protection function to at least one integrated image. That is, a specific area is emphasized or blinded on the integrated screen. Therefore, in the existing integrated control system, a plurality of computers or a high-performance and high-cost computer are required in order to individually emphasize interest and protect the privacy of individual images, whereas in the present invention, the integrated center system 200 ) Performs the image analysis and image processing only on the integrated image, thereby reducing the cost of image analysis and image processing.

Fig. 2 shows an example configuration of the field system of Fig.

2, the field system 100 includes a camera unit 110, a camera control unit 120, a field environment sensing unit 130, and a communication unit 140.

The camera unit 110 includes at least one fixed camera 111a and 111b and a PTZ (Pan / Tilt / Zoom) camera 112 as shown in FIG. The PTZ camera 112 acquires an image of the surveillance area through the fixed cameras 111a and 111b, and acquires a photograph of the surveillance object, which is enlarged, and provides the captured image to the camera controller 120. [ At this time, when two or more fixed cameras 111a and 111b are provided, it is preferable that the fixed cameras 111a and 111b have different imaging angles so that a wider imaging range can be ensured.

The camera control unit 120 generates surveillance information including at least one of a surveillance image and a photograph obtained by the camera unit 110 and transmits surveillance information to the control center system 200 through the communication unit 130. [ Here, the camera control unit 120 may watermark the monitoring information on the monitoring information and provide the watermarking information to the control center system 200 so that the security of the monitoring information, the prevention of artificial correction, and the original protection can be made possible. The monitoring situation information may include a shooting date and time, a photographing position, index information, coordinate information within the image of the target vehicle, and the like.

The camera control unit 120 controls the operation of the PTZ camera 112 in response to a command received from the center system 200. The PTZ camera 112 performs a pan, tilt, and zoom operation under the control of the camera control unit 120 to acquire an enlarged image of the surveillance target (for example, can do.

The communication unit 130 forms a wired or wireless communication channel with the control center system 200 to transmit the monitoring information generated by the camera control unit 120 to the control center system 200 or to be provided by the center system 200 And transmits the control information to the camera control unit 120.

Fig. 3 shows an example of the configuration of the control center system of Fig.

3, the control center system 200 includes a communication unit 210, a monitoring information storage unit 215, a monitoring information integration unit 220, an integrated image analysis unit 225, an attention highlight editing unit 235, A protection editing unit 230, a field control unit 240, an event information storage unit 245, an event notification unit 250, a screen control unit 260, and a user interface 260.

The communication unit 210 forms a wired or wireless communication channel with each of the plurality of the field systems 100 to receive monitoring information provided by the respective field system 100 or to receive various control information To the field system 100.

The monitoring information storage unit 215 receives and stores a plurality of monitoring information transmitted from the plurality of the field systems 100 through the communication unit 210. [ The monitoring information storage unit 215 divides and stores a plurality of monitoring information for each of the field systems 100 so that the monitoring information can be provided if necessary. The monitoring information storage unit 215 may further store at least one integrated image generated by the monitoring information integration unit 220. [

The monitoring information storage unit 215 preferably stores an original image without editing the monitoring information for later management and analysis. Accordingly, the monitoring information storage unit 215 receives and stores a plurality of monitoring information transmitted from the plurality of the field systems 100 as they are, and the integrated image generated by the monitoring information integration unit 220 is also used for the purpose of highlighting and protecting privacy It is desirable to store an image that has not been edited.

The monitoring information integrating unit 220 divides a plurality of pieces of sensing information stored in the monitoring information storage unit 215 into at least one group and integrates sensing information included in each of the at least one group to generate an integrated image . That is, the sensing information integrating unit 220 integrates the monitoring information provided as a video or image from the plurality of the field systems 110 into one video for each group. At this time, the monitoring information integrating unit 220 receives the integrated image settings such as the number of groups to be divided into a plurality of monitoring information, the monitoring information to be included in the integrated image, and the position where each monitoring information is to be arranged in the integrated image from the monitoring screen controller 250 can do. The monitoring information integrating unit 220 receives the monitoring information stored in the monitoring information storage unit 215 to generate an integrated image but directly receives a plurality of monitoring information received through the communication unit 210 to generate an integrated image It is also acceptable. The monitoring information integration unit 220 may integrate a plurality of monitoring information as it is at the time of generating the integrated image. However, in order to improve the efficiency of image editing, the monitoring information integration unit 220 performs resolution adjustment and size adjustment of each of the plurality of monitoring information, It is also possible to adjust the resolution or size after creating an image or creating an integrated image. The generation of integrated image and the resolution and size control greatly reduce the workload in the image processing. Therefore, the image processing can be performed with a low performance computer or a small number of computers as compared with the existing integrated control system. Therefore, the integrated control system can be constructed at low cost.

Here, the monitoring information integration unit 220 may map the location of the monitoring information arranged in the generated integrated image and the site system 100 corresponding to each monitoring information, and may include the mapping information together in the integrated image.

The integrated image analyzing unit 225 analyzes the integrated image generated by the monitoring information integrating unit 220 to determine whether a predetermined type of event occurs in each of the plurality of monitoring information included in the integrated image. Here, the types of events can be variously set according to the purpose of the integrated control system. For example, when the integrated control system is used as a traffic control system, the integrated image analysis unit 225 can identify an event such as a parking violation or a signal violation. In the case of a security control system, You will be able to identify events such as moving object detection. In the present invention, events corresponding to the purpose of the integrated control system are referred to as an attention event. In the present invention, the integrated image analysis unit 225 determines whether a privacy event occurs in each of a plurality of monitoring information included in the integrated image.

Also, when the original image stored in the monitoring information storage unit 215 is called for management and analysis, the integrated image analysis unit 225 determines whether an event of interest or a privacy protection event is also generated for an individual image that is not integrated. That is, the integrated image analyzing unit 225 basically detects whether or not an event is generated in the integrated image. However, if a monitoring operation is performed on an individual image through the monitoring screen control unit 250, You may.

In addition, the integrated image analyzer 225 may determine only the privacy event or only the interest highlight event according to the setting of the control center system 200. For example, if the integrated image analysis unit 225 is set to be activated only in the interest highlighting unit 235 in the monitoring screen control unit 250, only the interest highlighting event may be monitored, and only the privacy protection editing unit 230 If it is set to be activated, only privacy events can be monitored.

The integrated image analyzing unit 225 may detect the occurrence of the attention emphasis event and the privacy protection event by a predetermined area, a situation recognition, a specific pattern recognition, or the like. That is, it is possible to determine whether an event has occurred by setting the physical location area, or to analyze the contents of information included in the monitoring information, such as a predetermined situation or pattern, to determine whether an event has occurred.

When the integrated image analyzing unit 225 detects only one of the attention enhancement event and the privacy protection event according to the setting of the monitoring screen control unit 250, resources for analysis and processing of the integrated image can be further reduced.

Since the method of detecting the occurrence of the above-described event in the image is a known technique, a detailed description will be omitted here.

The attention emphasis editing unit 235 performs an editing operation for analyzing the event of interest if the event determined by the integrated image analyzing unit 225 is an event of interest. In the integrated control system, it is important to determine whether an event has occurred and let the monitoring person recognize it.

The emphasis editing unit 235 emphasizes the event occurrence area determined by the integrated image analysis unit 225 in a preset manner so as to be able to compare with the remaining areas. The event occurrence area is an area of interest to be actually monitored by the integrated control center. The attention highlight editing part 235 masks the area other than the area of interest, enlarges the area of interest, sets a boundary line for the area of interest, Can be used to highlight the region of interest. When the area of interest is set, the highlighted area of interest can be easily recognized by the monitoring personnel of the integrated control center. Therefore, it is possible to promptly respond to the occurrence of the event of interest even when the concentration of the monitoring personnel is reduced due to the operation of the integrated control center. The attention emphasis editing unit 235 performs an attention emphasis operation on the integrated image. The attention emphasis area emphasizes the attention area only within the area where the monitoring information in which the interest event occurs, among the plurality of monitoring information included in the integrated image. That is, when the interest event occurs in one monitoring information in the integrated image in which the monitoring information transmitted from the plurality of the field systems 100 is integrated, the attention area is emphasized. In this case, The region is emphasized in a predetermined manner so that the effect of highlighting the region of interest is not applied to the region where the monitoring information in which the event of interest is not generated is disposed. In order to emphasize the area of interest, the surveillance information in which the event of interest does not occur is not influenced by the integrated image.

In addition, the interest emphasis editing unit 235 may set the designated region in response to the interest region setting command applied from the screen control unit 260 or the user interface 260, even if the interest event occurrence is not detected in the integrated image analysis unit 225 It can also be emphasized as an area of interest.

And in the integrated control system, detailed event detail information about the object that generated the event of interest is needed more than determining whether the event occurs. For example, in a traffic control system, an object generating an event of interest is a vehicle that has a parking violation or a signal violation, and a security control system is a person who enters an object-prohibited area that generates an event of interest. In addition, the traffic control system not only identifies the interest event itself in which the vehicle has been subjected to a parking violation or a signal violation, but also requires event details (e.g., vehicle number) to identify the vehicle as the object that generated the interest event . In addition, the security control system requires detailed event information (eg, face image, physical characteristics, clothing, etc.) that can identify a person who is the object that generated the event of interest.

The attention emphasis editing unit 235 basically edits the region of interest with respect to the integrated image by software, and acquires event detail information. However, the attention emphasis editing unit 235 may not be able to acquire necessary event detail information even if the attention area is emphasized as occasion demands. For example, when acquiring the vehicle number of the vehicle in which the interested event occurred, it may happen that the vehicle number can not be identified simply by analyzing the integrated image based on the acquired monitoring information. In this case, the attention emphasis editing unit 235 transmits a attention emphasis control signal to the field control unit 240. [ In response to the attention enhancement control signal, the field control unit 240 controls the operation of the PTZ camera 112 of the field system 100 providing the monitoring information in which the event of interest has occurred, It is possible to enlarge and photograph. That is, if the event highlighting editing unit 235 fails to acquire the event detailed information from the obtained acquired monitoring information, the field emphasis editing unit 235 controls the field system 100 through the field control unit 240 so that the event can not be acquired by software editing Obtain detailed information. Then, the acquired detailed information is transmitted to the event information storage unit 245.

If the event determined by the integrated image analysis unit 225 is a privacy protection event, the privacy protection editing unit 230 performs an editing operation for privacy protection. The privacy protection editor 230 can protect the privacy of the individual from the monitoring of the integrated control system by applying a preset method such as masking processing to the preset privacy protection area in each of the plurality of monitoring information included in the integrated image. At this time, the privacy protection editing unit 230 may display only the monitoring information in which the privacy event occurs such that the image editing for privacy protection does not affect the monitoring information in which the privacy protection event has not occurred in the integrated image, Perform editing. Also, the privacy protection editing unit 230 may perform image editing for privacy protection selectively according to the monitoring authority of the monitoring personnel without performing image editing for all cases where a privacy protection event occurs. In other words, if the surveillance authority of the monitoring personnel is less than the predetermined standard authority, editing of the integrated image is prevented and the privacy protection area can not be confirmed. On the other hand, An agent may also be able to identify the privacy zone.

The attention emphasis editing part 235 and the privacy protection editing part 230 do not individually edit the plurality of pieces of monitoring information included in the integrated image but also include a corresponding event among the analyzed events in the integrated image analysis part 225 All the monitoring information is processed in a unit of integrated image at once. That is, after the existing integrated control system performs event analysis and editing operations individually for each monitoring information, the edited monitoring information is integrated and output to the user interface 260. In contrast, in the present invention, , The event can be analyzed and edited for the integrated image, so that only one image is edited, which can greatly reduce the cost of adding attention enhancement and privacy protection to the integrated control system.

In addition, the editing unit 235 and the privacy protection editing unit 230 do not edit the original information of the monitoring information and the integrated image but perform image editing in the form of a layer of a kind so that the original of the monitoring information and the integrated image are maintained .

In addition, the attention emphasis editing unit 235 and the privacy protection editing unit 230 may be selectively activated or deactivated according to the setting of the control center system 200. [ For example, when the control center system 200 only needs attention highlight editing, the control center system 200 can deactivate the privacy editor 230. On the other hand, if the control center system 200 only needs privacy editing, the attention highlight editing unit 235 can be deactivated. The setting of the control center system 200 may be set in the monitoring screen control unit 250. The monitoring screen control unit 250 may control the attention highlight editing unit 235 And the privacy protection editor 230 can be selectively activated or deactivated. In addition, if it is considered that at least one of the attention emphasis function and the privacy protection function is not used at the time of manufacturing the control center system 200, at least one of the attention emphasis editing part 235 and the privacy protection editing part 230 It may be configured by excluding it from the center system 200.

The field control unit 240 controls the operation of the field system 100 in response to at least one of a field control command applied through the user interface 260 and a attention enhancement control signal applied at the attention emphasis unit 230. The field control unit 240 authenticates the authority of the monitoring agent to perform field control and receives a field control command through the user interface 260 according to the authorized authority to receive at least one camera operation of the field system 100 .

The field control command is a command for a monitoring person to directly input the PTZ control value through the user interface 260 to directly control the camera unit 110 of the field system 100, This command is generated by selecting specific coordinates of the image. The field control unit 240 includes a conversion reference for converting the coordinate information in the monitoring image to the PTZ control value so that the field control command can be received using the coordinates of the monitoring image, Can be performed.

The event information storage unit 245 stores event detail information acquired by the attention highlight editing unit 235. [ The event information storage unit 245 stores event detail information transmitted from the attention highlight editing unit 235 according to the type of each event. The event information storage unit 245 may store event information for each type according to the contents of event detailed information. For example, when the integrated control system is a traffic control system, the event information storage unit 245 can store detailed event information according to the types of events such as a signal violation, a parking violation, etc., Can be separately stored. The event information storage unit 245 may store the event environment information together with the event detail information to be stored. The event environment information can store the photographing place photographing time and the like of the monitoring information where the event occurs together with the event detail information.

The monitoring screen control unit 250 adjusts the configuration of the image to be displayed on the user interface 260 and determines whether the attention highlight editing unit 235 and the privacy protection editing unit 230 are activated. The monitoring screen control unit 250 controls a screen configuration to be output to the user interface 260 in response to a screen control command applied through the user interface 260, and determines whether to edit the attention highlighting and privacy protection. The monitoring screen control unit 250 generates the integrated image edited in the attention highlight editing unit 235 or the private editing unit 235 as it is in the monitoring information integration unit 220 if the screen control command is not applied, And activates the attention emphasis editing unit 235 and the privacy protection editing unit 230 to perform attention emphasis editing and privacy protection editing on the integrated image.

  However, when the screen control command is applied, only the selected monitoring information among the plurality of monitoring information may be individually output to the user interface 260 in response to the screen control command. At this time, the screen control command may designate the arrangement and size of the selected monitoring information to be displayed on the user interface 260. [

The monitoring screen control unit 250 may selectively activate the attention highlight editing unit 235 and the privacy protection editing unit 230 so that only one of interest highlight editing and privacy protection editing is applied to the integrated image.

In addition, the monitoring screen control unit 250 selectively activates the attention highlight editing unit 235 or the privacy protection editing unit 230 even when the selected individual monitoring information is output to the user interface 260, Let at least one be performed.

In addition, the monitoring screen control unit 250 may transmit the integrated image setting to the monitoring information integrating unit 220 as occasion demands. The integrated image setting is a setting for selecting the monitoring information to be included in the integrated image among the plurality of monitoring information and designating the position and size in which the selected monitoring information is to be arranged in the integrated image. That is, when the monitoring person applies the screen control command through the user interface unit 270, the monitoring screen control unit 250 can set the configuration of the integrated image to be displayed on the user interface 260 according to the screen control command .

The user interface 260 includes a monitor, a control panel, and a mouse so that the integrated image or at least one monitoring information controlled by the monitoring screen control unit 250 is displayed on the screen of the monitor, And acquires various request items or control values of the input monitoring personnel as a user command.

4 shows an example of an integrated image according to the present invention.

In FIG. 4, the 20 pieces of monitoring information transmitted from the field system 100 constitute one integrated image. In FIG. 4, a privacy protection event is found in four pieces of monitoring information among 20 pieces of monitoring information of the integrated image, privacy protection editing is performed, and attention highlighting events are found in two pieces of monitoring information, and attention highlight editing is performed.

In the integrated image, the surveillance information in the first row and first column and the surveillance information in the second row, the first column and the fourth row and the second column are set so that the area other than the motorway is set as a privacy protection area, . In the second row and the third column, a residential area such as a home is set as a privacy zone so that the privacy of the individual can be protected.

In FIG. 4, the integrated image displays a boundary line for each of the interest highlighted areas so that the monitoring agent can easily recognize that an event has occurred in the two monitoring information.

In FIG. 4, masking editing is performed on the privacy protection area, and borderline editing is performed on the highlighted area. However, editing methods for the privacy protection area and the interest highlighted area may be variously set.

As in the monitoring information shown in the fourth row and the second column in FIG. 4, the privacy editing and the attention highlight editing can be performed together in one monitoring information. 4, the privacy protection editing and the attention emphasis editing are both performed on the integrated image. However, the privacy protection editing and the attention emphasis editing are performed according to the setting of the control center system 200, Only one edit may be performed during editing.

Also, although not shown, even when only the selected monitoring information among the plurality of monitoring information included in the integrated image is displayed on the user interface 260 in response to the screen control command, You can do at least one of highlight editing.

FIG. 5 shows an integrated control method having privacy protection and attention enhancement functions according to an embodiment of the present invention.

Referring to FIGS. 1 to 4, the integrated control method of FIG. 5 will be described. First, the control center system 200 of the integrated control system initializes the system (S110). The system initial setting determines whether or not the privacy protection editing unit 230 and the attention highlighting unit 235 of the control center system 200 are activated by interlocking the plurality of the field systems 100 and the control center system 200, Set up a protection event and an attention highlight event. Here, the privacy event and the attention emphasis event may be set in the form of a place such as a privacy zone and a highlight area for the places monitored by the plurality of field systems 100, and may be set to cameras of the field system 100 May be set for a predetermined specific operation of the objects photographed by the camera. It is also possible to set additional events in addition to the attention highlight event and the privacy event. A separate event may be set by the system administrator or monitoring personnel. In addition, it is possible to set the level of information provision by the monitoring personnel in the system initialization operation together. Also, the plurality of field systems 100 are grouped into at least one group. Here, the grouping of the plurality of on-site systems 100 into at least one group is for generating an integrated image for each group.

When the system initialization is performed, the control center system 200 receives monitoring information from each of the plurality of the field systems 100 (S120). When the plurality of monitoring information is received, the control center system 200 divides the plurality of monitoring information into at least one predetermined group, and combines the monitoring information for each group to generate an integrated image (S130). That is, a plurality of pieces of monitoring information are merged to generate an integrated image.

When the integrated image is generated, the integrated image is analyzed (S140). When analyzing the integrated image, the control center system 200 first determines whether the attention highlight editing setting is activated (S150). If the highlight emphasis edit setting is activated, it is determined whether the attention emphasis event occurs in the integrated image analysis result (S160). At this time, it is determined whether or not the attention enhancement event occurs in all the monitoring information included in the integrated image. If it is determined that the attention emphasis event has occurred, the attention emphasis editing unit 235 performs attention emphasis editing on the integrated image (S170). At this time, the attention emphasis editing unit 235 does not edit the plurality of monitoring information included in the integrated image individually, but performs the editing operation on the entire integrated image composed of one image. The attention emphasis editing unit 235 may control the field system 100 by transmitting a attention emphasis control signal to the field control unit 240 to acquire event detail information.

Then, the control center system 200 determines whether the privacy protection edit setting is activated (S180). If the privacy protection edit setting is activated, it is determined whether a privacy event has occurred in the integrated image (S190). If a privacy event occurs, the privacy protection editing unit 230 performs privacy protection editing on the integrated image (S200). Editing of Privacy Protection Also, as with editing, editing is performed on the integrated image instead of each monitoring information.

Thereafter, the control center system 200 outputs the integrated image on which the attention emphasis editing and the privacy editing are performed to the user interface 260 (S210). However, at the time of outputting the integrated image, the control center system 200 identifies the identifier of the monitoring agent input through the user interface 260, confirms the authority of the monitoring agent, and displays the integrated image Or output an unedited integrated image.

In the above description, attention emphasis editing and privacy protection editing are separately performed. However, for convenience of explanation, in actual implementation, it is determined by one integrated image analysis whether an attention emphasis event and a privacy protection event occurrence are generated, Highlight editing and privacy editing can also be done at once.

FIG. 6 is a detailed view of the integrated image generation step of FIG.

6, the integrated image generation step (S130) divides the received plurality of monitoring information into groups (S131). Here, the number of groups for dividing the plurality of monitoring information and the monitoring information to be included in each group may be designated in advance in the initialization step (S110), and the integrated image May be set in response to the setting.

Then, a plurality of pieces of monitoring information included in each of the divided groups is determined (S132). The arrangement position where each of the plurality of monitoring information is arranged may also be specified in the initialization step S110 or by the integrated image setting applied through the monitoring screen control unit 250. [

If the arrangement of the plurality of monitoring information for each group is determined, an integrated image for each group in which a plurality of monitoring information is arranged according to the determined arrangement is generated (S133).

FIG. 7 is a detailed view of the integrated image output step of FIG.

7, the integrated video output step S210 outputs the integrated video generated for each group to the user interface 260 (S211). Then, it is determined whether a user command is applied through the user interface 260 (S212). If the user command is authorized, it is determined whether the authorized user command is the monitoring information individual analysis command (S213). Here, the monitoring information individual analysis command may be individual monitoring information transmitted from a plurality of the field systems 100 in real time, but may be monitoring information previously stored in the monitoring information storage unit 215. [ In some cases, the integrated control system may need to retrieve or re-analyze the previously obtained monitoring information as well as the monitoring information currently being monitored by the field system 100. [ If the previously acquired monitoring information is to be searched or reanalyzed, the original of the previously stored monitoring information in the monitoring information storage unit 215 can be used again.

If the authorized user command is a monitoring information individual analysis command, the control center system 200 analyzes the selected individual monitoring information by the integrated image analysis unit 225. The integrated image analyzing unit 225 analyzes the individual monitoring information to determine whether a attention enhancement event occurs in the individual monitoring information (S215). If it is determined that the attention emphasis event has occurred, the attention emphasis editing unit 235 performs interest emphasis editing on the individual monitoring information (S216). At this time, according to the setting of the control center, the analysis of the occurrence of the attention highlight event and the attention highlight edit are performed only when the highlight highlight edit setting is activated.

On the other hand, if the attention highlight editing is completed or the highlight highlight edit is not performed, it is determined whether a privacy event occurs for the individual monitoring information (S217). If it is determined that the privacy event is generated in the individual monitoring information, the activated private protection editing unit 230 individually performs privacy protection editing on the selected monitoring information (S218). Individual privacy editing is also performed only if privacy editing settings are enabled.

Then, the individual monitoring information in which the attention emphasis editing and the privacy protection editing are performed is outputted through the user interface 260 (S219).

However, if the authorized user command is not the monitoring information individual analysis command, the operation corresponding to the user command is performed (S220). For example, a user command may be granted a field control command, in which case the control center system 200 may control the field system 100 in response to a field control command.

Therefore, the integrated control method having privacy protection and attention enhancement function according to the present invention shown in FIG. 5 to FIG. 7 converts a plurality of monitoring information received from the plurality of field systems 100 into an integrated image After editing, such as privacy protection and attention emphasis on the converted integrated image, system construction cost can be greatly reduced.

In the above description, it is described that the editing function of privacy protection and the highlighting editing function are applied to the integrated control system. However, in recent years, various devices such as smart TV, computer, smart phone and smart pad can provide integrated image, There is a similarity that the integrated image should be processed with low performance. In addition, as the spread of various devices is expanded and harmful information to children or adolescents is overflowed, it is possible to use the low cost attention highlight editing technology and privacy protection editing technology of the present invention in combination with various electronic devices.

The method according to the present invention can be implemented as a computer-readable code on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of the recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and a carrier wave (for example, transmission via the Internet). The computer-readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art.

Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

Claims (23)

A plurality of field systems, each having at least one camera, for transmitting surveillance information comprising images photographed by the at least one camera; And
Receiving and monitoring the monitoring information from the plurality of field systems, integrating the plurality of monitoring information to generate an integrated integrated image, analyzing the integrated image, and analyzing at least one of the preset privacy- And a control center system for performing an editing operation corresponding to an event generated for the integrated image and outputting the edited operation,
The control center system comprises:
A communication unit for receiving the monitoring information from each of the plurality of field systems;
A monitoring information storage unit for storing the plurality of monitoring information and the integrated image;
A monitoring information integration unit for dividing the plurality of monitoring information into at least one group including a plurality of monitoring information, and integrating a plurality of monitoring information divided into at least one group to generate at least one integrated image;
An integrated image analyzing unit analyzing each of the at least one integrated image to determine whether the privacy protection event or the monitoring information in which the attention enhancement event occurs is present in each of the at least one integrated image;
An interest highlighting unit for performing predetermined interest highlight editing on a region of interest highlighted in the integrated image if it is determined that the monitoring information in which the attention highlighting event occurs is present in the integrated image;
A privacy protection editor for performing privacy protection editing on a privacy protection area in the integrated image if it is determined that the monitoring information in which the privacy protection event occurs is present in the integrated image; And
And a user interface for outputting an edited image in which the attention highlight editing and privacy protection editing are performed according to whether the at least one event is generated or not, and receiving a user command. delete The apparatus of claim 1, wherein the monitoring information integration unit
Selects the monitoring information to be included in the integrated image among the plurality of monitoring information in response to the integrated image setting, and determines the position and size of the selected monitoring information in the integrated image. The apparatus of claim 3, wherein the monitoring information integration unit
And controlling the size and the resolution of each of the selected monitoring information in consideration of the size and the resolution of the integrated image, and then integrating the integrated image to generate the integrated image.
The apparatus of claim 3, wherein the monitoring information integration unit
Wherein the control unit controls the size and resolution of the integrated image to a predetermined size and resolution after generating the integrated image by integrating the selected monitoring information.
4. The apparatus of claim 3, wherein the attention highlight editor
Wherein the attention enhancement editing unit performs the attention enhancement editing in an area where at least one monitoring information in which the attention enhancement event occurs is placed in the integrated image.
4. The apparatus of claim 3, wherein the privacy editor
Wherein the monitoring authority of the monitoring agent authenticated through the user interface is checked and whether or not privacy protection editing is performed is determined according to the monitored authority.
8. The system of claim 7, wherein the privacy editor
And the privacy protection editing unit performs the privacy protection editing in the area where at least one monitoring information in which the privacy protection event occurs is placed in the integrated image.
4. The system of claim 3, wherein the control center system
A field controller for controlling each of the plurality of field systems in response to the field control command if the user command is a field control command for controlling the plurality of field control systems; And
Generates the integrated image setting that designates the number, placement position, and size of the monitoring information to be included in the integrated image according to the received screen control command, and transmits the integrated image setting to the monitoring information integration unit And a monitoring screen control unit for monitoring the integrated control system.
The apparatus of claim 9, wherein the monitoring screen control unit
And controlling the selected monitoring information among the plurality of monitoring information stored in the monitoring information storage unit to be output to the user interface if the user command applied through the user interface is a monitoring command for an individual image of the plurality of monitoring information Wherein the control system comprises:
11. The system of claim 10, wherein each of the attention highlight editor and the privacy editor
And performs the highlight highlight editing and the privacy edit on the selected monitor information if the user command is a monitoring command for the individual image.
The apparatus of claim 1, wherein the monitoring information storage unit
And stores the plurality of surveillance information and the original of the integrated image in which the attention emphasis editing and the privacy protection editing are not performed by the attention emphasis editing unit and the privacy protection editing unit. The apparatus of claim 9, wherein the attention highlight editor
Wherein the event highlighting control unit obtains event detail information on the attention highlight event through the attention highlight editing and if the event detail information can not be obtained even by the attention highlight edit, To the control unit.
1. An integrated control method using an integrated control system including a plurality of field systems and a control center system each having at least one camera,
Setting the position and size of the detection information included in the integrated image among the plurality of monitoring information, setting the position and size of the detection information included in the integrated image, A system initialization step;
The control center system receiving and storing monitoring information from each of the plurality of field systems;
Wherein the control center system divides the plurality of monitoring information into at least one group including a plurality of monitoring information and integrates a plurality of monitoring information divided into at least one group to generate at least one integrated image ;
The control center system analyzes each of the at least one integrated image to determine whether the privacy protection event or the monitoring information in which the attention enhancement event occurs is present in each of the at least one integrated image;
Performing predetermined attention highlight editing on a region of interest highlighted in the integrated image if the control center system determines that supervisory information on which the attention highlight event occurs is present in the integrated image;
Performing a privacy editing process for the privacy protection area in the integrated image if the control center system determines that the monitoring information in which the privacy protection event occurs is present in the integrated image;
Outputting an edited image in which the attention highlight editing and privacy editing are performed according to whether the at least one event is generated by the control center system; And
And controlling the field system in response to a user command. delete 15. The method of claim 14, wherein generating the at least one integrated image comprises:
Wherein the integrated image is generated by adjusting the size and resolution of each of the selected monitoring information in consideration of the size and resolution of the integrated image. 15. The method of claim 14, wherein generating the at least one integrated image comprises:
Wherein the integrated image is generated by combining the selected monitoring information, and then the size and resolution of the integrated image are adjusted to a predetermined size and resolution. 15. The method of claim 14, wherein performing the attention enhancement editing comprises:
Wherein the attention emphasis editing is performed within a region in which at least one monitoring information in which the attention emphasis event occurs is placed in the integrated image.
19. The method of claim 18, wherein performing the attention highlight editing comprises:
Obtaining event detailed information on the attention highlight event through the attention highlight editing; And
And controlling the on-scene system to obtain the event detail information if the event detail information can not be obtained by the highlight highlight editing.
15. The method of claim 14, wherein the step of performing the private editing comprises:
Confirming the monitoring authority of the monitoring agent, and determining whether to edit the privacy protection according to the checked monitoring authority; And
And performing the privacy editing on the integrated image if it is determined to perform the privacy protection editing.
15. The method of claim 14,
And outputting selected monitoring information among the plurality of monitoring information stored in the monitoring information storage unit when an individual image monitoring command for the plurality of monitoring information is applied.
22. The method of claim 21, wherein outputting the selected monitoring information comprises:
Performing attention highlight editing and privacy edit on the selected monitoring information; And
And outputting the edit monitoring information in which the attention emphasis editing and the privacy protection editing are performed.
22. The method of claim 21,
Storing the original of the plurality of surveillance information transmitted and stored in each of the plurality of field systems, and performing the attention emphasis editing and the privacy protection editing only on the edited image to be output.

Images