KR20210083571A - A portable terminal for generating floor plans based on pointing walls and providing mapping of virtual objects to the floor plans - Google Patents

Abstract

An operating method of a portable terminal according to an embodiment of the present invention includes: acquiring measurement information corresponding to a first coordinate point of a first wall surface and a second coordinate point of the first wall surface; determining structure information of the first wall surface connecting the first coordinate point and the second coordinate point based on a linear function operation of the first coordinate point and the second coordinate point; completing the indoor structure information including one or more closed spaces according to the sequential connection processing of other wall surfaces in a first direction corresponding to the first wall surface; providing a virtual object mapping interface corresponding to the indoor structure information; and generating virtual object information mapped to the indoor structure information according to the virtual object mapping interface input.

Description

A portable terminal providing wall-pointing-based indoor structure information generation and virtual object mapping and its operation method

The present invention relates to a portable terminal and an operating method thereof. More specifically, the present invention relates to a portable terminal providing wall pointing-based indoor structure information generation and virtual object mapping, and an operating method thereof.

In general, when designing drawings of buildings, CAD programs are installed on personal computers or notebook computers, and drawings are created using devices such as a mouse or a tablet, and the results are calculated.

However, as society develops from an industrial society to an information society, virtual reality technologies that can replace functions such as a model house by providing users with 3D modeling results rather than drawings more easily in a user experience format are emerging.

VR (Virtual Reality) or AR (Augmented Reality) for the purpose of, for example, a virtual tour of a building interior (house, apartment, office, hospital, church, etc.), interior or furniture placement simulation (or interior simulation) is created, and various methods have been proposed to provide the user with a simulated environment and situation based thereon and to interact with it.

To this end, a method of generating 3D data of a building or indoor structure in advance manually or using a 3D scanner and providing virtual reality based thereon may be used. However, in the case of this method, a three-dimensional architectural modeling process by estimation from scan information or drawings is required, so there is a difficulty in manufacturing, and the accuracy is lowered due to limitations in data processing and manual work. There is this.

In order to solve this problem, a technology for recognizing an indoor structure, furniture, etc. from an image using a camera function of a portable terminal has been proposed. However, these techniques are also based on image image analysis and estimation, and not only cannot calculate an accurate indoor structure, but also use only images in a specific direction, so it is difficult to calculate detailed indoor structure information such as a building floor plan.

Therefore, it is a situation in which time and cost are excessively required to structure and generate the indoor information of a building realistically only with the current technology.

The present invention is to solve the above problems, and by generating sequential wall pointing-based indoor structure information based on distance measurement and three-dimensional angle measurement interlocked with a portable terminal, a user can intuitively and conveniently indoor structure information In particular, it is possible to create a building floor plan close to the actual measurement with just a few inputs to a portable terminal, and by using this efficient interface input, it is possible to redesign or create a building floor plan based on wall pointing-based indoor structure information generation and An object of the present invention is to provide a portable terminal that provides a redesign and a virtual object mapping function corresponding thereto, and an operating method thereof.

In a method according to an embodiment of the present invention for solving the above problems, in the method of operating a portable terminal, measurement information corresponding to a first coordinate point of a first wall surface and a second coordinate point of the first wall surface are obtained. obtaining; determining structure information of the first wall surface connecting the first coordinate point and the second coordinate point based on a linear function operation of the first coordinate point and the second coordinate point; completing the indoor structure information including one or more closed spaces according to the sequential connection processing of other wall surfaces in a first direction corresponding to the first wall surface; providing a virtual object mapping interface corresponding to the indoor structure information; and generating virtual object information mapped to the indoor structure information according to the virtual object mapping interface input.

In addition, the device according to an embodiment of the present invention for solving the above problems, in the portable terminal, obtains measurement information corresponding to the first coordinate point of the first wall surface and the second coordinate point of the first wall surface measuring unit; Based on the linear function calculation of the first coordinate point and the second coordinate point, the structure information of the first wall surface connecting the first coordinate point and the second coordinate point is determined, and the structure information corresponding to the first wall surface is determined. a spatial information generating unit that completes the indoor structure information including one or more closed spaces according to sequentially connecting other wall surfaces in a first direction; and a virtual object mapping unit that provides a virtual object mapping interface and generates virtual object information mapped to the indoor structure information according to a user input corresponding to the virtual object mapping interface.

Meanwhile, the method according to an embodiment of the present invention for solving the above problems may be implemented as a program for executing the method in a computer and a recording medium in which the program is recorded.

According to an embodiment of the present invention, position information of each coordinate point corresponding to the first coordinate point and the second coordinate point of the first wall measured based on the distance measurement and the three-dimensional angle measurement interlocked with the portable terminal is calculated. and determining the structure information of the first wall based on a linear function operation connecting the coordinate points, so that indoor floor plan information including the structure information of the first wall can be generated, and subsequent wall connection Accordingly, it is possible to generate sequential wall pointing-based indoor structure information.

Accordingly, the present invention enables a user to intuitively and conveniently create indoor structure information, and in particular, a portable terminal for generating wall-pointing-based indoor structure information that can generate a building floor plan close to the actual measurement only with a few inputs to a portable terminal. A terminal and an operating method thereof may be provided.

In addition, the present invention supplements the accuracy of corner angles due to measurement and prediction errors, also supplements the accuracy that varies depending on the function and performance of the portable terminal, and processes an efficient user input to perform proper calibration and scaling according to the user's intention and design. By providing a redesign function, it is possible to provide a more efficient redesign process of indoor structure information while maintaining the polygonal shape of the overall indoor structure information and minimizing user input to the interface.

In addition, the present invention provides a virtual object mapping function for each wall corresponding to the indoor floor plan information, so that the user can easily map objects such as windows and doors for each wall of his/her own indoor floor plan information, and use the two-dimensional and three-dimensional By enabling dimensional indoor floor plan information to be constructed in various ways, it is possible to provide a portable terminal capable of promoting user convenience and diversity of indoor floor plan configurations and an operating method thereof.

1 illustrates a portable terminal according to an embodiment of the present invention.
2 is a block diagram illustrating in more detail a portable terminal according to an embodiment of the present invention.
3 is a block diagram illustrating a spatial information generating unit according to an embodiment of the present invention in more detail.
4 is a flowchart illustrating a method of operating a portable terminal according to an embodiment of the present invention.
5 and 6 are diagrams illustrating a step-by-step process of generating indoor structure information according to an embodiment of the present invention.
7 to 12 are diagrams for explaining a user interface output from a portable terminal according to an embodiment of the present invention.
13 is a flowchart schematically illustrating a redesign process according to an embodiment of the present invention.
14 is a flowchart for explaining a polygon calibration-based angle and node position redesign process according to an embodiment of the present invention, and FIGS. 15 to 23 are exemplary diagrams schematically illustrating the redesign process step by step.
24 is a flowchart for explaining a polygonal scaling redesign process according to an embodiment of the present invention, and FIGS. 25 to 30 are diagrams illustrating a user interface for polygonal scaling and a redesign result.
31 is a flowchart illustrating a virtual object mapping process according to an embodiment of the present invention, and FIGS. 32 and 33 are diagrams illustrating a user interface for virtual object mapping.

The following is merely illustrative of the principles of the invention. Therefore, those skilled in the art will be able to devise various devices which, although not explicitly described or shown herein, embody the principles of the present invention and are included within the spirit and scope of the present invention. Moreover, it is to be understood that all conditional terms and examples listed herein are, in principle, expressly intended solely for the purpose of enabling the concept of the present invention to be understood, and not limited to the specifically enumerated embodiments and states as such. should be

Moreover, it is to be understood that all detailed description reciting the principles, aspects, and embodiments of the invention, as well as specific embodiments, are intended to cover structural and functional equivalents of such matters. It is also to be understood that such equivalents include not only currently known equivalents, but also equivalents developed in the future, i.e., all devices invented to perform the same function, regardless of structure.

Thus, for example, the block diagrams herein are to be understood as representing conceptual views of illustrative circuitry embodying the principles of the present invention. Similarly, all flowcharts, state transition diagrams, pseudo code, etc. may be tangibly embodied on computer-readable media and be understood to represent various processes performed by a computer or processor, whether or not a computer or processor is explicitly shown. should be

The functions of the various elements shown in the figures including a processor or functional blocks represented by similar concepts may be provided by the use of dedicated hardware as well as hardware having the ability to execute software in association with appropriate software. When provided by a processor, the functionality may be provided by a single dedicated processor, a single shared processor, or a plurality of separate processors, some of which may be shared.

In addition, clear use of terms presented as processor, control, or similar concepts should not be construed as exclusively referring to hardware having the ability to execute software, and without limitation, digital signal processor (DSP) hardware, ROM for storing software. It should be understood to implicitly include (ROM), RAM (RAM) and non-volatile memory. Other common hardware may also be included.

In the claims of the present specification, a component expressed as a means for performing the function described in the detailed description includes, for example, a combination of circuit elements that perform the function or software in any form including firmware/microcode, etc. It is intended to include all methods of performing the functions of the device, coupled with suitable circuitry for executing the software to perform the functions. Since the present invention defined by these claims is combined with the functions provided by the various enumerated means and combined in a manner required by the claims, any means capable of providing the functions are equivalent to those contemplated from the present specification. should be understood as

The above-described objects, features and advantages will become more apparent through the following detailed description in relation to the accompanying drawings, and accordingly, those of ordinary skill in the art to which the present invention pertains can easily implement the technical idea of the present invention. There will be. In addition, in the description of the present invention, when it is determined that a detailed description of a known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

Hereinafter, a preferred embodiment according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a portable terminal according to an embodiment of the present invention, and FIG. 2 is a block diagram showing the configuration of a portable terminal according to an embodiment of the present invention in more detail.

The portable terminal 100 described herein is a mobile phone, a smart phone, a computer, a laptop computer, a digital broadcasting terminal, PDA (Personal Digital Assistants), PMP (Portable Multimedia) operated according to a user input. Player), navigation, and various electronic devices such as virtual reality devices may be exemplified.

In addition, a program or application for executing the methods according to an embodiment of the present invention may be installed and operated in the portable terminal 100 .

Accordingly, the portable terminal 100 according to the embodiment of the present invention may provide an interface for generating indoor structure information, and the indoor structure information generated according to the embodiment of the present invention may be stored in the portable terminal 100 or separately It may be uploaded to a server (not shown) and managed according to user information.

Here, the indoor structure information may include two-dimensional building floor plan information, and may include structure information that can be used for indoor interior simulation by matching three-dimensional modeling information. In addition, the indoor structure information may include one or more wall surfaces and connection information of each wall surface, and may form one or more closed spaces.

In order to facilitate the generation of the indoor structure information, the portable terminal 100 may include a distance measuring sensor and an angle measuring sensor, and from measurement information corresponding to the first wall 200 pointed in the room according to a user input, The first coordinate point 201 and the second coordinate point 202 may be calculated, and structural information of the first wall surface 200 may be determined based on the first coordinate point 201 and the second coordinate point 202 . . The structure information of the first wall surface 200 may be calculated as an infinite linear function connecting the first coordinate point 201 and the second coordinate point 202 , and the linear function is each of the wall surfaces 200 and 210 . Each can be determined individually.

Accordingly, the portable terminal 100 can extend the linear functions corresponding to the respective wall surfaces 200 and 210 , and identify an intersection 203 between the linear functions, and the first corresponding to the intersection 203 . The connection of the wall surface and the second wall surface may be processed, and a corner position and a corner angle between intersections may be predicted.

In particular, the corner position and corner angle are very important factors for calculating the indoor building floor plan, but there is a problem in that it is difficult to accurately measure it using the existing full scanning method, etc. As it is calculated as the linearly calculated intersection 203 between the extension lines of the first wall 200 and the second wall 210, it is possible to calculate very accurate indoor structure information.

In addition, according to an embodiment of the present invention, the indoor structure information can be completed by having the user repeatedly perform the process of measuring and connecting each wall in the first direction until a closed space is formed.

To this end, the portable terminal 100 according to an embodiment of the present invention provides a user interface that allows the user to intuitively perform pointing of two coordinate points of each wall and sequentially inputting the wall surface creation in the first direction. can do.

For example, some prior art in the past includes a technique used to calculate indoor structure information by measuring a corner of a space, but there is a problem in that it is almost impossible to make an accurate measurement by only such a measurement.

In contrast, in the portable terminal 100 according to an embodiment of the present invention, an accurate wall structure can be calculated only by simply pointing two coordinate points on the wall, and the wall can be mapped with a linear function passing through the two measured points. As possible, by repeating this for all walls of the indoor space, wall and potential wall extension lines are calculated, and corner position and angle information according to the connection can be accurately calculated.

However, for this purpose, the user of the portable terminal 100 needs to continuously measure the wall surface in a specific first direction (eg, clockwise or counterclockwise). Therefore, after measuring the first wall surface, the next The second wall should be adjacent to the first wall, and there is a need to maintain the first first direction in the entire interior structure information generation process.

In addition, it is preferable that the portable terminal 100 moves at a constant speed or less during measurement. This is to increase the accuracy in measuring the position and angle of the portable terminal 100 .

In addition, it is preferable that the first coordinate point and the second coordinate point are spaced apart from each other by a certain distance or more, and it is preferable that the first coordinate point and the second coordinate point be adjacent to each other within a certain height. This is because it is easy to calculate an accurate linear function.

In addition, the completed indoor structure information can be used for information sharing and storage, and can be used for indoor simulation. The indoor simulation is a three-dimensional space similar to reality on a virtual space displayed on the display of the portable terminal 100, etc. may include a function of visualizing and freely arranging a 3D object corresponding thereto on an indoor simulation graphic based on the indoor structure information. Accordingly, the indoor simulation may be preferably used for a floor plan that simulates furniture to be placed in a room, and the application providing the indoor simulation may include a floor plan application.

In particular, the portable terminal 100 according to an embodiment of the present invention creates an arbitrary virtual object on an indoor floor plan according to a user input, and maps it to two-dimensional drawing information on the indoor floor plan or to three-dimensional indoor simulation information. It can provide a virtual object mapping function that allows users to easily map objects such as windows and doors for each wall of their own indoor floor plan information, and use this to diversify 2D and 3D indoor floor plan information. By enabling the construction, it is possible to provide a portable terminal capable of promoting user convenience and diversity of interior floor plan configurations and an operating method thereof.

To this end, a separate server device may store the predetermined application that can be installed in the portable terminal 100 and information necessary to provide the indoor simulation, and user registration and indoor structure information for the user of the portable terminal 100 . management can be provided. The portable terminal 100 may download and install an application from a server device.

Detailed configurations of each device for implementing this will be described in more detail below.

2 is a block diagram illustrating in more detail a portable terminal according to an embodiment of the present invention.

Referring to FIG. 2 , the portable terminal 100 includes an input unit 110 , a distance measurement unit 121 , an angle measurement unit 122 , a spatial information generation unit 130 , a control unit 140 , and an interface output unit 150 . , a storage unit 160 , a communication unit 170 , and a virtual object mapping unit 180 . Since the components shown in FIG. 2 are not essential, a terminal having more or fewer components may be implemented.

The communication unit 170 may include one or more modules that enable wireless communication between the portable terminal 100 and a wireless communication system or between the portable terminal 100 and a network in which the portable terminal 100 is located. For example, the wireless communication unit 170 may include a broadcast reception module, a mobile communication module, a wireless Internet module, a short-range communication module, and a location information module.

The mobile communication module transmits/receives wireless signals to and from at least one of a server device, a base station, an external terminal, and a server on a mobile communication network.

The wireless Internet module refers to a module for wireless Internet access, and may be built-in or external to the portable terminal 100 . As wireless Internet technologies, wireless LAN (WLAN) (Wi-Fi), wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), etc. may be used.

The short-distance communication module refers to a module for short-distance communication. Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used as short range communication technologies.

The location information module is a module for acquiring the location of the terminal, and a representative example thereof is a Global Position System (GPS) module.

Also, for example, the communication unit 170 may upload the completed indoor structure information to the server device, or may receive pre-registered indoor structure information in response to user information from the server device.

The input unit 110 generates input data for the user to control the operation of the terminal. The user input unit 110 may include a keypad, a dome switch, a touch pad (static pressure/capacitance), a jog wheel, a jog switch, and the like.

The measurement unit 120 measures and outputs information sensed by one or more sensors provided in the portable terminal 100 . The measuring unit 120 may include a distance measuring unit 121 , an angle measuring unit 122 , and a position measuring unit 123 .

The distance measuring unit 121 may include one or more distance measuring sensors that output distance information to the location pointed to by the portable terminal 100 . The distance measuring unit 121 may include, for example, various sensors such as an ultrasonic sensor, a laser sensor, an infrared sensor, a radar sensor, and a camera sensor, and is preferably provided in a detachable form to the portable terminal 100 . can

In addition, the angle measuring unit 122 may include one or more state measuring sensors for outputting three-dimensional angle information corresponding to the current state of the portable terminal 100 . For example, the angle measuring unit 122 may include a three-axis acceleration sensor that measures whether the portable terminal 100 is inclined at a certain angle. Here, the measured angle information can be used to calculate the coordinate points of the wall together with the distance information of the distance measuring unit 121, in particular, a yaw axis, a pitch axis, and a roll axis. Each of the three-axis angle information as an axis may be measured or calculated and output.

In addition, the location measurement unit 123 may include one or more sensors for outputting location information corresponding to the current location of the portable terminal 100, and various location information such as an acceleration sensor, a GPS sensor, or an indoor location tracking sensor. It may include output sensors for calculation. In particular, the position measuring unit 123 may include one or more tracking sensors that enable tracking of the user's position and head for augmented reality or virtual reality simulation.

The interface output unit 150 is for generating an output related to visual, auditory, or tactile sense by providing an interface, and may include a display unit, a sound output module, an alarm unit, a haptic module, and the like.

The display unit displays (outputs) information processed by the portable terminal 100 . For example, when the terminal is in the indoor simulation mode, a user interface (UI) or graphic user interface (GUI) related to the indoor simulation and floor plan is displayed. In addition, a user interface for generating indoor structure information according to an embodiment of the present invention may be displayed on the interface screen.

The display unit includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, 3 It may include at least one of a 3D display.

The storage unit 160 may store a program for the operation of the control unit 140 and may temporarily store input/output data.

Storage unit 160 is a flash memory type (flash memory type), hard disk type (hard disk type), multimedia card micro type (multimedia card micro type), card type memory (for example, SD or XD memory, etc.), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, It may include at least one type of storage medium among a magnetic disk and an optical disk. The portable terminal 100 may operate in relation to a web storage that performs a storage function of the memory 160 on the Internet.

The spatial information generating unit 130 is configured to perform an input of the input unit 110 and control of the controller 140 , based on the distance information of the distance measuring unit 121 and the 3D angle information of the angle measuring unit 122 . Calculates wall structure information and wall connection information for generating indoor structure information, completes indoor structure information according to whether a closed space is formed by sequentially connecting walls, and performs output processing through the interface output unit 150 .

To this end, the spatial information generating unit 130 may calculate a first coordinate point and a second coordinate point of each wall based on the distance information of the distance measuring unit 121 and the three-dimensional angle information of the angle measuring unit 122 . In addition, it is possible to determine the structure information of the first wall surface by the connection of the first coordinate point and the second coordinate point, and perform a corner connection process with another wall surface according to a linear function calculation of the structure information, so that the indoor structure It is possible to perform corner position and corner angle calculations of information.

In addition, the spatial information generating unit 130 may generate the completed indoor structure information by performing the corner angle redesign process, which is an overall angle redesign process considering that the wall structure of a typical indoor plan view is 90 degrees. may include.

The controller 140 generally controls the overall operation of the terminal, and performs related control and processing for, for example, generating indoor structure information, providing an interface, voice call, data communication, video call, and the like.

In addition, according to a user input, the control unit 140 stores the indoor structure information including the wall structure information, the corner position information, and the corner angle information calculated according to the generation of the spatial information in the storage unit 160 or the communication unit 170 ) to be sent to the server device.

Meanwhile, the virtual object mapping unit 180 may output a virtual object mapping interface for mapping virtual object information corresponding to each wall of the indoor floor plan according to the indoor structure information. In addition, the virtual object mapping unit 180 may generate virtual objects such as windows and doors corresponding to each wall of the indoor floor plan according to a user selection input corresponding to the virtual object mapping interface, and the generated virtual object information is A mapping process may be performed corresponding to the location of each wall surface of the indoor plan view.

More specifically, the virtual object mapping unit 180 outputs a virtual object mapping interface capable of generating a virtual object corresponding to the indoor floor plan information completed or redesigned by the spatial information generating unit 130 to the interface output unit 150 . can be output in the form of a combination of two-dimensional image, three-dimensional image, or audio data.

In addition, the virtual object mapping unit 180 receives virtual object type information, first wall information selected corresponding to the indoor floor plan, and virtual object contour location information from a user input according to the interface input, and generates virtual object information. do.

Here, the virtual object contour position information may be determined differently according to the virtual object type information, and for example, in the case of a rectangular object such as a window or a door, the first position of the upper left and the second position of the lower right are included. can do. Accordingly, the virtual object mapping unit 180 extracts the first location information and the second location information of the rectangular object from the user input, and based on the inputted first location information and the second location information, such as a window door, etc. of virtual object information can be created.

Here, the virtual object information may be mapped to a texture corresponding to the virtual object type information selected by the user and output on a 2D indoor floor plan or a 3D indoor simulation graphic interface.

In addition, the virtual object mapping unit 180 may map the generated virtual object information to the first wall information, and the mapping information may be stored in the storage unit 170 or uploaded to an external server.

To this end, the virtual object mapping unit 180 may combine the virtual object information and the mapping information corresponding to the first wall surface to the indoor floor plan information including the first wall surface and store it as the indoor structure information.

Accordingly, the indoor structure information may be stored and managed in a cloud server or a server device by matching the user account information of the portable terminal 100 .

3 is a block diagram illustrating a spatial information generating unit according to an embodiment of the present invention in more detail.

Referring to FIG. 3 , the spatial information generating unit 130 according to the embodiment of the present invention includes a measurement point coordinate calculating unit 131 , a wall information calculating unit 133 , a corner calculating unit 135 , and a spatial information determining unit 137 . and a redesign unit 139 .

The measuring point coordinate calculating unit 131 calculates the coordinates of the wall measuring point based on the distance information and the three-dimensional angle information sensed by the distance measuring unit 121 and the angle measuring unit 122, and the first corresponding to the first wall surface. Coordinate point information and second coordinate point information may be output.

More specifically, the measurement point coordinate calculating unit 131 may calculate the coordinates of the wall measurement point on the premise that each wall surface is vertically raised from the ground and is formed in a straight line shape instead of a curved surface.

For example, the measuring point coordinate calculating unit 131 uses the user's current position measured by the position measuring unit 123 as a reference point, and according to the distance information obtained from the distance measuring unit 121 , the wall surface in the direction pointed from the current position. It is possible to measure the pointing distance information to .

At this time, the measuring point coordinate calculating unit 131 may perform a cosine operation on the pointing distance information and the pitch angle information among the current three-dimensional angle information to calculate the parallel distance information of a line segment parallel to the ground, which is the user's current It may be determined by the two-dimensional distance information from the location to the wall. That is, it can be calculated as parallel distance information from the user to the wall = pointed distance information x COS (pitch angle).

In addition, the measurement point coordinate calculating unit 131 may calculate the coordinate point information of the wall corresponding to the current position by calculating the parallel distance information and the three-dimensional angle information important (yaw) angle information. Let the parallel distance information be l, the pitch angle be θ, the yaw angle information be Φ, and the current position is (x0, y0), according to the following equation (1), the current coordinate point information (x , y) can be calculated.

In addition, when the first coordinate point (x1, y1) of the first wall surface is measured, the measurement point coordinate calculating unit 131 may additionally measure the second coordinate point (x2, y2) of the first wall surface. Here, the number of coordinate points corresponding to each wall surface may be at least two, and two coordinate points for the wall surfaces sequentially in the first direction may be calculated according to the provision of the interface, respectively.

And, when two or more coordinate points of each wall are calculated, the wall information calculating unit 133 calculates wall structure information by processing a linear function operation corresponding to each coordinate point.

The wall information calculating unit 133 may determine each wall structure information in the form of a linear function equation (y = ax + b) connecting two coordinate points. Each wall structure information may include a measured wall portion and a predicted wall portion extending infinitely from the wall portion.

Further, the corner calculator 135 may calculate corner information connecting each wall based on the calculation of the intersection point of each wall structure information, and the corner information may include corner position information and corner angle information.

More specifically, the corner calculating unit 135 calculates the slope s of each of the first and second walls in order to calculate corner information between the first and second walls, and y based on one point of each wall. Intercept values can be calculated. (y_0 - s*x_0 = b)

Here, assuming that the first linear function of the first wall surface is ax + b = y and the second linear function of the second wall surface is cx + d = y, the x at the intersection point where x and y of the two linear functions coincide = (db)/(ac). Here, a may be the slope of the first wall surface, c may be the slope of the second wall surface, b may be the y-intercept of the first wall surface, and d may be the y-intercept of the second wall surface.

Further, the corner calculator 135 may calculate the y value by applying the previously calculated x coordinate value to the first wall surface or the second wall surface linear function. Accordingly, the obtained corner position information (x, y) may be calculated, and corner angle information may be calculated by calculating the slope period of the first linear function and the second linear function in response to the corner position information.

The spatial information determining unit 137 may determine spatial information connecting each corner and the wall surfaces based on the calculated wall structure information and corner information. For example, when a closed space is formed according to each corner and wall connection, the spatial information determiner 137 may determine spatial information and give a label such as room 1 .

On the other hand, the correction unit 138 may process the angle correction considering that the wall structure information is usually a right angle (90 degrees) in response to the corner angle information of the corner information.

For example, when the corner angle information corresponds to 90 degrees and is within a predetermined angle, the correction unit 139 may perform a correction process for angle-correcting the corner angle information by 90 degrees.

In addition, the redesign unit 139 may perform a redesign process of the interior floor plan information based on the user redesign input information corresponding to the indoor floor plan information corrected by the correction unit 139 . The redesign process according to an embodiment of the present invention may include a process of redesigning the interior floor plan information to an arbitrary scale according to a user redesign input.

For example, the redesign unit 139 may perform a wall length or polygonal redesign scaling of any scale, and may provide a vector-based scaling interface to the user so that the structural form of the overall interior floor plan is maintained during the redesign scaling. have.

Accordingly, it is possible to accurately structure the overall building or indoor floor plan, and through redesign and scaling of the structured floor plan, it is possible to construct an indoor floor plan having its own shape for each user.

4 is a flowchart for explaining a method of operating a portable terminal according to an embodiment of the present invention, and FIGS. 5 and 6 are diagrams showing a step-by-step process of generating indoor structure information according to an embodiment of the present invention.

First, the portable terminal 100 obtains user input and measurement information corresponding to the first coordinate point of the first wall surface (S101).

Then, based on the current location information, angle information, and distance information, a two-dimensionally transformed first coordinate point is calculated ( S103 ).

Thereafter, the portable terminal 100 acquires the user input and measurement information corresponding to the second coordinate point of the first wall surface (S105).

Then, based on the current location information, angle information, and distance information, a two-dimensionally transformed second coordinate point is calculated (S103).

Thereafter, the portable terminal 100 determines a linear function and structure information of the first wall connecting the first coordinate point and the second coordinate point (S109).

Then, the portable terminal 100 repeatedly performs calculation of coordinate points corresponding to one or more second wall surfaces, generation of a linear function, and determination of structure information according to continuous user input ( S111 ).

Then, according to the wall connection input, the portable terminal 100 calculates a corner position based on the linear function of the first wall and the linear function of the second wall adjacent in the first direction ( S115 ).

Then, the portable terminal 100 connects the first wall surface and the adjacent second wall surface based on the corner position information through the spatial information determining unit 137 (S117).

Then, the portable terminal 100 sequentially performs the connection process between the remaining second wall surfaces in the first direction until the first wall surface is connected again (S119).

Thereafter, the portable terminal 100 may generate and output the indoor floor plan information according to the user's completed input through the interface output unit 150 (S121).

In addition, the portable terminal 100 may perform corner angle correction through the correction unit 139 ( S123 ), and redesign the polygon or wall length by any scaling corresponding to the user input through the redesign unit 139 . can be processed (S124).

In addition, the portable terminal 100 may perform storage and upload processing of the redesigned indoor floor plan information according to a user input ( 125 ).

Here, the indoor floor plan information may be planar structure information including two-dimensional wall information and corner information, and the two-dimensional structure information itself is output, or is converted into three-dimensional indoor simulation information, so that the user can realistically experience three-dimensional (3D) information. It may be output as a graphic image.

5 to 6 show the wall and indoor structure information generation process according to each step. As shown in FIG. 5(A), the user points for identification of two coordinate points corresponding to each wall surface. In particular, the portable terminal 100 provides an interface for sequentially performing in the first direction, so that a normal wall connection can be made.

And, when the sequential wall generation is completed, a closed space may be formed by connecting a linear function of each wall and calculating corner information, as shown in FIG. 5(B), and the spatial information determining unit 137 According to the indoor structure information can be determined.

In addition, as shown in FIG. 6 , the correction unit 139 predicts the error value of each corner information, and when it is within a certain range compared to 90 degrees, it is possible to perform an angle redesign process of redesigning all of them by 90 degrees. , calculation as more natural indoor floor plan information becomes possible.

7 to 12 are diagrams for explaining a user interface output from a portable terminal according to an embodiment of the present invention.

7 and 8 show a wall measurement interface provided through the interface output unit 150, an interface for measuring two points for each wall may be provided to the user, and each time the two points are measured A graphic image in which one wall is generated may be output through the interface output unit 150 .

Also, referring to FIG. 8 , a wall extension line according to the generation of a wall may be output together, and the wall extension line may be a predicted line of a wall surface determined by a linear function and used for corner calculation.

And, Figures 9 and 10 show the wall connection interface when the user inputs the line connection/release button when all the wall surfaces are measured, and each wall surface is connected by the process of the present invention described above, Indoor structure information can be formed. The user can preview the result, and if the measurement is wrong, input the wire connection/disconnect button again to disconnect the wall connection.

Meanwhile, FIGS. 11 and 12 show the final corner angle redesign and creation completion interface, and the user can selectively input at least one of a corner angle correction function, a redesign setting information input function, or a virtual object mapping function. In addition, it is possible to selectively input whether or not to upload the indoor floor plan information that has been corrected, redesigned, or mapped to a virtual object to the cloud or a server.

13 is a flowchart schematically illustrating a redesign process according to an embodiment of the present invention.

Referring to FIG. 13 , the redesign unit 139 according to an embodiment of the present invention may perform an overall polygon calibration process and a wall length scaling process according to the user's input of the redesign setting information, and input the user's interface It can be processed so that accurate and personalized interior floor plans that fit the user's intentions can be generated and output by providing a more efficient redesign function while minimizing the amount of space required.

Accordingly, the portable terminal 100 receives the user input or redesign setting information based on the laser measurement value (S201), and based on the input redesign setting information, according to the polygon calibration process through the redesign unit 139 Angle and node position redesign processing (S203) and wall surface redesign according to polygon scaling processing are processed (S205).

Accordingly, the redesign unit 139 outputs an indoor floor plan based on the redesigned indoor structure information (S207), and the portable terminal 100 receives the redesigned indoor structure information according to a user confirmation input corresponding to the output indoor floor plan. You can save or upload.

Here, the redesign setting information may include polygon calibration redesign or polygon scaling redesign setting information, and each redesign process may be selectively performed according to the setting information.

In addition, whether each redesign process can be performed may be determined according to the shape, shape, or characteristic of the polygon obtained from the indoor structure information.

Accordingly, the redesign unit 139 according to an embodiment of the present invention performs only polygonal calibration redesign, or only polygonal scaling redesign, according to setting information and check whether it is possible to perform according to threshold setting for redesign, After performing polygon calibration redesign, optional processing such as polygon scaling redesign may be performed.

Hereinafter, the redesign process processed by the redesign unit 139 as described above is divided into a polygonal calibration redesign process and a polygonal scaling redesign process, and each will be described in more detail.

14 is a flowchart for explaining a polygon calibration-based angle and node position redesign process according to an embodiment of the present invention, and FIGS. 15 to 23 are exemplary diagrams schematically illustrating the redesign process step by step.

According to an embodiment of the present invention, since the coordinate point calculation and the corner position calculation process according to the user input and measurement are prediction processes, some differences may occur from the actual process. In particular, in an indoor structure, a corner should generally be set at a right angle (90 degrees or 270 degrees), but partial deformation may occur due to errors in measurement and prediction processes.

For example, if the corner angle of the polygon is 85 degrees to 95 degrees or 265 to 275 degrees, it will be more consistent with the actual indoor floor plan information to be redesigned to 90 degrees and 270 degrees, respectively, as corners in a building in reality. However, since the shape and length of the overall indoor structure information cannot be maintained when only a specific angle is modified, a more detailed redesign is required.

Accordingly, when the redesign setting information including the user's polygon calibration is input, the redesign unit 139 performs calibration for redesigning the overall node location according to the polygon information obtained from the indoor structure information, The shape of the information is maintained and the corner angles between the walls can be adjusted to reach a right angle (90 degrees or 270 degrees). This can be referred to as polygon calibration based angle and node position redesign process. Accordingly, the redesign setting information may include an adjustment threshold value of a corner angle between walls, and a corner angle within a threshold value may be adjusted to reach a right angle. However, this is due to the user redesign setting, and the user may not set the adjustment threshold value to reflect the actual measurement. In this case, the polygon calibration is not performed, and the initial node position and corner angle may be maintained. have.

Figure 15 (A) shows a polygon according to the indoor structure information before the polygon calibration redesign, Figure 15 (B) shows the polygon redesigned according to the indoor structure information after the polygon calibration redesign by the user's setting information input did it As shown in FIG. 15 , the polygon calibration redesign redesigns some node positions due to user input or prediction error to fit the right angle, while maintaining the overall shape to build the indoor structure information in a form closer to the actual measurement. make it possible

For this purpose, the polygon calibration redesign process will be described in more detail. First, referring to FIG. 14 , the redesign unit 139 obtains polygon information from indoor structure information to perform polygon calibration redesign, and sequentially indexes node coordinate information of the polygon in a first direction from the polygon ( S301 ). .

Then, the redesign unit 139 determines a CONVEX HULL area based on the indexed polygon node coordinates (S303).

The convex hull region may refer to a convex polygonal region configured to include all remaining nodes when some of the points (nodes) constituting the polygon are connected. Various general algorithms may be used to determine the convex hull region, and a Graham's scan method that can be performed in O(n) time according to the arrangement of nodes may be exemplified.

It consists of a list that sorts the edges of nodes in a clockwise or counterclockwise order, and sequentially indexes each node in a clockwise or counterclockwise direction, depending on whether it is included in the convex hull region, constituting the convex hull. A method to determine whether a node is a node.

16 is an exemplary view of a determined convex hull. Referring to FIG. 16 , a convex hull 310 that may include all nodes of a polygon 301 obtained from indoor structure information may be determined.

Thereafter, the redesign unit 139 forms a MINIMUM BOUNDING rectangle surrounding the convex hull region (S305).

The minimum bounding rectangle may be a rectangle with a minimum size surrounding the convex hull region, and as a result, may represent a rectangle with the smallest size surrounding the polygon 301 .

17 is an exemplary view of the formed minimum size rectangle. Referring to FIG. 17 , the smallest boundary rectangle 320 surrounding the polygon 301 obtained from the indoor structure information may be formed.

Thereafter, the redesign unit 139 indexes a first corner point at which a difference angle within a predetermined angle determined according to a threshold value input of the user redesign setting information is formed based on the right angle of the corner of the minimum boundary rectangle ( S307 ).

More specifically, referring to FIG. 18 , a first angle A1 and a second angle A2 with the minimum boundary rectangle 320 formed at the corner point A may be formed. And, A2 may be smaller than a preset difference angle of 10 degrees, for example. In this case, the redesign unit 139 may index the corner point A as the first corner point. When the indexing of the first corner points corresponding to all nodes is completed, a calibration redesign process corresponding to the indexed first corner points may be processed.

Specifically, the redesign unit 139 indexes the corner points, and the angle formed by the neighboring edges corresponds to the first corner points that are within a predetermined difference value compared to a right angle (90 degrees or 270 degrees), so that the neighboring edges are While forming a right angle, the node position of the first corner point is moved to a position to remain parallel to the adjacent minimum boundary rectangle 320 (S309).

More specifically, referring to FIG. 19 , the first corner points in which the angle formed by the neighboring edges is within a certain difference value compared to the right angle (90 degrees or 270 degrees) of the minimum boundary rectangle are A, B, C, etc. can

Accordingly, as shown in FIG. 20, the position coordinates may be moved to A' A', B to B', and C to C', and the edges formed by each position coordinate are adjacent to the smallest bounding rectangle ( 320) can be adjusted to remain parallel to the edge.

By maintaining the parallelism with the minimum boundary rectangle 320, the overall polygonal shape may be maintained by minimizing the influence and deformation between the previous corner angle and the next corner angle.

In addition, if the angles of the other first corner points are already redesigned to be right angles through the position movement of any one of the first corner points A, B, and C, the additional indexing and position movement process of the other first corner points will be omitted. can

On the other hand, the redesign unit 139 extracts a second non-orthogonal second corner point and two adjacent nodes among the remaining corner points other than the first corner point, and the first edge among the neighboring edges of the second corner point is the smallest adjacent edge. The positions of the second corner points and the two nodes are rotated so as to be parallel to the edge of the boundary rectangle (S311).

Then, the redesign unit 139 moves the position of the second corner point in the vertical or horizontal direction so that the remaining second edge among the neighboring edges adjacent to the rotationally moved second corner point is parallel to the edge of the adjacent minimum boundary rectangle. and (S313), the second corner point and neighboring nodes that have been rotated and moved vertically/horizontally are reversely rotated by the rotationally moved value and reinserted into the extracted position (S315).

As shown in FIG. 21, the steps S311 to S315 are performed by indexing the second corner point E, which requires a right angle redesign, among the corner points that are not indexed as the first corner point in direct contrast with the minimum boundary rectangle 320. For redesign, the second corner point area 302 including the second corner point E and two adjacent nodes D and F may be extracted and re-inserted after the calibration redesign process.

More specifically, as shown in FIG. 22A , the extracted second corner point area 302 may include corner points D, E, and F positioned in a triangular shape.

And, as shown in FIG. 22(B), the second corner point area 302 may be rotationally moved as a whole so that any one of the edges is parallel to the edge of the minimum boundary rectangle 320 shown by a dotted line. In FIG. 22B , the edges E-F may be moved to a position parallel to the minimum boundary rectangle 320 . According to this movement, it can be confirmed that the remaining edges E-D form a predetermined error angle with the minimum boundary rectangle 320 . In addition, the rotationally moved rotation angle may be stored in advance.

Accordingly, as shown in FIG. 22(C) , the redesign unit 139 determines that the remaining second edge ED among the neighboring edges adjacent to the rotationally moved second corner point is parallel to the edge of the adjacent minimum boundary rectangle. By moving the position of the second corner point (E) in the vertical or horizontal direction, it can be corrected to the redesigned position E'.

Then, the redesign unit 139, based on the previously stored rotation angle, the rotation and vertical/horizontal movement of the second corner point (E ') and the neighboring nodes (E, F) by the rotationally moved value by the reverse rotation , can be reinserted at the extracted position.

Here, when the redesign unit 139 redesigns only the position of the second corner point located in the middle among all the nodes of the second corner point region 302 , the overall shape is maintained in parallel with the minimum boundary rectangle 320 . This is because, in order to redesign the angle, if any one of the neighboring nodes, not the central point, is moved, the overall shape may be deformed again.

Then, the redesign unit 139 may perform the redesign in response to all polygon node coordinate points requiring the first corner point-based redesign or the second corner point-based redesign, and may output the execution result (S317) . Accordingly, the overall form of the redesigned is illustrated in FIG. 23 . Referring to FIG. 23 , as the existing corner point positions A, B, C, and E are modified to A', B', C', E', the overall shape is deformed to fit the right angle, completing the polygon calibration redesign process it can be

24 is a flowchart illustrating a polygon scaling redesign process according to an embodiment of the present invention.

According to an embodiment of the present invention, the redesign unit 139 may perform an appropriate scaling redesign corresponding to the wall length after the polygon calibration redesign is completed.

However, if the wall length is simply modified, the polygonal shape of the overall indoor structure information cannot be maintained and a closed loop cannot be formed. Therefore, a more efficient wall length redesign is required while minimizing user input to the interface.

Accordingly, the redesign unit 139 detects redesignable reference wall surfaces according to polygon information obtained from the indoor structure information, receives a redesign value corresponding thereto, and performs scaling on the remaining entire wall surfaces, While maintaining the polygonal shape of the structural information, the walls can be adjusted to have a redesigned length value according to a user input as a whole. This enables convenient redesign while minimizing user input, which can be referred to as a wall length scaling redesign process.

To this end, referring to FIG. 24 , first, the redesign unit 139 acquires wall information and corner information of an interior floor plan that has been subjected to angle redesign (S401).

Then, the redesign unit 139 checks whether or not a wall that forms a right angle with both adjacent wall surfaces is detected (S403).

More specifically, for example, the redesign unit 139 normalizes the vectors of each wall (edge) obtained from polygon information of the indoor floor plan, and determines whether the absolute value of the vector dot product between two adjacent vectors is within a certain range corresponding to 0. By checking, it is possible to identify a wall that forms a right angle with both adjacent wall surfaces.

Here, the wall which forms a right angle with both the adjacent wall surfaces may be a wall that can be redesigned by receiving a redesign value, and accordingly, such a wall surface may be referred to as a scalable wall.

When the redesignable wall surface is detected, the redesign unit 139 selects the longest scalable wall among the detected redesignable wall surfaces (S405).

Then, the redesign unit 139 checks whether orthogonal scalable walls that are perpendicular to both adjacent wall surfaces are detected from among the walls perpendicular to the first wall surface (S407).

Here, when such a redesignable vertical wall surface is not detected, the redesign unit 139 drives the equal ratio scale redesign module, and when detected, drives the two-dimensional polygonal scale redesign module, each different scale Handle the redesign process to run.

First, when the equal ratio scale redesign is driven because vertical wall surfaces that are perpendicular to both adjacent wall surfaces are not detected, the redesign unit 139 determines the scale value of the first wall surface according to a user input corresponding to the first wall surface. do (S413).

Then, the redesign unit 139 processes the wall surfaces perpendicular to the first wall surface as the determined scale value and performs scaling redesign to calculate equal ratio vectors (S415).

For example, if the existing measurement value of the first wall surface is A, the redesign unit 139 may obtain a redesign value B corresponding to the redesignable first wall surface according to a user input. Accordingly, the scale value may be calculated as B/A.

Then, the redesign unit 139 processes the two-dimensional coordinate transformation in order to apply the value calculated as the scale value B/A to the vector of the vertical wall surface connected to the first wall surface, and applies the coordinate-converted scale value to the first wall surface. Scaling can be performed by applying to the vertical wall surface connected to For example, when a scale value corresponding to the first wall surface is applied as (2, 3), the scale vector to be applied to the vertical wall surface is (-3, 2), and may be converted while maintaining the same ratio.

On the other hand, when a redesignable vertical wall surface is detected, the redesign unit 139 calculates the second vector and second scale values from the longest wall among the detected redesignable vertical wall surfaces according to the two-dimensional polygonal scale redesign process. obtained (S409), and using the first vector and the first scale value corresponding to the first wall surface, and the second vector and the second scale value, the rotation matrix-based two-dimensional polygon scaling is processed (S411).

Here, the redesign unit 139 uses the existing corner position information of the redesign target, the first vector and the first scale value corresponding to the first wall surface, and the second vector and the second scale value, based on the rotation matrix. By processing the two-dimensional polygonal scaling, it is possible to perform a scaling process that maintains the overall shape corresponding to each wall surface.

To describe the rotation matrix-based processing in more detail, the redesign unit 139 calculates a first relative angle (RelativeAngle) between the first vector and the X-axis (1, 0), and using the rotation matrix, the first According to the relative angle, rotate all the nodes of the redesign target area in the X-axis direction.

Then, the redesign unit 139 multiplies the X-coordinate values of the rotated nodes by the first scale value, and processes the reverse rotation (-RelativeAngle) of the first relative angle with respect to the nodes.

The redesign unit 139 calculates a second relative angle (RelativeAngle) between the second vector and the X-axis (1, 0), and uses a rotation matrix to redesign the second vector in the X-axis direction according to the second relative angle. Rotate all nodes in the target area.

Then, the redesign unit 139 multiplies the X-coordinate values of the rotated nodes by the second scale value, and processes the reverse rotation (-RelativeAngle) of the second relative angle with respect to the nodes.

According to such processing, it is possible to adjust the wall surfaces to have more accurate length values while maintaining the polygonal shape of the indoor structure information.

25 to 30 are diagrams illustrating a user interface for polygon scaling and a redesign result.

First, FIGS. 25 to 27 show inputs and results according to equal ratio scaling. Referring to FIG. 25 , the portable terminal 100 is capable of redesigning detected by the redesign unit 139 through the user interface. It may indicate that a wall is output on the display and redesign according to a user input is possible only for the corresponding wall.

As shown in FIG. 25 , the first wall 401 having vertical walls connected to both ends is Wall 1, and it can be displayed through the portable terminal 100 that overall scaling is possible according to the redesign input. .

Then, as shown in FIG. 26 , the user may measure the redesign value corresponding to the redesignable wall with the measurement unit 120 or directly input the redesign value.

Accordingly, as shown in FIG. 27 , the scale ratio according to the scale redesign corresponding to the first wall surface 401 is applied to the remaining vertical wall surfaces 402 and the processing result of the equal ratio scale redesign is processed in the portable terminal It can be output through (100).

That is, when the wall length of the existing first wall surface 401 is redesigned from 7.163 m to 7.200 m as shown in FIGS. 27(A) and 27(B), the scale value can be defined as 7200/7163 = 1.0051654335. Also, as shown in FIGS. 27(C) and 27(D), the length of the remaining vertical wall surface 402 according to the equal ratio scaling can also be scaled to 8.96 m by multiplying 1.0051654335 with respect to 8.92 m.

Meanwhile, FIGS. 28 to 30 show inputs and results according to the two-dimensional polygon scaling. Referring to FIG. 28 , the portable terminal 100 detects the redesign detected by the redesign unit 139 through the user interface. Possible walls may be output on the display, and it may indicate that redesign according to a user input is possible only for the corresponding wall.

As shown in FIG. 28, a first wall surface 401 with a length of 13287 mm in which the wall surfaces connected to both ends are vertical, and a second wall surface with a length of 4896 mm in which the wall surfaces connected to both ends are perpendicular to the first wall surface ( 403) may exist, and the possibility of overall scaling according to each redesign input may be displayed through the portable terminal 100 .

And, as shown in FIG. 29 , the user may measure the redesign values 13000 mm and 5000 mm respectively corresponding to the redesignable wall with the measuring unit 120 or may directly input the redesign values.

Accordingly, as shown in FIG. 30 , the scale redesign corresponding to the first wall surface 401, the scale redesign corresponding to the second wall surface 403 corresponding thereto, and the remaining vertical wall surface 404 correspond to One rotation matrix-based two-dimensional polygonal scaling redesign is applied, so that each processed result may be output through the portable terminal 100 .

That is, when the wall length of the existing first wall surface 401 is redesigned from 13287 mm to 13000 mm as shown in FIGS. 30 (A) and 30 (B), the first scale value can be defined as 0.9783999398, As shown in FIGS. 30(C) and 30(D), when the wall length of the existing second wall surface 403 is redesigned from 4896 mm to 5000 mm, the second scale value may be defined as 1.0212418301. In addition, as shown in FIGS. 30(E) and 30(F), the length of the remaining vertical wall surface 404 according to the two-dimensional polygonal scaling redesign is 5.96 m by multiplying the first scale value from the existing 6.09 m can be scaled to

Accordingly, a convenient redesign is possible while minimizing user input, and the overall proportion and the two-dimensional polygonal shape can be maintained.

31 is a flowchart illustrating a virtual object mapping process according to an embodiment of the present invention, and FIGS. 32 and 33 are diagrams illustrating a user interface for virtual object mapping.

Referring to FIG. 31 , the virtual object mapping unit 180 according to an embodiment of the present invention outputs a virtual object mapping interface for mapping virtual object information corresponding to each wall of an indoor floor plan according to indoor structure information. It is provided to the user (S301).

Then, the virtual object mapping unit 180 selects the first wall and virtual object type information according to the user input (S303).

Thereafter, the virtual object mapping unit 180 receives contour location information of the virtual object corresponding to the first wall (S305).

Here, the contour position information may be determined differently according to the virtual object type information as described above. For example, in the case of a rectangular object such as a window or a door, the first position of the upper left and the second position of the lower right may include.

Then, the virtual object mapping unit 180 generates virtual object information based on the contour position information (S307).

For example, the virtual object mapping unit 180 extracts the first location information and the second location information of the rectangular object from the contour location information, and based on the input first location information and the second location information Thus, virtual object information such as a window or door can be created.

Here, the first location information may be two-dimensional location information in which the upper left position is mapped on the first wall surface, and the second position information is two-dimensional position information in which the lower right position is mapped on the first wall surface. can Each of the first position and the second position information can be more accurately measured by the current position information, angle information, and distance information calculation process, such as the above-described first wall coordinate point calculation process.

In addition, the generated image object information may be mapped to a texture corresponding to the virtual object type information such as a window and a door selected by the user, and outputted on a 2D indoor floor plan or a 3D indoor simulation graphic interface.

Thereafter, the virtual object mapping unit 180 may map the generated virtual object information to the first wall information, configure mapping information according to the mapping processing (S309), and apply the configured mapping information to the indoor floor plan information can be coupled to (S311).

Accordingly, the indoor structure information including the indoor floor plan information may be stored and managed in a cloud server or a server device by matching the user account information of the portable terminal 100 .

For example, as shown in FIG. 32 , the virtual object mapping unit 180 may generate a virtual object such as a door and a window and output a virtual object mapping interface that can be mapped to an indoor floor plan, and the mapping interface is It may include a virtual object type selection interface such as a door creation item and a window creation item, and may provide a user with pointing information for selection of the first wall surface and acquisition of contour position information.

Accordingly, the user can select the first wall surface of the interior plan view as shown in FIG. 32, and by pointing to each of the first and second positions, virtual object information such as doors and windows can be created and mapped. have.

And, as shown in FIG. 33 , when the virtual object is mapped, the virtual object mapping unit 180 outputs the 2D indoor floor plan information to which the virtual object is mapped through the interface output unit 150 or the 3D indoor It can be output by merging on the simulation screen (not shown).

According to the completion of the indoor floor plan information to which the virtual object information is mapped, the user freely creates a virtual object of a desired type and a desired size according to simple first and second position pointing, and wants to It can be appropriately placed in a location, thus providing a user interface that allows users to easily build an arbitrary interior floor plan of their own in a variety of ways.

The method according to the present invention described above may be produced as a program to be executed by a computer and stored in a computer-readable recording medium. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape. , a floppy disk, an optical data storage device, and the like, and also includes those implemented in the form of a carrier wave (eg, transmission through the Internet).

The computer-readable recording medium is distributed in network-connected computer systems, so that computer-readable codes can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the method can be easily inferred by programmers in the art to which the present invention pertains.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the claims Various modifications may be made by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

Claims (20)

A method of operating a portable terminal, comprising:
obtaining measurement information corresponding to a first coordinate point of a first wall surface and a second coordinate point of the first wall surface;
determining structure information of the first wall surface connecting the first coordinate point and the second coordinate point based on a linear function operation of the first coordinate point and the second coordinate point;
completing the indoor structure information including one or more closed spaces according to the sequential connection processing of other wall surfaces in a first direction corresponding to the first wall surface;
providing a virtual object mapping interface corresponding to the indoor structure information; and
generating virtual object information mapped to the indoor structure information according to the virtual object mapping interface input
A method of operating a portable terminal. According to claim 1,
The virtual object information is
including contour location information of a virtual object mapped to the first wall surface of the indoor structure information
A method of operating a portable terminal. 3. The method of claim 2,
The contour location information includes one or more location information determined according to the type of the virtual object.
A method of operating a portable terminal. 4. The method of claim 3,
When the virtual object type is a rectangular object, the one or more location information includes first location information corresponding to the upper left and second location information corresponding to the lower right
A method of operating a portable terminal. 5. The method of claim 4,
The first location information and the second location information are determined according to a user's pointing input.
A method of operating a portable terminal. According to claim 1,
Determining the structure information comprises:
obtaining a user input and measurement information corresponding to a first coordinate point of a first wall surface;
calculating the position information of the first coordinate point transformed in two dimensions based on the user position information, the 3D angle information, and the distance information obtained from the measurement information;
obtaining user input and measurement information corresponding to a second coordinate point of the first wall;
calculating position information of a two-dimensionally transformed second coordinate point based on the three-dimensional angle information and distance information obtained from the measurement information;
determining structure information of the first wall surface connecting the first coordinate point and the second coordinate point based on a linear function operation; and
and generating the indoor structure information including the structure information of the first wall.
A method of operating a portable terminal. According to claim 1,
Calculating the location information includes:
The first pointing distance information from the current location to the first wall surface in the pointed direction and the first parallel distance information to the first wall surface calculated based on the three-dimensional angle information are applied to the first coordinate point of the first wall surface. Comprising the step of calculating as the corresponding distance information
A method of operating a portable terminal. According to claim 1,
The completion step is
Further comprising the step of determining the structure information of the second wall surface adjacent to the first wall surface in the first direction,
Based on the linear function information of the first wall and the linear function information of the second wall, the first wall and the second wall are connected according to corner information calculation of the structure information of the first wall and the second wall further comprising the step of processing
A method of operating a portable terminal. According to claim 1,
Further comprising the step of performing a redesign process using the indoor structure information according to the user's redesign setting information input,
The redesign process includes redesigning the angle and node position according to the polygon calibration process corresponding to the indoor structure information,
The polygon calibration process is,
A process of redesigning one or more corner angles to be a right angle by performing a position movement of a corner point based on polygonal node coordinate information corresponding to the indoor structure information according to a threshold value of the user redesign setting information
A method of operating a portable terminal. 10. The method of claim 9,
The process of redesigning at the right angle is
A process of determining a convex hull area based on polygon node coordinate information corresponding to the indoor structure information, forming a minimum boundary rectangle using the convex hull area, and moving a corner point using parallel to the minimum boundary rectangle containing
A method of operating a portable terminal. 10. The method of claim 9,
The redesign process includes a wall scaling redesign process corresponding to the indoor structure information,
The scaling redesign process is
From the indoor structure information, detecting a wall that is perpendicular to both adjacent wall surfaces as a redesignable wall surface, and performing either an equal ratio scale redesign or a two-dimensional polygonal scale redesign according to the corresponding redesign value input including treatment
A method of operating a portable terminal. In a portable terminal,
a measurement unit configured to obtain measurement information corresponding to a first coordinate point of a first wall surface and a second coordinate point of the first wall surface;
Based on the linear function calculation of the first coordinate point and the second coordinate point, the structure information of the first wall surface connecting the first coordinate point and the second coordinate point is determined, and the structure information corresponding to the first wall surface is determined. a spatial information generating unit that completes the indoor structure information including one or more closed spaces according to sequentially connecting other wall surfaces in a first direction; and
A virtual object mapping unit providing a virtual object mapping interface and generating virtual object information mapped to the indoor structure information according to a user input corresponding to the virtual object mapping interface
portable terminal. 13. The method of claim 12,
The virtual object information is
including contour location information of a virtual object mapped to the first wall surface of the indoor structure information
portable terminal. 14. The method of claim 13,
The contour location information includes one or more location information determined according to the type of the virtual object.
portable terminal. 15. The method of claim 14,
When the virtual object type is a rectangular object, the one or more location information includes first location information corresponding to the upper left and second location information corresponding to the lower right
portable terminal. 16. The method of claim 15,
The first location information and the second location information are determined according to a user's pointing input.
portable terminal. 13. The method of claim 12,
The measuring unit obtains user input and measurement information corresponding to a first coordinate point of a first wall surface, and obtains user input and measurement information corresponding to a second coordinate point of the first wall surface,
Based on the user location information, 3D angle information, and distance information obtained from the measurement information, the 2D-transformed first coordinate point location information is calculated, and the 3D angle information and distance information obtained from the measurement information Based on the coordinate calculation unit for calculating the position information of the two-dimensionally transformed second coordinate point,
The spatial information generating unit determines the structure information of the first wall connecting the first coordinate point and the second coordinate point based on a linear function calculation, and the indoor structure including the structure information of the first wall surface generating information
portable terminal. 13. The method of claim 12,
In response to the user's input of redesign setting information, further comprising a redesign unit for performing redesign processing using the indoor structure information
portable terminal. 19. The method of claim 18,
The redesign process includes redesigning the angle and node position according to the polygon calibration process corresponding to the indoor structure information,
The polygon calibration process is,
According to the threshold value of the user redesign setting information, through a corner point position movement based on the polygon node coordinate information corresponding to the indoor structure information, comprising the process of redesigning one or more corner angles to be a right angle
portable terminal. 20. The method of claim 19,
The redesign process includes a wall scaling redesign process corresponding to the indoor structure information,
The scaling redesign process is
From the indoor structure information, detecting a wall that is perpendicular to both adjacent wall surfaces as a redesignable wall surface, and performing either an equal ratio scale redesign or a two-dimensional polygonal scale redesign according to the corresponding redesign value input including treatment
portable terminal.

Images