KR102329027B1 - Method for managing virtual object using augment reality and big-data and mobile terminal executing thereof - Google Patents

Abstract

The present invention relates to a virtual object management method using augmented reality and big data. According to an embodiment of the present invention, a first virtual image of a plant-like virtual object is synthesized at a specific point in a real image obtained for a specific area in a mobile terminal at a first time point, and the real image and the first virtual image are stored. However, the first virtual image is generated and stored so that growth, reaction or both are performed based on time information and surrounding environment information of at least a specific area or a specific point; Time information at the second point in time according to the start of augmented reality driving in the mobile terminal at the second point in time outside the specific area, surrounding environment information about the specific area or point at the second time point, and first information applied to the mobile terminal generating a second virtual image in which growth, reaction, or both are performed based on the change; and displaying the second virtual image to be synthesized on the real image and updating and storing the second virtual image, wherein the growth of the first and second virtual images is a virtual object in addition to the passage of time from the time of generation of the immediately stored image. Augmented reality and big data, characterized in that it is made from the immediately stored image based on at least one of the first information applied to the mobile terminal according to the lapse of time related to the growth of the surrounding environment information and the growth of the virtual object A virtual object management method using In addition, a mobile terminal for performing virtual object management using augmented reality and big data is proposed.

Description

A method for managing virtual objects using augmented reality and big data and a mobile terminal performing the same

The present invention relates to a virtual object management method using augmented reality and big data, and a mobile terminal for performing the same. More specifically, it relates to a virtual object management method for performing management of a plant-type virtual object using augmented reality and big data, and a mobile terminal for performing the same.

Augmented reality (AR) is a technology derived from one field of virtual reality (VR), and refers to a combination of the real world and a virtual experience. That is, it is a computer graphics technique that synthesizes virtual objects in the real environment and makes them look like objects existing in the original environment. Virtual reality interacts with the user by creating all environments as a virtual environment through a computer, but augmented reality has a feature that the user can interact with virtual objects based on the real world to provide an improved sense of reality. Accordingly, in augmented reality, the user recognizes the real environment in which he is located, and at the same time recognizes virtual information expressed on the real image.

Conventional augmented reality technology has mostly inserted content such as advertisements into real images or synthesized animal objects or active objects. A method of realizing augmented reality by synthesizing content such as advertisements, animal objects, or active objects into real images has limitations in directly applying it to virtual objects such as plants with little activity or change.

Republic of Korea Patent Publication No. 10-2012-0009638 (published on February 02, 2012) Republic of Korea Patent Publication No. 10-2011-0071210 (published on June 29, 2011) Republic of Korea Patent Publication No. 10-2011-0004974 (published on January 17, 2011) Republic of Korea Patent Publication No. 10-2011-0104686 (published on September 23, 2011)

An object of the present invention is to provide a technology for managing virtual objects using augmented reality and big data for plant-type virtual objects in order to solve this problem.

In order to achieve the above object, according to one aspect of the present invention, in a mobile terminal at a first point of view, a first virtual image of a plant-like virtual object is synthesized at a specific point in a real image acquired for a specific area, and the real Storing an image and a first virtual image, wherein the first virtual image is generated and stored so that growth, reaction, or both are performed based on at least time information and surrounding environment information of a specific region or a specific point; In the mobile terminal at the second time point in the other area outside the specific area, the time information of the second time point according to the start of augmented reality driving, the surrounding environment information about the specific area or the specific point at the second time point, and the first applied to the mobile terminal generating a second virtual image in which the changed growth, reaction or both are performed based on the information; and displaying, in the mobile terminal, a second virtual image to be synthesized on the real image, and updating and storing the second virtual image, wherein the growth of the first and second virtual images is a time from the creation time of the immediately stored image. Augmentation, characterized in that it is made from the immediately stored image based on at least one information of the first information applied to the mobile terminal according to the lapse of time related to the growth of the virtual object and the surrounding environment information related to the growth of the virtual object in addition to the lapse A virtual object management method using reality and big data is proposed.
In one example, the step of storing the real image and the first virtual image in the mobile terminal includes: real-time surrounding environment information of a specific area or a specific point in addition to the location and time of a specific area or a specific point in the mobile terminal, and the surroundings according to the lapse of time acquiring at least one piece of information including real-time surrounding environment information among the environment information and the first information applied to the mobile terminal; Acquiring a real image about the location or surrounding location of a specific area or a specific point in the mobile terminal; determining a planting position of a virtual object determined according to an initial selection or initial setting among positions in a real image or according to an existing planting as a specific point; In the case of synthesizing and displaying the first planting image of a virtual object as the first virtual image at a specific point in the real image determined according to the initial selection or initial setting, or after the initial storage of the first planting image of the virtual object, in addition to the acquired time information The growth information of the virtual object to be grown is calculated from the last stored image based on at least one of the surrounding environment information according to the lapse of time and the first information applied to the mobile terminal, or from the real-time surrounding environment information and the first information applied to the mobile terminal. Calculating reaction information of the virtual object to be changed from the immediately stored image based on at least one piece of information, or at least one of real-time surrounding environment information, surrounding environment information according to time lapse, and first information applied to the mobile terminal in addition to the acquired time information A step of generating a first virtual image by calculating growth and reaction information of a virtual object to be grown and changing from the immediately stored image based on the above information, and synthesizing and displaying the generated first virtual image at a specific point in the acquired real image ; and storing or updating the acquired real image and the first virtual image.

At this time, in one example, the real image is a moving image or a still image, and the surrounding environment information includes real-time or time-lapse weather information including any one or more of temperature, precipitation, sunshine, wind, and humidity information. wherein the weather information according to the lapse of time is information obtained from big data, and the first information is at least one of external environment information applied to the mobile terminal and touch or input information about the virtual object displayed on the mobile terminal and its surroundings. Including touch or input information, the external environment information includes any one or more of shaking information of the mobile terminal and blowing information to the mobile terminal, and the touch information about the virtual object or its surroundings includes touching, shaking, pushing or pulling, It is touch input information for performing any one or more of cutting and picking, and the input information about the virtual object or its surroundings is the installation of virtual facilities or virtual supports to protect the virtual object, watering, temperature control, control work, nutritional supplements, etc. It may be information of any one or more of nutrition management such as fertilization cycle, surrounding management such as weed removal, crop management such as pruning or thinning, and harvest.

In addition, at this time, in one example, the weather information according to the lapse of time is any one or more information of temperature, precipitation, and sunlight, and is an average of a value according to an elapsed day or an elapsed section, a pattern or an average of the entire time lapse, and the growth of the virtual image is The input information as the basis is made during the lapse of time from the start of the augmented reality operation for the creation of the last stored image to the start of the augmented reality operation for the generation of the virtual image at the time, and the installation of a virtual facility or virtual support to assist the growth , watering, temperature control, control work, nutrition management, perimeter management, and crop management, and the response of the second virtual image is at least one of wind, shaking or blowing, touch input information, crop management, and harvest. can be determined accordingly.

delete

In one example, the step of storing the real image and the first virtual image may include, before the specific point is determined according to the initial selection or initial setting, during a past setting period regarding soil, climate, or both for a specific area or a specific point. The method may further include a step of determining or comparing the growth suitability of a preliminarily selected virtual object based on the big data environment information of , or receiving the determination result and then finally selecting the virtual object.

Also in one example, the virtual object management method includes: in the mobile terminal, after the step of updating and storing the second virtual image, obtain real-time shipment and price information of agricultural products corresponding to the harvest of the virtual object, and obtain the yield of the virtual object and providing information to determine the harvest time; and obtaining, in the mobile terminal, a sale price according to virtual shipment of a harvest of a virtual object according to a harvest amount selected according to the provision and a harvest time, and determining an expected profit.

In another example, the real image obtained with respect to the location of a specific area or a specific point in the mobile terminal is obtained through a mobile terminal in a specific area or acquired through purchase or update through an app set regardless of the location of the mobile terminal. It could be a video.

In this case, in one example, a specific point within a specific area is individually matched for each mobile terminal that manages virtual objects, or is matched by a group of mobile terminals performing joint management on virtual objects, or a plurality of points that are individually or mixedly matched for each group is adjacent, and when the first virtual image is synthesized and displayed on the real image, the virtual image about the adjacent virtual object managed by another mobile terminal at the adjacent point included in the real image is also displayed, The image obtained through the update may represent some or all of the four seasons, represent a 360-degree view, or a mixture of some or all of the four seasons and a 360-degree view.

Also, in one example, the virtual object management method is a method performed by a game of a mobile terminal, and when the time information is information about the passage of time, it is proportionally increased than the real time according to the setting, or the growth and reaction of the virtual object according to the setting Virtual time-lapse information that is intermittently increased from real time according to the characteristics of growth and reaction or increased from real time according to a user's arbitrary setting. The surrounding environment information according to the information may be information estimated and calculated based on past big data environment information.

Next, in order to achieve the above object, according to another aspect of the present invention, a camera unit for acquiring a real image about a specific area including a specific point; a location information obtaining unit for obtaining location information of the mobile terminal; a communication unit that communicates with the outside; a memory unit for storing the real image acquired through the camera unit or acquired through the app and the virtual image synthesized on the real image; a touch interface unit that receives a user's input and displays an image; a point determination unit for determining a specific point determined as a planting location of a virtual object according to an initial selection or initial setting among locations in a real image; Augmented reality driving based on information including at least the surrounding environment information among the first information applied to the mobile terminal and the surrounding environment information of the specific area or specific point obtained through the communication unit in addition to the time information of the specific area or specific point obtained from the mobile terminal a virtual image generating module for generating a virtual image of a plant-type virtual object in which growth, reaction, or both are performed from the stored image immediately prior to initiation; and an image synthesizing module that synthesizes a virtual image at a specific point in the real image and provides the synthesized image to be displayed through a touch interface unit, wherein at least a virtual image among the real image and the virtual image stored in the memory unit is stored at the time of storage. The growth of the virtual image generated by the virtual image generation module is updated and stored according to the lapse of time from the time of creation of the last saved image, and the surrounding environment information according to the lapse of time related to the growth of the virtual object and the time lapse related to the growth of the virtual object. A mobile terminal for performing virtual object management using augmented reality and big data is proposed, characterized in that it is made from the image stored immediately before on the basis of at least one or more of the first information applied to the mobile terminal according to the present invention.
In one example, the mobile terminal provides real-time surrounding environment information of a specific area or a specific point from an external server through a communication unit in addition to the location and time of a specific area or a specific point, and surrounding environment information over time from an external server through the communication unit and at least one or more pieces of information including real-time surrounding environment information among the first information applied to the mobile terminal, and the virtual image generation module is configured according to the lapse of time in addition to the acquired time information after the initial storage of the first planting image of the virtual object. Based on at least one of the surrounding environment information and the first information applied to the mobile terminal, the growth information of the virtual object to be grown is calculated from the last stored image, or at least one or more of the real-time surrounding environment information and the first information applied to the mobile terminal. Based on at least one of the reaction information of the virtual object to be changed from the immediately stored image based on A virtual image is generated by calculating growth and reaction information of a virtual object to be grown and changed from the immediately stored image, and the image synthesis module initially plants the virtual object as a virtual image at a specific point in the real image determined according to the initial selection or initial setting. The image is synthesized and displayed or the virtual image generated by the virtual image generating module is synthesized and displayed at a specific point in the acquired real image, and the memory unit may store or update the acquired real image and the virtual image.

At this time, in one example, the real image is a moving image or a still image, and the surrounding environment information is real-time including any one or more of temperature, precipitation, sunlight, wind, and humidity information obtained from an external server through a communication unit. or weather information according to the lapse of time, the weather information according to the lapse of time is information obtained from big data, and the first information is external environment information applied to the mobile terminal and a virtual object displayed on the mobile terminal or its surroundings. includes at least touch or input information among touch or input information for It is touch input information for performing any one or more of touching, shaking, pushing, pulling, breaking, and picking, and the input information about the virtual object or its surroundings includes installation of a virtual facility or virtual support to protect the virtual object, watering, It may be information about any one or more of temperature control, control work, nutritional management such as nutrients or fertilization cycle, surrounding management such as weed removal, crop management such as pruning or thinning, and harvest.

In addition, at this time, in one example, the weather information according to the lapse of time is any one or more information of temperature, precipitation, and sunlight, and is an average of a value according to an elapsed day or an elapsed section, a pattern or an average of the entire time lapse, and the growth of the virtual image is The input information as the basis is made during the lapse of time from the start of the augmented reality operation for the creation of the last stored image to the start of the augmented reality operation for the generation of the virtual image at the time, and the installation of a virtual facility or virtual support to assist the growth , watering, temperature control, control work, nutrition management, perimeter management, and crop management. can

delete

In another example, before the specific point is determined according to the initial selection or initial setting, big data environmental information for the past set period regarding soil, climate, or both for a specific area or specific point acquired through the communication unit Based on the determination or comparison determination of growth suitability of the preselected virtual object, or after receiving the determination result, the virtual object may be finally selected through the touch interface unit.

Also, in one example, real-time shipment and price information of agricultural products corresponding to the harvest of the virtual object is obtained through the communication unit, and the mobile terminal, based on the obtained real-time shipment and price information of agricultural products, the harvest amount and harvest time of the virtual object It may further include a harvest determination module for calculating and providing determination information, obtaining a sale price according to virtual shipment of a harvest according to the selected yield and harvest time according to the provision, and determining an expected profit.

In addition, in one example, the real image obtained with respect to the location of a specific area or a specific point is acquired through a camera unit in a mobile terminal in a specific area or acquired through purchase or update through an app set regardless of the location of the mobile terminal. It could be a video.

In one example, a specific point within a specific area is individually matched for each mobile terminal that manages virtual objects, is matched for each group of mobile terminals performing joint management on virtual objects, or a plurality of points that are individually or mixedly matched are adjacent When a virtual image is synthesized and displayed on a real image, a virtual image about an adjacent virtual object managed by another mobile terminal at an adjacent point included in the real image is also displayed and acquired through purchase or update. One image may represent some or all of the four seasons, a 360 degree view, or a mixture of some or all of the four seasons and a 360 degree view.

Also, in one example, the virtual object is managed on the game of the mobile terminal, and when the time information is information about the passage of time, it is proportionally increased than the real time according to the setting, or growth, reaction or growth and reaction of the virtual object according to the setting Virtual time-lapse information intermittently increased from the real time according to the characteristics of the user or increased from the real time according to the user's arbitrary setting. The environmental information may be information estimated and calculated based on past big data environmental information.

According to one example of the present invention, it is possible to implement management of a plant-type virtual object using augmented reality and big data. For example, according to this, virtual experience technology for plant cultivation can be secured.

According to various embodiments of the present invention, it is apparent that various effects not directly mentioned may be derived by those of ordinary skill in the art from various configurations according to the embodiments of the present invention.

1 is a flowchart schematically illustrating a virtual object management method using augmented reality and big data according to an embodiment of the present invention.
2 is a flowchart schematically illustrating a part of a virtual object management method using augmented reality and big data according to another embodiment of the present invention.
3 is a flowchart schematically illustrating a part of a virtual object management method using augmented reality and big data according to another embodiment of the present invention.
4 is a flowchart schematically illustrating a virtual object management method using augmented reality and big data according to another embodiment of the present invention.
5 is a block diagram schematically illustrating a mobile terminal that performs virtual object management using augmented reality and big data according to another embodiment of the present invention.
6 is a block diagram schematically illustrating a mobile terminal that performs virtual object management using augmented reality and big data according to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention for achieving the above object will be described with reference to the accompanying drawings. In this description, the same reference numerals mean the same components, and in order to facilitate the understanding of the present invention to those of ordinary skill in the art, the secondary description may be omitted.

It should be noted that, although a singular expression is described in this specification, it may be used as a concept representing the whole of a plurality of components unless it is contrary to the concept of the invention or is clearly different or contradictory. In the present specification, descriptions such as 'comprising', 'having', 'comprising', 'comprising' and the like should be understood as the possibility of the presence or addition of one or more other elements or combinations thereof.

In this specification, 'first', 'second', etc. do not indicate the order or rank of each component, but are used to distinguish each component from each other.

[How to manage virtual objects using augmented reality and big data]

First, a virtual object management method using augmented reality and big data according to an aspect of the present invention will be described with reference to FIGS. 1 to 4 . In addition, embodiments of a mobile terminal performing virtual object management using augmented reality and big data, which will be described later, and FIGS. 5 and 6 may be referred to.

1 is a flowchart schematically illustrating a virtual object management method using augmented reality and big data according to an embodiment of the present invention, and FIG. 2 is a flowchart using augmented reality and big data according to another embodiment of the present invention. It is a flowchart schematically showing a part of a virtual object management method, and FIG. 3 is a flowchart schematically showing a part of a virtual object management method using augmented reality and big data according to another embodiment of the present invention, and FIG. It is a flowchart schematically illustrating a virtual object management method using augmented reality and big data according to another embodiment of the present invention.

1 to 4, a virtual object management method using augmented reality and big data according to an example includes a real image and a first virtual image storage step (S100, S100', S100"), a second virtual image creation step (S300) and the second virtual image update storage step (S400) Each step will be described in detail.

First, the real image and the first virtual image storage step (S100) of FIG. 1 will be described. In the storage of the real image and the first virtual image (S100), the first virtual image of the plant-like virtual object is synthesized at a specific point in the real image acquired for the specific region in the mobile terminal at the first time point, and the real image and the first Save the virtual image. For example, the mobile terminal is a smart phone, a tablet PC, a notebook computer, a PDA, etc., but is not limited thereto, and a communication and portable information device is sufficient. The real image obtained for a specific area in the mobile terminal may be, for example, a real image obtained through a camera of the mobile terminal, or may be a real image purchased or obtained through an app installed in the mobile terminal in another example. A specific area includes a specific point. For example, a specific point is a point where a plant-type virtual object is planted. Plant-type virtual objects are virtual objects, not real objects included in real images, and are combined with real images to realize augmented reality. At this time, the virtual image of the virtual object is synthesized with the real image, and augmented reality is realized.

In this case, the first virtual image is generated so that growth, reaction, or both are performed based on at least time information and surrounding environment information of a specific region or a specific point. The first virtual image may be synthesized with the real image to implement augmented reality, and may be stored separately from the real image. For example, the growth of the virtual image includes at least one of budding, length growth, branch or leaf growth, flowering, fruit bearing, fruit growth, and the like. For example, the reaction of the virtual image may include at least one or more of shaking, pushing, pulling, bending, bending, falling leaves, falling leaves, and the like of the virtual object.

Real images are real images. In one example, the real image may be a moving image or a still image. Preferably, according to one example, the real image may be a moving picture.

The virtual image refers to a manufactured image that is synthesized with a real image for the realization of augmented reality. For example, the virtual image may be an image in which a simple still image performs growth and reaction.

For example, in one example, the step ( S100 ) of storing the real image and the first virtual image of FIG. 1 may be implemented as shown in FIGS. 2 to 3 . 2 to 3 will be described later.

Next, the second virtual image generation step ( S300 ) of FIG. 1 will be described. In the second virtual image generation step ( S300 ), the time information of the second time point according to the start of driving the augmented reality in the mobile terminal at the second time point in another area outside the specific area, the surrounding area of the specific area or the specific point at the second time point Based on the environment information and the first information applied to the mobile terminal, a second virtual image in which changed growth, reaction, or both are performed is generated.

For example, augmented reality driving may be initiated by driving an existing augmented reality image including a stored reality image. In this case, the stored reality image includes an image of a specific point. Alternatively, augmented reality driving may be driven by receiving a selection from a specific point on geographic information or a specific point in a stored real image in the mobile terminal. The geographic information may be address information, a selection point on a map, a name of a specific point, and the like, but is not limited thereto.

For example, in one example, the surrounding environment information may include real-time or time-lapse weather information including any one or more of temperature, precipitation, sunshine, wind, and humidity information. In this case, the surrounding environment information may be weather information on a specific area or a specific point that is the background of the real image. In one example, the weather information over time may be information obtained from big data. For example, the lapse of time may be the lapse of time from the creation time of the previously stored virtual image to the corresponding time. For example, the generation time of the virtual image stored immediately before the existing may simply refer to the generation time of the virtual image. It may mean the input time of the first information related to the growth of the virtual image immediately before the generation of the virtual image. That is, the generation time of the previously stored virtual image may include the input time of the first information related to the growth of the virtual image immediately before the generation of the previously stored virtual image. For example, the entire augmented reality driving process related to the generation of the previously stored virtual image may be determined as the generation time of the previously stored virtual image.

In one example, the first information may include at least touch or input information among external environment information applied to the mobile terminal and touch or input information about a virtual object displayed on the mobile terminal and its surroundings. In this case, the external environment information may include any one or more of shaking information of the mobile terminal and blowing information to the mobile terminal. For example, the touch information on the virtual object or its surroundings may be touch input information for performing one or more of touching, shaking, pushing or pulling, breaking, and picking. In addition, input information about the virtual object or its surroundings includes installation of a virtual facility or virtual support to protect the virtual object, watering, temperature control, control work, nutrition management such as nutrient or manure cycle, and surrounding management such as weed removal , crop management such as pruning or thinning, and harvest may be any one or more information.

For example, in one example, the weather information according to the lapse of time may be any one or more of temperature, precipitation, and sunlight, and may be a value according to an elapsed day or an elapsed section, a pattern or an average of the entire time elapsed. For example, the input information, which is the basis for the growth of the virtual image, is made during the lapse of time from the start of the augmented reality driving for the generation of the last stored image to the start of the augmented reality driving for the generation of the virtual image at the time, and to assist the growth. It may be any one or more of installation of virtual facilities or virtual supports, watering, temperature control, pest control, nutrition management, surrounding management, and crop management. For example, the response of the second virtual image may be determined according to any one or more of wind, shaking or blowing, touch input information, crop management, and harvest. In this case, the touch input information is touch information about the virtual object or its surroundings.

Subsequently, the second virtual image update storage step ( S400 ) of FIG. 1 will be described. In the second virtual image update and storage step ( S400 ), the second virtual image is displayed to be synthesized on the real image, and the second virtual image is updated and stored. In this case, the update storage may mean replacing an existing virtual image with a new virtual image, or may mean additionally storing a new virtual image in addition to the existing virtual image according to an embodiment.

In this case, the growth of the first and second virtual images is performed on the mobile terminal according to the lapse of time related to the growth of the virtual object and the surrounding environment information according to the lapse of time related to the growth of the virtual object in addition to the lapse of time from the time of creation of the immediately preceding stored image. Based on at least one or more of the applied first information, it is made from the last stored image. For example, the time lapse is the time of generation of the previously stored virtual image, that is, the entire time of the augmented reality driving process related to the generation of the previously stored virtual image, for example, preferably the growth of the virtual image immediately before the generation of the previously stored virtual image and It may be the lapse of time from the input of the related first information to the corresponding time.

Next, an example of a virtual object management method using augmented reality and big data will be described in detail with reference to FIG. 2 . Referring to FIG. 2 , the step ( S100 ) of storing the real image and the first virtual image of FIG. 1 may include the following steps ( S110 to S150 ) ( S100 ′). That is, the real image and the first virtual image storage step (S100') includes the information acquisition step (S110), the real image acquisition step (S120), the specific point determination step (S140), and the first virtual image creation, synthesis and display steps ( S150) and a storage to update storage step (S160) may be included. At this time, the information acquisition step (S110) and the real image acquisition step (S120) to the specific point determination step (S140), as shown in FIGS. Note that (S120) may be performed first. That is, there is no time-series ranking between the information acquisition step S110 and the real image acquisition step S120, and the time-series ranking may vary according to embodiments. For example, unlike FIG. 2 , the information obtaining step S110 is performed after the real image obtaining step S120 is first performed, or the real image obtaining step S120 and the specific point determining step S140 are first performed. The obtaining step (S110) may be performed.

For example, referring to FIG. 3 , the step of storing the real image and the first virtual image ( S100 ″) may further include the step of selecting a virtual object ( S13 ).

Let's look at each step in detail. For example, in the information acquisition step ( S110 ), in the mobile terminal, in addition to the location and time of a specific area or a specific point, real-time surrounding environment information of a specific area or a specific point, the surrounding environment information over time, and the first information applied to the mobile terminal At least one piece of information including real-time surrounding environment information is acquired.

In the real image acquisition step (S120), the mobile terminal acquires a real image relating to the location or surrounding location of a specific area or a specific point. For example, the real image obtaining step S120 may be performed after the information obtaining step S110 as shown in FIG. 2 , or may be performed before the information obtaining step S110 as shown in FIG. 3 . Alternatively, after the real image acquisition step S120 and the specific point determination step S140 are performed, the information acquisition step S110 may be performed.

Next, in the specific point determination step ( S140 ), the planting location of the virtual object determined according to the initial selection or initial setting among the locations in the real image or according to the existing planting is determined as the specific point.

Next, in the first virtual image creation, synthesis, and display step (S150), when the initial planting image of the virtual object is synthesized and displayed, as a first virtual image at a specific point in the real image determined according to the initial selection or initial setting The initial planting image of the virtual object can be synthesized and displayed (S150a).

Alternatively, in the case after the initial storage of the first planting image of the virtual object (S150b), in the first virtual image creation, synthesis and display step (S150), in addition to the acquired time information, the surrounding environment information and the first applied to the mobile terminal over time Growth information of a virtual object to be grown is calculated from the immediately stored image based on at least one or more of the information, or a virtual object to be changed from the immediately stored image based on at least one or more of real-time surrounding environment information and first information applied to the mobile terminal A virtual object to be grown and changed from the immediately stored image based on at least one of the first information applied to the mobile terminal and the real-time surrounding environment information in addition to the acquired time information, or the surrounding environment information over time It is possible to generate a first virtual image by calculating the growth and reaction information (S151). For example, the calculation of the growth information of the virtual object may be calculated over time. In one example, the growth information of the virtual object may be calculated according to the surrounding environment information according to the lapse of time in addition to the lapse of time, for example, temperature information according to the lapse of time, precipitation information according to the lapse of time, and the like, but is not limited thereto. In addition, the growth information of the virtual object can be calculated according to the first information related to the growth of the virtual object over time in addition to the passage of time, for example, any one or more of water cycle, temperature control, control work, nutrition management and crop management over time. can and is not limited thereto. For example, the growth information of the virtual object may be calculated according to the first information related to the growth of the virtual object according to the lapse of time and the surrounding environment information according to the lapse of time in addition to the lapse of time. For example, in one example, the reaction information of the virtual object includes real-time surrounding environment information, such as wind information, and first information applied to the mobile terminal, such as shaking information of the mobile terminal, blowing information to the mobile terminal, touching the virtual object, Surrounding management such as shaking virtual objects, pushing or pulling virtual objects, breaking virtual objects, picking fruits of virtual objects, removing weeds, etc., crop management such as pruning or thinning, harvesting, etc. means and is not limited thereto.

In addition, in the first virtual image generation, synthesis, and display step ( S150 ) of FIG. 2 , the generated first virtual image may be synthesized and displayed at a specific point in the acquired real image ( S152 ).

Next, in the storage or update storage step ( S160 ) of FIG. 2 , the acquired real image and the first virtual image may be stored or updated and stored.

Next, an example of a virtual object management method using augmented reality and big data will be described in detail with reference to FIG. 3 . Referring to Fig. 3, in the virtual object management method, the step of storing the real image and the first virtual image (S100") may further include the step of selecting the virtual object (S130). For example, the step of storing the real image and the first virtual image In (S100"), before the specific point is determined according to the initial selection or initial setting (refer to S140), in the virtual object selection step (S130), the past setting regarding the soil, climate, or both of the specific area or the specific point Based on the big data environment information for the period, the growth suitability of the preselected virtual object may be determined or compared, or the determination result may be provided and the virtual object may be finally selected ( S130 ).

For example, determination of suitability for growth of a virtual object may be made through an app of a mobile terminal. For example, suitability determination may be made by running the app itself, or the suitability determination result may be provided from an external server connected through the app.

For example, although not shown, in one example, the virtual object selection step S130 of FIG. 3 determines a specific point even when the information acquisition step S110 is performed prior to the real image acquisition step S120 as in FIG. 2 . It may be performed before step S140.

Next, an example of a virtual object management method using augmented reality and big data will be described in detail with reference to FIG. 4 . Referring to FIG. 4 , the virtual object management method may further include a yield and harvest time determination information providing step ( S700 ) and a profit determination step ( S800 ). For example, in the step of providing information on yield and harvest time ( S700 ), real-time shipment and price information of agricultural products corresponding to the harvest of the virtual object may be obtained from the mobile terminal, and information for determining the yield and harvest time of the virtual object may be provided. . For example, real-time shipment and price information of agricultural products may be obtained through big data information.

In addition, in the revenue determining step ( S800 ), the sales price according to the virtual shipment of the harvest of the virtual object according to the selected yield and the harvest time is obtained according to the provision in the yield and harvest time determination information providing step ( S700 ), and the expected profit is obtained. can decide

For example, in one example, the real image and the first virtual image storage step (S100, S100', S100") in FIGS. It may be an image acquired through a mobile terminal of , or an image acquired through purchase or update through an app set regardless of the location of the mobile terminal, For example, in FIGS. You can acquire a real image of the area Although not shown, you can also purchase a real image through an app installed on a mobile terminal.

For example, in one example, a specific point within a specific area is individually matched for each mobile terminal that manages virtual objects, is matched for each group of mobile terminals that perform joint management on virtual objects, or multiple points that are individually or mixedly matched for each group may be adjacent. Also, in one example, when a first virtual image is synthesized and displayed on a real image, a virtual image about an adjacent virtual object managed by another mobile terminal at an adjacent point included in the real image may also be displayed. .

In this case, in one example, the image acquired through purchase or update may represent some or all of the four seasons, represent a 360-degree view, or a mixture of some or all of the four seasons and a 360-degree view.

For example, in one example, the virtual object management method may be a method performed by a game of a mobile terminal. In this case, if the time information is information about the passage of time, it is proportionally increased than the real time according to the setting, or increased intermittently from the real time according to the characteristics of the growth, reaction or growth of the virtual object, or the user's arbitrary setting according to the setting. Accordingly, as virtual time-lapse information increased from real time, it may be virtual time-lapse information that has elapsed from a virtual time point of creation of the last stored image. For example, the surrounding environment information according to the virtual time-lapse information may be information estimated and calculated based on the past big data environment information.

[Mobile terminal that performs virtual object management using augmented reality and big data]

Next, a mobile terminal for performing virtual object management using augmented reality and big data according to another aspect of the present invention will be described with reference to FIGS. 5 to 6 . Also, reference may be made to the virtual object management method using augmented reality and big data according to the above-described embodiment and FIGS. 1 to 4 . In this case, the overlapping description may be omitted.

5 is a block diagram schematically illustrating a mobile terminal for performing virtual object management using augmented reality and big data according to another embodiment of the present invention, and FIG. 6 is an augmented reality according to another embodiment of the present invention. It is a block diagram schematically showing a mobile terminal that performs virtual object management using reality and big data.

5 to 6 , the mobile terminal 1 performing virtual object management using augmented reality and big data according to an example includes a camera unit 10 , a location information acquisition unit 20 , and a communication unit 30 . ), a memory unit 40 , a touch interface unit 50 , a point determination unit 60 , a virtual image generation module 70 , and an image synthesis module 80 . For example, referring to FIG. 6 , in another example, the mobile terminal 1 for performing virtual object management using augmented reality and big data may further include a harvest determination module 90 . For example, the mobile terminal is a smart phone, a tablet PC, a notebook computer, a PDA, etc., but is not limited thereto, and a communication and portable information device is sufficient. Let's look at each configuration in detail.

First, the camera unit 10 acquires a real image about a specific area including a specific point. A real image of a specific area may be acquired through the camera unit 10 . In addition, in one example, a real image of a specific area may be purchased or obtained through an app installed in the mobile terminal 1 in addition to the camera unit 10 .

The location information obtaining unit 20 obtains location information of the mobile terminal 1 . For example, the location information acquisition unit 20 may include a GPS module.

Next, the communication unit 30 performs communication with the outside. For example, through the communication unit 30, the surrounding environment information of a specific area or a specific point may be acquired from an external server (not shown).

For example, in one example, the surrounding environment information includes real-time or time-lapse weather information including any one or more of temperature, precipitation, sunshine, wind, and humidity information obtained from an external server through the communication unit. can For example, the weather information according to the lapse of time may be information obtained from big data.

For example, in one example, the weather information according to the lapse of time may be any one or more information of temperature, precipitation, and sunlight, and may be a value according to an elapsed day or an elapsed section, a pattern or an average of the entire time elapsed.

For example, in one example, the mobile terminal 1 receives real-time surrounding environment information of a specific area or a specific point from an external server through the communication unit 30 in addition to the location and time of the specific area or the specific point, and the communication unit 30 through the communication unit 30 . At least one or more pieces of information including real-time surrounding environment information among the first information applied to the mobile terminal 1 and surrounding environment information according to time lapse from an external server may be acquired.

Next, the memory unit 40 stores the virtual image synthesized on the real image and the real image acquired through the camera unit 10 or acquired through the app. For example, at least a virtual image among the real image and the virtual image stored in the memory unit 40 may be updated and stored according to a storage time point.

For example, in one example, the real image may be a moving image or a still image. Preferably, according to one example, the real image may be a moving picture.

For example, in one example, the memory unit 40 may store or update the acquired real image and virtual image.

For example, in one example, the real image obtained with respect to the location of a specific area or a specific point is acquired through the camera unit 10 in the mobile terminal 1 of a specific area or an app set regardless of the location of the mobile terminal 1 It may be an image acquired through purchase or update through .

Next, the touch interface unit 50 receives the user's input and displays an image.

The point determination unit 60 determines a specific point determined as a planting location of the virtual object according to the initial selection or initial setting among locations in the real image.

Next, the virtual image generating module 70 includes the specific area or the surrounding environment information of the specific point obtained through the communication unit 30 in addition to the time information of the specific area or the specific point obtained from the mobile terminal 1 and the mobile terminal 1 Generates a virtual image of a plant-type virtual object in which growth, reaction or both are performed from the stored image immediately before starting of augmented reality driving based on information including at least surrounding environment information among the first information applied to the .

For example, the growth of the virtual image generated by the virtual image generation module 70 is related to the time lapse of surrounding environment information according to the lapse of time related to the growth of the virtual object and the lapse of time related to the growth of the virtual object, in addition to the lapse of time from the time of creation of the last stored image. Based on at least one or more of the first information applied to the mobile terminal 1 according to

For example, in one example, the first information includes at least touch or input information among external environment information applied to the mobile terminal 1 and touch or input information about the virtual object displayed on the mobile terminal 1 and its surroundings. can do. For example, the external environment information may include any one or more of shaking information of the mobile terminal 1 and blowing information to the mobile terminal. For example, the touch information on the virtual object or its surroundings may be touch input information for performing one or more of touching, shaking, pushing or pulling, breaking, and picking. For example, input information about a virtual object or its surroundings includes installation of a virtual facility or virtual support to protect the virtual object, watering, temperature control, control work, nutrition management such as nutrient or manure cycle, and surrounding management such as weed removal. , crop management such as pruning or thinning, and harvest may be any one or more information.

For example, in one example, the input information, which is the basis for the growth of the virtual image, is made during the lapse of time from the start of the augmented reality operation for the generation of the immediately stored image to the start of the augmented reality operation for the generation of the virtual image at the time point. It may be any one or more of installation of a virtual facility or virtual support to support growth, watering, temperature control, pest control, nutrition management, surrounding management, and crop management. In addition, the response of the second virtual image may be determined according to any one or more of wind, shaking or blowing, touch input information, crop management, and harvest.

For example, in one example, the virtual image generation module 70 is the first information applied to the surrounding environment information and the mobile terminal 1 according to the lapse of time in addition to the acquired time information after the initial storage of the first planting image of the virtual object The growth information of the virtual object to be grown is calculated from the last stored image based on at least one or more of the information, or is changed from the immediately stored image based on at least one or more of the real-time surrounding environment information and the first information applied to the mobile terminal 1 To calculate the reaction information of the virtual object, or to grow and change from the immediately stored image based on at least one of the real-time surrounding environment information, the surrounding environment information over time, and the first information applied to the mobile terminal in addition to the acquired time information. A virtual image may be generated by calculating the growth and reaction information of the virtual object.

Continuing to look, the image synthesis module 80 synthesizes a virtual image at a specific point in the real image and provides the synthesized image to be displayed through the touch interface unit 50 . Since the technology for realizing augmented reality by synthesizing a virtual image with a real image is already well known, it will be referred to and a detailed description will be omitted.

For example, in one example, the image synthesis module 80 synthesizes and displays the initial planting image of a virtual object as a virtual image at a specific point in the real image determined according to the initial selection or initial setting, or in the virtual image generation module 70 . The generated virtual image can be displayed by synthesizing it at a specific point in the acquired real image.

For example, in one example, the virtual image generating module 70 and the image synthesizing module 80 may be implemented by combining software into one processor. For example, in one example, the virtual image generating module 70 and the image synthesizing module 80 as well as the point determining unit 60 may be implemented by combining software in one processor.

A mobile terminal 1 for performing virtual object management using augmented reality and big data according to another example will be described. At this time, before the specific point is determined according to the initial selection or initial setting, the mobile terminal 1 performs the soil, climate or both for the specific area or the specific point acquired through the communication unit 30 during the past setting period. The virtual object may be finally selected through the touch interface unit 50 after determining or comparing the growth suitability of the preliminarily selected virtual object based on the big data environment information of , or receiving the determination result. For example, growth suitability determination may be performed by the harvest determination module 90 of FIG. 6 to be described later. Alternatively, the growth suitability determination may be performed in an external server connected to the communication unit 30 .

Next, a mobile terminal 1 for performing virtual object management using augmented reality and big data according to an example will be described with reference to FIG. 6 . In this case, the mobile terminal 1 may further include a harvest determination module 90 . The mobile terminal 1 may acquire real-time shipment and price information of agricultural products corresponding to the harvest of the virtual object through the communication unit 30 . At this time, the harvest determination module 90 calculates the harvest amount and harvest time determination information of the virtual object based on the obtained real-time shipment and price information of the agricultural products, provides it to the user through the touch interface unit 50, and selects according to the provision It is possible to obtain the sales price according to virtual shipment of the harvest according to the yield and harvest time, and determine the expected profit.

For example, consider the mobile terminal 1 for performing virtual object management using augmented reality and big data according to another example. At this time, a specific point within a specific area is individually matched for each mobile terminal 1 that manages virtual objects, is matched for each group of mobile terminals 1 that performs joint management on virtual objects, or a plurality of individually or mixed matching for each group. The points may be adjacent. In addition, when a virtual image is synthesized and displayed on a real image, a virtual image related to an adjacent virtual object managed by another mobile terminal at an adjacent point included in the real image may also be displayed. In addition, the image acquired through purchase or update may represent some or all of the four seasons, a 360 degree view, or a mixture of some or all of the four seasons and a 360 degree view.

Also, look at the mobile terminal 1 for performing virtual object management using augmented reality and big data according to an example. In this case, the virtual object may be managed on the game of the mobile terminal 1 . That is, the management of the virtual object may be a part of the game performed on the mobile terminal 1 . In this case, if the time information is information about the passage of time, it is proportionally increased than the real time according to the setting, or increased intermittently from the real time according to the characteristics of the growth, reaction or growth of the virtual object, or the user's arbitrary setting according to the setting. Accordingly, as virtual time-lapse information increased from real time, it may be virtual time-lapse information that has elapsed from a virtual time point of creation of the last stored image. In addition, the surrounding environment information according to the virtual time-lapse information may be information estimated and calculated based on the past big data environment information.

In the above, the above-described embodiments and the accompanying drawings are illustratively described to help those of ordinary skill in the art for the present invention, rather than limiting the scope of the present invention. In addition, embodiments according to various combinations of the above-described configurations may be apparent to those skilled in the art from the above detailed descriptions. Accordingly, various embodiments of the present invention can be implemented in modified forms without departing from the essential characteristics of the present invention, and the scope of the present invention should be interpreted according to the invention described in the claims, and it is common in the art Various modifications, alternatives, and equivalents are included by those with knowledge of

1: mobile terminal 10: camera unit
20: location information acquisition unit 30: communication unit
40: memory unit 50: touch interface unit
60: point determination unit 70: virtual image generation module
80: image synthesis module 90: harvest determination module

Claims (18)

In the mobile terminal at the first point of view, a first virtual image of a plant-like virtual object is synthesized at a specific point in the real image acquired for a specific area, and the real image and the first virtual image are stored, the first virtual image is generated and stored so that growth, reaction or both are performed based on at least the time information and surrounding environment information of the specific area or the specific point;
In the mobile terminal at a second time point in another area outside the specific area, the time information of the second time point according to the start of augmented reality driving, and the surrounding environment information about the specific area or the specific point at the second time point and generating a second virtual image in which the changed growth, reaction, or both are performed based on the first information applied to the mobile terminal. and
In the mobile terminal, displaying the second virtual image to be synthesized on the real image and updating and storing the second virtual image,
The growth of the first and second virtual images is based on the lapse of time related to the growth of the virtual object and the surrounding environment information according to the lapse of time related to the growth of the virtual object in addition to the lapse of time from the time of creation of the immediately preceding stored image. Based on at least one or more of the first information applied to the mobile terminal according to
Storing the real image and the first virtual image in the mobile terminal includes:
In the mobile terminal, in addition to the location and time of the specific area or the specific point, the real-time surrounding environment information of the specific area or the specific point, the surrounding environment information according to the lapse of time, and the first information applied to the mobile terminal. acquiring at least one piece of information including real-time surrounding environment information;
acquiring the real image of the specific area or the location of the specific point or the surrounding location in the mobile terminal;
determining, as the specific point, a planting position of the virtual object determined according to an initial selection or initial setting among positions in the real image or according to an existing planting;
After synthesizing and displaying the first planting image of the virtual object as the first virtual image at the specific point in the real image determined according to the initial selection or the initial setting, or after the initial storage of the first planting image of the virtual object In this case, in addition to the acquired time information, the growth information of the virtual object to be grown is calculated from the immediately preceding stored image based on at least one of the first information applied to the mobile terminal and the surrounding environment information according to the lapse of time, The reaction information of the virtual object to be changed from the immediately stored image is calculated based on at least one of the real-time surrounding environment information and the first information applied to the mobile terminal, or the real-time surrounding environment in addition to the acquired time information. Based on at least one or more of information, the surrounding environment information over time, and the first information applied to the mobile terminal, growth and reaction information of the virtual object to be grown and changed from the immediately preceding stored image is calculated based on the first information. 1 generating a virtual image, synthesizing and displaying the generated first virtual image at the specific point in the acquired real image; and
A virtual object management method using augmented reality and big data, comprising the step of storing or updating the acquired real image and the first virtual image.
In claim 1,
The real image is a moving image or a still image,
The surrounding environment information includes real-time or weather information according to the lapse of time including any one or more of temperature, precipitation, sunshine, wind, and humidity information, and the weather information according to the lapse of time is big data information obtained from
The first information includes at least the touch or input information among external environment information applied to the mobile terminal and touch or input information about the virtual object displayed on the mobile terminal and its surroundings,
The external environment information includes any one or more of shaking information of the mobile terminal and blowing information to the mobile terminal,
The touch information on the virtual object or its surroundings is touch input information for performing any one or more of touching, shaking, pushing or pulling, bending, and picking,
The input information about the virtual object or its surroundings includes installation of a virtual facility or virtual support for protecting the virtual object, watering, temperature control, control work, nutrition management such as nutrient or manure cycle, and surrounding areas such as weed removal. A virtual object management method using augmented reality and big data, characterized in that the information is any one or more of management, crop management such as pruning or thinning, and harvest.
In claim 2,
The weather information according to the lapse of time is information of any one or more of the temperature, the amount of precipitation, and the sunlight, and is a value according to an elapsed day or an elapsed section, a pattern or an average of the entire time elapsed,
The input information, which is the basis for the growth of the virtual image, is made during the lapse of time from the start of driving the augmented reality for generation of the immediately preceding stored image to the start of driving the augmented reality for generating the virtual image at the time point. any one or more of the installation of the virtual facility or virtual support to assist
The reaction of the second virtual image is a virtual object management method using augmented reality and big data, characterized in that it is determined according to any one or more of the wind, the shaking or blowing, the touch input information, the crop management, and the harvest. .
delete In claim 1,
The step of storing the real image and the first virtual image in the mobile terminal, before the specific point is determined according to the initial selection or initial setting, in the soil, climate, or both of the specific area or the specific point. The method further comprising the step of judging or comparing the growth suitability of the preselected virtual object based on big data environment information for a set period in the past, or receiving the determination result and then finally selecting the virtual object A virtual object management method using augmented reality and big data.
In any one of claims 1, 2, 3, 5,
In the mobile terminal, after the step of updating and storing the second virtual image, obtaining real-time shipment and price information of agricultural products corresponding to the harvest of the virtual object and providing information to determine the harvest amount and harvest time of the virtual object step; and
Augmented reality and big data, characterized in that it further comprises, in the mobile terminal, obtaining a sale price according to virtual shipment of the harvest of the virtual object according to the harvest amount and harvest time selected according to the provision and determining the expected profit How to manage virtual objects using
In any one of claims 1, 2, 3, 5,
The real image acquired with respect to the location of the specific area or the specific point in the mobile terminal is acquired through the mobile terminal in the specific area or acquired through purchase or update through an app set regardless of the location of the mobile terminal A virtual object management method using augmented reality and big data, characterized in that it is a single image.
In claim 7,
The specific point within the specific area is individually matched for each mobile terminal that manages the virtual object, is matched for each group of the mobile terminal that performs joint management on the virtual object, or a plurality of points that are individually or mixedly matched It is adjacent, and when the first virtual image is synthesized and displayed on the real image, a virtual image about an adjacent virtual object managed by another mobile terminal at an adjacent point included in the real image is also displayed,
Augmented reality and big data, characterized in that the image acquired through the purchase or update represents some or all of the four seasons, or a 360-degree view, or a mixture of some or all of the four seasons and the 360-degree view. How to manage virtual objects using
In any one of claims 1, 2, 3, 5,
The virtual object management method is a method performed by a game of the mobile terminal,
When the time information is information on the lapse of time, it is proportionally increased than real time according to a setting, or is intermittently increased than real time according to the characteristics of growth, reaction or growth and reaction of the virtual object according to the setting, or the user's discretion It is the virtual time-lapse information that has elapsed from the creation virtual time of the immediately preceding stored image as virtual time-lapse information that is increased than the real time according to the setting,
The virtual object management method using augmented reality and big data, characterized in that the surrounding environment information according to the virtual time-lapse information is information estimated and calculated based on past big data environment information.
a camera unit for acquiring a real image about a specific area including a specific point;
a location information obtaining unit for obtaining location information of the mobile terminal;
a communication unit that communicates with the outside;
a memory unit for storing the real image acquired through the camera unit or acquired through an app and a virtual image synthesized on the real image;
a touch interface unit that receives a user's input and displays an image;
a point determination unit for determining the specific point determined as a planting location of a virtual object according to an initial selection or initial setting among locations in the real image;
In addition to the time information of the specific area or the specific point obtained from the mobile terminal, at least the surrounding environment information of the surrounding environment information of the specific area or the specific point obtained through the communication unit and the first information applied to the mobile terminal a virtual image generation module for generating a virtual image of a plant-type virtual object in which growth, reaction, or both are performed from the stored image immediately before starting the augmented reality operation based on the information included; and
A mobile terminal comprising an image synthesizing module for synthesizing the virtual image at the specific point in the real image and providing the synthesized image to be displayed through the touch interface unit,
At least the virtual image among the real image and the virtual image stored in the memory unit is updated and stored according to a storage time,
The growth of the virtual image generated by the virtual image generating module is related to the growth of the virtual object and the surrounding environment information according to the lapse of time related to the growth of the virtual object in addition to the lapse of time from the creation time of the immediately preceding stored image. Based on at least one or more of the first information applied to the mobile terminal according to the lapse of time, it is made from the last stored image,
In addition to the location and time of the specific area or the specific point, the mobile terminal provides real-time surrounding environment information of the specific area or the specific point from the external server through the communication unit, and the time elapsed from the external server through the communication unit. acquiring at least one or more pieces of information including the real-time surrounding environment information among the first information applied to the surrounding environment information and the mobile terminal according to the
The virtual image generation module is at least one of the first information applied to the first information and the surrounding environment information according to the lapse of time in addition to the acquired time information after the initial storage of the first planting image of the virtual object. Calculating the growth information of the virtual object to be grown from the immediately previous stored image based on it, or the virtual object to be changed from the immediately preceding stored image based on at least one or more of the real-time surrounding environment information and the first information applied to the mobile terminal , or based on at least one of the real-time surrounding environment information, the surrounding environment information according to the lapse of time, and the first information applied to the mobile terminal in addition to the acquired time information, the immediately before stored image to generate the virtual image by calculating growth and reaction information of the virtual object to be grown and changed from
The image synthesis module synthesizes and displays the initial planting image of the virtual object as the virtual image at the specific point in the real image determined according to the initial selection or the initial setting, or the virtual image generation module generates the Displaying a virtual image by synthesizing it at the specific point in the acquired real image,
The memory unit is a mobile terminal for performing virtual object management using augmented reality and big data, characterized in that storing or updating the acquired real image and the virtual image.
In claim 10,
The real image is a moving image or a still image,
The surrounding environment information includes real-time or weather information according to the lapse of time including any one or more of temperature, precipitation, sunshine, wind, and humidity information obtained from an external server through the communication unit, and the time The weather information over time is information obtained from big data,
The first information includes at least the touch or input information among external environment information applied to the mobile terminal and touch or input information about the virtual object displayed on the mobile terminal and its surroundings,
The external environment information includes any one or more of shaking information of the mobile terminal and blowing information to the mobile terminal,
The touch information on the virtual object or its surroundings is touch input information for performing any one or more of touching, shaking, pushing or pulling, bending, and picking,
The input information about the virtual object or its surroundings includes installation of a virtual facility or virtual support for protecting the virtual object, watering, temperature control, control work, nutrition management such as nutrient or manure cycle, and surrounding areas such as weed removal. A mobile terminal for performing virtual object management using augmented reality and big data, characterized in that the information is any one or more of management, crop management such as pruning or thinning, and harvest.
In claim 11,
The weather information according to the lapse of time is information of any one or more of the temperature, the amount of precipitation, and the sunlight, and is a value according to an elapsed day or an elapsed section, a pattern or an average of the entire time elapsed,
The input information, which is the basis for the growth of the virtual image, is made during the lapse of time from the start of driving the augmented reality for generation of the immediately preceding stored image to the start of driving the augmented reality for generating the virtual image at the time point. any one or more of the installation of the virtual facility or virtual support to assist
The reaction of the virtual image is to perform virtual object management using augmented reality and big data, characterized in that determined according to any one or more of the wind, the shaking or blowing, the touch input information, the crop management, and the harvest mobile terminal.
delete In claim 10,
Before the specific point is determined according to the initial selection or initial setting, based on the big data environment information for the past set period about the soil, climate, or both of the specific area or the specific point acquired through the communication unit Virtual object management using augmented reality and big data, characterized in that the virtual object is finally selected through the touch interface unit after determining or comparing the growth suitability of the preselected virtual object or receiving the determination result A mobile terminal that performs
In any one of 10, 11, 12, 14,
Acquire real-time shipment and price information of agricultural products corresponding to the harvest of the virtual object through the communication unit,
The mobile terminal calculates and provides information to determine the harvest amount and harvest time of the virtual object based on the obtained real-time shipment and price information of the agricultural products, and provides virtual information on the harvest according to the selected harvest amount and harvest time according to the provision. A mobile terminal for performing virtual object management using augmented reality and big data, characterized in that it further comprises a harvest determination module for obtaining a sales price according to shipment and determining an expected profit.
In any one of 10, 11, 12, 14,
The real image acquired with respect to the location of the specific area or the specific point is acquired through the camera unit in the mobile terminal in the specific area or acquired through purchase or update through an app set regardless of the location of the mobile terminal A mobile terminal that performs virtual object management using augmented reality and big data, characterized in that it is a single image.
17. In claim 16,
The specific point within the specific area is individually matched for each mobile terminal that manages the virtual object, is matched for each group of the mobile terminal that performs joint management on the virtual object, or a plurality of points that are individually or mixedly matched It is adjacent, and when the virtual image is synthesized and displayed on the real image, a virtual image about an adjacent virtual object managed by another mobile terminal at an adjacent point included in the real image is also displayed,
Augmented reality and big data, characterized in that the image acquired through the purchase or update represents some or all of the four seasons, or a 360-degree view, or a mixture of some or all of the four seasons and the 360-degree view. A mobile terminal that performs virtual object management using
In any one of 10, 11, 12, 14,
The virtual object is managed on the game of the mobile terminal,
When the time information is information on the lapse of time, it is proportionally increased than real time according to a setting, or is intermittently increased than real time according to the characteristics of growth, reaction or growth and reaction of the virtual object according to the setting, or the user's discretion It is the virtual time-lapse information that has elapsed from the creation virtual time of the immediately preceding stored image as virtual time-lapse information that is increased than the real time according to the setting,
The mobile terminal for performing virtual object management using augmented reality and big data, characterized in that the surrounding environment information according to the virtual time-lapse information is information estimated and calculated based on past big data environment information.

Images