KR101890989B1 - O2O(Online to Offline) Calorie Service Management System for Calorie Measuring and Consumption based Image Recognition using Deep Learning Algorithm - Google Patents

Abstract

 The present invention uses a smartphone application to notify a user of a calorie-counting image of a food using a deep-running algorithm, transmits calorie-consuming information through an application, The present invention relates to a business model for providing exercise services in a health club. More specifically, the present invention relates to a business model in which a user takes a picture taken by a customer to search for a food of the same kind and amount using a deep learning algorithm using Big Data By showing the calorie value of one calorie, it shows the calories of the food ingested, calculates the calories consumed and the calories consumed, and when the average body mass index is exceeded, the warning message and various information that can consume calories And characters provided by the application If you want to exercise in the off-line, you can use the GPS of your smartphone to provide information about the sport center and health club that are closest to your current location, If you want to exercise in a club or get a personal training, you can use a contract to pre-register the place where the service is provided and provide the service so that the customer can connect with the closest place to where they are, A calorie management system is provided.

Description

[0001] The present invention relates to an O2O calorie management system for calorie measurement and consumption using object recognition using a deep learning algorithm. [0002] The present invention relates to a calorie management system for calorie measurement and consumption,

The present invention is a service through a smart phone application. When a customer takes a food photograph to be consumed by using the object recognition algorithm using the non-bio-learning method of deep learning, he automatically recognizes the type of each food and the amount of food It shows the calories of each food you want to eat, and the food you eat according to each customer's body, entered in advance through the application, gives you information about the calories you exceeded in your average body mass index. In addition, among the application functions of the smart phone, 'pedometer', that is, the calorie consumed on foot in the day and the calorie consumed by the foot calorie is exceeded by the calorie warning message and the calorie consumed for the excessive calorie consumption How to send video and data data, using GPS of smartphone to inform the location of the health club which is closest to the customer and make a reservation for the personal training and exercise at the exercise time It is a network management system that provides services to provide personal trainings and payment of expenses by sending information of customers who are holding and exercising, receiving orders online or providing information offline, Calorie management system for O2O service to solve problems It is a system.

In the case of the calorie serving application of the currently used food, if the name of the food is inputted, the fixed calorie corresponding to the name of the food is inputted, and it is impossible to find the correct food when the service is not in the service. There is no way to recognize pictures and provide calories through the running algorithm. The method of providing information for consuming calories does not provide customized exercise information corresponding to personal body information, but provides only predetermined information through a method of providing uniformly or cyclically determined information. And nowadays, online and offline marketing is used to make orders and receive information through online using smart phone. We can make reservation and information so that we can provide goods through offline, solve problems or exercise with health club. In other words, a representative example is 'nation of delivery' which is a service to deliver food by smart phone or 'taxi service' by smart phone, so it is possible to measure calorie in O2O service online such as 'Cacao taxi' There is no service to manage calories through direct exercise reservation and information provision.

It is an object of the present invention to provide a service provided by a smartphone application, in which when a photograph of a food to be taken is taken, a large amount of big data acquired by a data company or collected directly by a company is operated, And a calorie management system that can recognize the calories of the food ingested by showing the calories entered in advance.

According to the present invention, calorie measured through photographs of foods consumed through deep running and information on calories consumed on walking and calories consumed in the workplace can be inputted through a pedometer calculator function using a calorie application and a smart phone application When calculating the total calorie value, if the sum of the food calories consumed by the customer for a day exceeds the pre-entered average body mass index of the consumer, various exercise videos and information materials that can consume calories according to the customer's constitution When the customer wants to exercise on the off-line, they can use the GPS of the smartphone to provide information on various sports centers such as health club, swimming pool, park, etc. . And if you want to exercise in the nearest health club, you can make reservations at the health club through a network that has been built in advance, provide your information to the health club, You can provide O2O services that provide information to clubs and, in addition, pay for them online, by linking your online needs offline.

In order to accomplish the above object, the present invention provides a calorie management system in which a calorie of a food through deep-running using an application installed on a smartphone by a customer and consumes excess calories in off-line, I would like to present the O2O business model that solves the needs at offline sports center and health club.

According to the present invention, when a calorie controlled by a deep-running type calorie check is applied through a smartphone application, the customer can receive information such as a warning message when the calories managed for a day exceeds the body mass index of the customer, And provides a system that enables customers to receive personal training suitable for their customers in the closest place to the time they want to exercise through a network with the health club. It is convenient, fast, and convenient because it can be used anytime and anywhere through a smart phone that is easy to carry. On the other hand, the sports center can welcome a variety of people who need to consume calories without needing special marketing, can help the health club through the network, and reduce the national cost that can be paid by obesity There is also.

FIG. 1 is a diagram showing the overall environment to which a business model of an O2O service management system using object recognition, calorie measurement, and object recognition is applied by a deep learning algorithm using a smartphone application according to the present invention. , Which is a flowchart depicting the overall environment in which the O2O service management system model using object recognition, calorie measurement, and object recognition is applied to a deep running algorithm using a smartphone application. The service according to the present invention enables the customer who installed the application to measure the calories consumed and the calories consumed during the day by using the smartphone and consumes the excess calories when the calories consumed exceeds the average body mass index of the customer It is an O2O service calorie management system that provides information that you can subtract through online and offline methods.

The present invention relates to a deep-run method that can confirm the calories of foods consumed by a customer who installs an application using a smartphone, and a method of calculating the average body mass due to the calories of the food consumed by the customer- And an O2O service calorie management system that provides information and connects various sports to be performed on-line or off-line when the index is exceeded. Referring to FIG. 1, when a customer installs an application on a smart phone 1 and inputs customer information, the customer's information is stored in the company's server 2, and when the customer takes a picture of the food consumed, When the big data bought or collected by the company is transmitted to the server and the photograph is read through the deep learning algorithm, the calorie of the food designated in advance for the food photograph is transmitted to the customer, and the calories of the food consumed by the customer When the average body mass index is exceeded, the GPS server of the smartphone is connected to the satellite (3) to provide various information through the company server, and to get information for exercising at an offline sports center or health club, The location information of the sports center and health club is shown to the application through the company server, Receive by any customer using the application (1) the payment of the reservation and the costs to provide customer information try to exercise to select the nearest gym (4) at the current location, the information that the company's servers (2) (4), information on the date and time of reservation, customer information and expenses is displayed on the health club system (4), and the message of completion to the customer's smartphone via the company server again through the approval of the health club And the data is transmitted.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, specific configuration diagrams for implementing the present invention will be described with reference to the drawings.

As shown in FIG. 2, when a customer installs and executes an application of a smartphone according to the present invention, information such as sex, age, height, weight, favorite exercise, And when the customer information is sent to the server of the company, the average body mass index corresponding to the customer comes out. Based on the body mass index, the patient consumes the food for one day. When the body weight is increased, the calorie is exceeded. When the body weight is decreased by exercise, . In addition, it shows whether the current BMI of the customer is compared with the average BMI and whether the mass is exceeded or not. If it is exceeded, it shows the mass to be weighted, And a service that allows you to create exercise and diet control schedules tailored to your exercise habits, thus helping you to lose weight in accordance with your overall goals. When the customer's information is sent to the server, it is possible to measure the number of steps every time you take a step, and calculate the number of steps you have entered in advance If you use the service, you will be registered as the calories you consume. You can enter the type of work and the working time to set the calculated calories consumed for each type of work and time. When the customer enters the information, it displays the calories consumed in real time and is registered as the calories consumed in the day. It is applied to the calculation of the total calories. When the food picture is taken with the smartphone camera linked with the application, Through deep-running algorithms that are sent to the server and process big data By selecting a photo from matching of food and the amount of food placed separately into the same kind of food and 12 steps to put calorie information entered through the variety of food in advance sends the same amount of calories ingested food to the customer's application. Also, the average body mass index of a general person who is measured and inputted in advance based on the sex, age, height, weight, etc. registered by the customer in advance is shown, and the average body mass index of the general public or the average body mass index The average body mass index (BMI) of a week is selected according to the target set by the customer, and if the standard is set, the calorie consumed from the food calorie consumed during the day is subtracted, and the average body mass index If the calorie value exceeds the reference body mass index, a warning message and information on the excess calorie are sent to the customer. In addition to the warning message, we provide exercise videos and exercise information tailored to the customer's habits and hobbies so that we can consume excess calories, and we can customize the customer's settings during the exercise time so that we can walk or play with the characters in the application. To transmit video and sound together with the real-time motion of the character on the application. In addition, when the customer wants to do swimming, tennis, yoga, table tennis, etc. at the sports center, the GPS of the smartphone is automatically turned on when the sports center is selected so that the user can exercise in the closest place Location of sports center, exercise time, and cost. When you choose a health club when you want to exercise in a health club or receive personal training, your smartphone's GPS will automatically turn on and allow you to contact your nearest and current customers You can see the location of the health club and the personal trainer and cost information you are willing to provide. In order to exercise in the gym, we provide the gym with information about the time the customer wishes to exercise and, optionally, the customer's body mass index already registered on the company server, the customer's preferred exercise program, Consent (optional for customer's information so that the trainer of the health club can check the information in advance so that the customer can receive the desired exercise training), approval of the health club through approval of the health club through trainer selection and payment, To the customer ' s application. Hereinafter, the configuration and operation of the O2O-type calorie management system for calorie measurement and consumption using object recognition using the deep learning algorithm according to the present invention will be described in detail. The present invention is a method of calorie measurement by photographing an application on a food, which is a method of recognizing a calories of a food to be ingested by a service using a smartphone application. In other words, it is not a 'map learning method' that identifies puppies' pictures based on the results of inputting data values into a computer like the existing 'It's apple' or 'cat' In order to use this method, we use the algorithm of 'artificial neural network' which simulates the pattern of human brain recognizing the pattern. For example, to create an algorithm that recognizes cats, input a large number of animal picture data, including cats, so that the neural network learns how each behavior and model pattern should be categorized based on what. In this learning, even if the data does not have the specified name, it finds a certain pattern of data, extracts various features to make a feature map, clusters similar to the repetition of such feature extraction, As you sort out the objects, you can sort the data so that you can see the pictures and judge if they are cats. This process is also applied to food photographs, and massive quantities of food data are converted into big data, so that customers can create a pattern of how the pictures taken by the application are matched to each other, You can find out what kind of food you are eating with just food photographs. If you select a pre-measured food and the exact calorie value for each amount in the food data and select it through the deep-running algorithm of the photographed picture, You can check the calories of the food you are eating right now by sending it to your customers. The calories of the food taken are summed up on a daily basis and stored as a record on the customer's own application so that the customer can check the calories of each food taken and the total calories of the food taken during the day in real time. In addition, by using the vibration function of the mobile phone, the user can select 'smartphone', that is, measure the number of steps each time a step is taken and know how much calories are consumed by walking The amount of calories consumed by stepping is displayed in real time, and when the type of work and the working time of the customer are inputted into the application, the amount of calories per hour consumed per type of work is inputted into the calorie data The calorie consumed by the customer is calculated by calculating the calories consumed during the day, subtracting the calories consumed from the calories consumed during the day, and calculating the current calorie quantity by displaying the figure in real time. In addition, we calculate the BMI with information such as the customer's age, height, and weight, which we entered at the time of application installation, and the calories consumed during the day exceeded the average body mass index or the average body mass If the index is exceeded, a warning message is displayed and an alarm is displayed to show the excess value of calories. If the average body mass index is exceeded, the customer can enter programs such as exercise tastes, body mass indexes, exercise video information corresponding to the exercise program, and various calorie consumption information, and walking and running programs that can consume calories with application characters It provides a service that shows the video and sound of the character so that it can proceed simultaneously in real time through setting the time and specifying the method. In other words, the customer can input the time and place such as walking or running by the character setting, and the character can hear the sound together with the video running or walking in real time. If a customer wants to consume calories in off-line sports such as swimming, yoga, table tennis, badminton, squash, tennis, etc., the smartphone's GPS will automatically activate and use the GPS feature to locate the nearest sports center And movement time, cost, and the shortest distance movement interval. If a customer wants to be trained by a health club, he or she can use the GPS of the smartphone in conjunction with a health club that has already joined the service via the network, If the application shows price and trainer information and time available for exercise, and the customer wishes to make a reservation to exercise in the gym or to receive personal training, he or she can optionally send information such as body mass index, If you select a time and a trainer that can exercise at the same time, determine the payment method, and pay the application by application or pay offline, you will be able to provide services through the company's server. Contracted and system built When the customer's approval request is displayed in the computer system of the health club, the person in charge of the health club confirms the reservation and clicks the approval for the reservation, the approval message is transmitted to the customer's application screen through the company server, O2O service calorie management system that allows you to work in an offline sports center or health club in your smartphone application.

 1: customer smartphone, 2: company server and big data, 3: satellite, 4: health club

Claims (1)

 In a management system composed of a customer smart phone 1, a server 2 of a company with big data, a satellite 3, and a health club 4, a customer installs an application on a smart phone, If you enter information such as weight, favorite exercise, exercise habits, etc., and send it to the company server, the average body mass index of the customer will come out. Based on that figure, if you eat food for one day, your weight will go up. Calorie shortage, etc., and the current customer shows whether the body mass index is below or below the mass compared to the average body mass index, shows the mass to lose if it is exceeded, and the favorite exercise and exercise A meal schedule for a certain period of time that can exercise the exercise and the excess calorie can be selected by the customer's choice such as a week or a month. We provide a service that allows you to create a meal schedule for a certain period of time that allows you to subtract calories. Use the vibration function of your smartphone to calibrate your calorie reduction measurement. Precisely measure the number of steps each time you take a step, You can selectively use the pedometer function to display the calorie consumption figures. If you enter the type of work and the working time, you can calibrate the calories consumed according to the type of work and the type of work, When calculating the total calories per day, the calories consumed in one day are subtracted from the calories consumed in the day, and the current calorie amount is calculated in real time, and the food consumed by the customer is photographed with the camera of the smartphone associated with the application, The image is sent to the company's server. It is a deep processing method that processes big data of the company by repeating the clustering process by using the 'no-learning method' which is a method of finding a large number of files, Through an algorithm of artificial neural network such as the way in which the human brain recognizes the pattern through a running method, various features are extracted from a large number of food photograph data, and a characteristic map is made. And the pattern, as if human beings distinguish objects. The data is classified and the food is searched like a photograph, and the image matching with the same food amount is searched out among the food quantity divided into 12 steps, and the calorie is measured, Food types like images And 12 steps, you can send the same amount of calories to the customer through the server, so you can immediately check the calories of the food you have bought, and the calories of the food are summed up on a daily basis, The body mass index, which is the standard for exceeding the calories, is calculated by the average body mass index of the public according to the body size inputted in advance, or the average value measured by the customer on the previous day BMI, or a customer's average body mass index, measured on a week-by-month basis, to determine the baseline BMI, calculate the total calories consumed for each type of work, The result of the sum of the calorie consumption and the added knife of the food taken during the day If the calculated body mass index exceeds the selected reference body mass index, a warning message is provided and excess calorie information and exercise information that can consume the calories are provided. The exercise information includes exercise tastes, favorite exercise and body mass Analyze the index to help customers easily follow and use their favorite and favorite motion picture information, information on various calorie consumption methods, exercise information in sports centers and health clubs, And a service that shows the character and the like of the character performing the same exercise with the customer in real time through the designation of the time setting and the method such as walking and running, and if the sports center is selected from the exercise information, Is automatically activated, so you can swim in the sports center closest to your current location, Yoga, badminton, tennis, table tennis, squash, etc., i.e., information such as position, exercise time, cost, and shortest distance movement interval. When the customer chooses a health club, the GPS of the smartphone is automatically activated, promising to provide the service already, and the location of the health club closest to the customer's current location, trainer information, price, exercise Time, and so on. In order for the customer to exercise in the gym or take the appointment time with the gym to receive personal training, the trainer of the gym must check the customer information in advance so that the customer can receive the desired exercise training, , You can send information such as your body mass index, exercise propensity, favorite exercise programs, existing exercise programs, etc. recorded in the server to the trainer of the health club, and select a trainer, If you check and send the information, your system When a message is sent to a non-registered health club and approved by the health club, the authorization information is sent back to the customer via the company server to provide information on the on-line application where the service is concluded, Giving O2O service calorie management system.

Images