CN107656611A - Somatosensory game realization method and device, terminal equipment - Google Patents

Somatosensory game realization method and device, terminal equipment Download PDF

Info

Publication number
CN107656611A
CN107656611A CN201710676899.2A CN201710676899A CN107656611A CN 107656611 A CN107656611 A CN 107656611A CN 201710676899 A CN201710676899 A CN 201710676899A CN 107656611 A CN107656611 A CN 107656611A
Authority
CN
China
Prior art keywords
game user
television game
somatic sensation
sensation television
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710676899.2A
Other languages
Chinese (zh)
Inventor
周意保
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201710676899.2A priority Critical patent/CN107656611A/en
Publication of CN107656611A publication Critical patent/CN107656611A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides a method and a device for realizing a motion sensing game and a terminal device, wherein the method comprises the following steps: projecting the somatosensory game user by adopting structured light equipment to obtain a 3D model of the somatosensory game user at each time point; analyzing the 3D model of each time point somatosensory game user to obtain the posture information of each time point somatosensory game user; determining motion information of the motion sensing game user and a control instruction matched with the motion information according to the posture information of the motion sensing game user at each time point; according to the control instruction, the motion sensing game is operated, so that a motion sensing game user can control the operation of the motion sensing game by making a certain action, the motion sensing game on the terminal device is effectively and visually operated in the air, the behavior mode of the user does not need to be bound, and the game operation efficiency and the game operation experience are improved.

Description

体感游戏实现方法及装置、终端设备Somatosensory game realization method and device, terminal equipment

技术领域technical field

本发明涉及终端设备领域，尤其涉及一种体感游戏实现方法及装置、终端设备。The present invention relates to the field of terminal equipment, in particular to a method and device for realizing a somatosensory game, and a terminal equipment.

背景技术Background technique

目前，人机交互技术是指通过输入输出设备，以有效的方式实现人与机器交互的技术。现有的人机交互的交互方式通常是通过鼠标、键盘、触摸屏或者手柄等外部设备与机器系统进行交互，机器系统再做出相应的响应。比如当用户需要对终端设备上的游戏进行操作时，用户需要通过按键或者触摸屏等实现对游戏的点击或者其他操作，从而实现对游戏的操作。At present, human-computer interaction technology refers to the technology of realizing human-machine interaction in an effective way through input and output devices. Existing human-computer interaction methods usually interact with the machine system through external devices such as a mouse, keyboard, touch screen, or handle, and the machine system makes a corresponding response. For example, when the user needs to operate a game on the terminal device, the user needs to click or perform other operations on the game through buttons or a touch screen, so as to realize the operation on the game.

现有的游戏操作方式，都需要用户与输入设备比如触摸屏进行接触才能完成游戏操作，使得用户玩游戏时必须依赖于外部设备，束缚用户的行为方式，降低了游戏操作效率和游戏操作体验。Existing game operation methods require the user to contact an input device such as a touch screen to complete the game operation, so that the user must rely on external devices when playing the game, which restricts the user's behavior and reduces the game operation efficiency and game operation experience.

发明内容Contents of the invention

本发明旨在至少在一定程度上解决相关技术中的技术问题之一。The present invention aims to solve one of the technical problems in the related art at least to a certain extent.

为此，本发明的第一个目的在于提出一种体感游戏实现方法，以实现对终端设备上的体感游戏进行有效、直观的操作，以及解决现有技术中用户玩游戏时必须依赖于外部设备，束缚用户的行为方式，降低了游戏操作效率和游戏操作体验的问题。For this reason, the first purpose of the present invention is to propose a method for implementing a somatosensory game, so as to realize effective and intuitive operation of the somatosensory game on the terminal device, and solve the problem that users must rely on external devices when playing games in the prior art. , Restricting the user's behavior, reducing the efficiency of game operation and the problem of game operation experience.

本发明的第二个目的在于提出一种体感游戏实现装置。The second object of the present invention is to provide a somatosensory game realization device.

本发明的第三个目的在于提出一种终端设备。The third object of the present invention is to provide a terminal device.

本发明的第四个目的在于提出一种非临时性计算机可读存储介质。A fourth object of the present invention is to provide a non-transitory computer-readable storage medium.

为达上述目的，本发明第一方面实施例提出了一种体感游戏实现方法，包括：In order to achieve the above purpose, the embodiment of the first aspect of the present invention proposes a method for implementing a somatosensory game, including:

采用结构光设备向体感游戏用户进行投影，获取各个时间点所述体感游戏用户的3D模型；Use structured light equipment to project to the somatosensory game user, and obtain the 3D model of the somatosensory game user at each time point;

对各个时间点所述体感游戏用户的3D模型进行分析，获取各个时间点所述体感游戏用户的姿态信息；Analyzing the 3D model of the user of the somatosensory game at each time point, and obtaining the gesture information of the user of the somatosensory game at each time point;

根据各个时间点所述体感游戏用户的姿态信息，确定所述体感游戏用户的动作信息以及与所述动作信息匹配的控制指令；According to the posture information of the somatosensory game user at each time point, determine the motion information of the somatosensory game user and the control instruction matching the motion information;

根据所述控制指令，对所述体感游戏进行操作。According to the control instruction, the somatosensory game is operated.

作为本发明第一方面实施例的一种可能的实现方式，所述采用结构光设备向体感游戏用户进行投影，获取各个时间点所述体感游戏用户的3D模型，包括：As a possible implementation of the embodiment of the first aspect of the present invention, the use of structured light equipment to project to the somatosensory game user and obtain the 3D model of the somatosensory game user at each time point includes:

针对各个时间点，采用结构光设备向体感游戏用户进行投影；For each time point, use structured light equipment to project to somatosensory game users;

采用摄像机对所述体感游戏用户进行摄像，获取所述体感游戏用户的深度图像；Using a camera to take pictures of the somatosensory game user to obtain a depth image of the somatosensory game user;

结合所述体感游戏用户的深度图像，以及所述结构光设备和所述摄像机之间的位置关系，计算获取所述体感游戏用户的3D模型。Combined with the depth image of the somatosensory game user and the positional relationship between the structured light device and the camera, the 3D model of the somatosensory game user is calculated and acquired.

作为本发明第一方面实施例的一种可能的实现方式，所述结构光设备产生的结构光为非均匀结构光。As a possible implementation manner of the embodiment of the first aspect of the present invention, the structured light generated by the structured light device is non-uniform structured light.

作为本发明第一方面实施例的一种可能的实现方式，所述对各个时间点所述体感游戏用户的3D模型进行分析，获取各个时间点所述体感游戏用户的姿态信息，包括：As a possible implementation of the embodiment of the first aspect of the present invention, the analyzing the 3D model of the user of the somatosensory game at each time point, and obtaining the posture information of the user of the somatosensory game at each time point includes:

针对各个时间点，对所述体感游戏用户的3D模型进行分析，提取所述3D模型中的特征点信息；For each time point, analyze the 3D model of the user of the somatosensory game, and extract the feature point information in the 3D model;

将所述3D模型中的特征点信息与预设的各个姿态信息对应的特征点信息进行比对，获取所述体感游戏用户的3D模型与各个姿态信息之间的匹配度；Comparing the feature point information in the 3D model with the feature point information corresponding to each preset posture information, and obtaining the matching degree between the 3D model of the somatosensory game user and each posture information;

将对应的匹配度大于预设阈值的姿态信息确定为所述体感游戏用户的姿态信息。Determining the gesture information whose matching degree is greater than a preset threshold as the gesture information of the user of the somatosensory game.

作为本发明第一方面实施例的一种可能的实现方式，所述根据各个时间点所述体感游戏用户的姿态信息，确定所述体感游戏用户的动作信息以及与所述动作信息匹配的控制指令，包括：As a possible implementation of the embodiment of the first aspect of the present invention, according to the gesture information of the user of the somatosensory game at each time point, the action information of the user of the somatosensory game and the control instruction matching the action information are determined ,include:

根据各个时间点所述体感游戏用户的姿态信息，确定所述体感游戏用户的动作信息；According to the posture information of the somatosensory game user at each time point, determine the action information of the somatosensory game user;

根据所述体感游戏用户的动作信息，查询预设的控制指令表，获取与所述动作信息匹配的控制指令。According to the action information of the user of the somatosensory game, query the preset control instruction table to obtain the control instruction matching the action information.

作为本发明第一方面实施例的一种可能的实现方式，所述根据各个时间点所述体感游戏用户的姿态信息，确定所述体感游戏用户的动作信息，包括：As a possible implementation of the embodiment of the first aspect of the present invention, the determination of the action information of the user of the somatosensory game according to the gesture information of the user of the somatosensory game at each time point includes:

根据各个时间点所述体感游戏用户的姿态信息，确定所述体感游戏用户的姿态序列；According to the gesture information of the somatosensory game user at each time point, determine the gesture sequence of the somatosensory game user;

根据所述体感游戏用户的姿态序列，确定与所述姿态序列匹配的动作信息。According to the gesture sequence of the user of the somatosensory game, action information matching the gesture sequence is determined.

本发明实施例的体感游戏实现方法，通过采用结构光设备向体感游戏用户进行投影，获取各个时间点体感游戏用户的3D模型；对各个时间点体感游戏用户的3D模型进行分析，获取各个时间点体感游戏用户的姿态信息；根据各个时间点体感游戏用户的姿态信息，确定体感游戏用户的动作信息以及与动作信息匹配的控制指令；根据控制指令，对体感游戏进行操作，使得体感游戏用户可以通过做出一定的动作来控制体感游戏的操作，从而实现对终端设备上的体感游戏进行有效、直观的隔空操作，不需要束缚用户的行为方式，提高了游戏操作效率和游戏操作体验。The implementation method of the somatosensory game in the embodiment of the present invention uses structured light equipment to project onto the somatosensory game user to obtain the 3D model of the somatosensory game user at each time point; analyze the 3D model of the somatosensory game user at each time point to obtain each time point Gesture information of the somatosensory game user; according to the posture information of the somatosensory game user at each time point, determine the motion information of the somatosensory game user and the control instruction matching the action information; operate the somatosensory game according to the control instruction, so that the somatosensory game user can pass Make certain actions to control the operation of the somatosensory game, so as to realize effective and intuitive air-space operation of the somatosensory game on the terminal device, without restricting the user's behavior, and improving the game operation efficiency and game operation experience.

为达上述目的，本发明第二方面实施例提出了一种体感游戏实现装置，包括：In order to achieve the above purpose, the embodiment of the second aspect of the present invention proposes a somatosensory game realization device, including:

投影模块，用于采用结构光设备向体感游戏用户进行投影，获取各个时间点所述体感游戏用户的3D模型；The projection module is used to project the user of the somatosensory game using a structured light device, and obtain the 3D model of the user of the somatosensory game at each time point;

分析模块，用于对各个时间点所述体感游戏用户的3D模型进行分析，获取各个时间点所述体感游戏用户的姿态信息；An analysis module, configured to analyze the 3D model of the user of the somatosensory game at each time point, and obtain posture information of the user of the somatosensory game at each time point;

确定模块，用于根据各个时间点所述体感游戏用户的姿态信息，确定所述体感游戏用户的动作信息以及与所述动作信息匹配的控制指令；A determining module, configured to determine action information of the somatosensory game user and a control instruction matching the action information according to the posture information of the somatosensory game user at each time point;

操作模块，用于根据所述控制指令，对所述体感游戏进行操作。An operating module, configured to operate the somatosensory game according to the control instruction.

作为本发明第二方面实施例的一种可能的实现方式，所述投影模块包括：As a possible implementation of the embodiment of the second aspect of the present invention, the projection module includes:

投影单元，用于针对各个时间点，采用结构光设备向体感游戏用户进行投影；The projection unit is used for projecting to the somatosensory game users by using the structured light device at each time point;

摄像单元，用于采用摄像机对所述体感游戏用户进行摄像，获取所述体感游戏用户的深度图像；A camera unit, configured to use a camera to take pictures of the somatosensory game user and obtain a depth image of the somatosensory game user;

计算单元，用于结合所述体感游戏用户的深度图像，以及所述结构光设备和所述摄像机之间的位置关系，计算获取所述体感游戏用户的3D模型。A computing unit, configured to calculate and acquire a 3D model of the somatosensory game user in combination with the depth image of the somatosensory game user and the positional relationship between the structured light device and the camera.

作为本发明第二方面实施例的一种可能的实现方式，所述结构光设备产生的结构光为非均匀结构光。As a possible implementation manner of the embodiment of the second aspect of the present invention, the structured light generated by the structured light device is non-uniform structured light.

作为本发明第二方面实施例的一种可能的实现方式，所述分析模块包括：As a possible implementation of the embodiment of the second aspect of the present invention, the analysis module includes:

提取单元，用于针对各个时间点，对所述体感游戏用户的3D模型进行分析，提取所述3D模型中的特征点信息；An extraction unit, configured to analyze the 3D model of the somatosensory game user at each time point, and extract feature point information in the 3D model;

比对单元，用于将所述3D模型中的特征点信息与预设的各个姿态信息对应的特征点信息进行比对，获取所述体感游戏用户的3D模型与各个姿态信息之间的匹配度；A comparison unit, configured to compare the feature point information in the 3D model with the feature point information corresponding to each preset posture information, and obtain the matching degree between the 3D model of the somatosensory game user and each posture information ;

第一确定单元，用于将对应的匹配度大于预设阈值的姿态信息确定为所述体感游戏用户的姿态信息。The first determining unit is configured to determine the corresponding gesture information whose matching degree is greater than a preset threshold as the gesture information of the user of the somatosensory game.

作为本发明第二方面实施例的一种可能的实现方式，所述确定模块包括：As a possible implementation of the embodiment of the second aspect of the present invention, the determining module includes:

第二确定单元，用于根据各个时间点所述体感游戏用户的姿态信息，确定所述体感游戏用户的动作信息；The second determining unit is configured to determine the action information of the somatosensory game user according to the posture information of the somatosensory game user at each time point;

查询单元，用于根据所述体感游戏用户的动作信息，查询预设的控制指令表，获取与所述动作信息匹配的控制指令。The query unit is configured to query a preset control command table according to the action information of the user of the somatosensory game, and acquire a control command matching the action information.

作为本发明第二方面实施例的一种可能的实现方式，所述第二确定单元具体用于，As a possible implementation manner of the embodiment of the second aspect of the present invention, the second determining unit is specifically configured to:

根据各个时间点所述体感游戏用户的姿态信息，确定所述体感游戏用户的姿态序列；According to the gesture information of the somatosensory game user at each time point, determine the gesture sequence of the somatosensory game user;

根据所述体感游戏用户的姿态序列，确定与所述姿态序列匹配的动作信息。According to the gesture sequence of the user of the somatosensory game, action information matching the gesture sequence is determined.

本发明实施例的体感游戏实现装置，通过采用结构光设备向体感游戏用户进行投影，获取各个时间点体感游戏用户的3D模型；对各个时间点体感游戏用户的3D模型进行分析，获取各个时间点体感游戏用户的姿态信息；根据各个时间点体感游戏用户的姿态信息，确定体感游戏用户的动作信息以及与动作信息匹配的控制指令；根据控制指令，对体感游戏进行操作，使得体感游戏用户可以通过做出一定的动作来控制体感游戏的操作，从而实现对终端设备上的体感游戏进行有效、直观的隔空操作，不需要束缚用户的行为方式，提高了游戏操作效率和游戏操作体验。The somatosensory game implementation device of the embodiment of the present invention uses structured light equipment to project onto the somatosensory game user to obtain the 3D model of the somatosensory game user at each time point; analyze the 3D model of the somatosensory game user at each time point to obtain each time point Gesture information of the somatosensory game user; according to the posture information of the somatosensory game user at each time point, determine the motion information of the somatosensory game user and the control instruction matching the action information; operate the somatosensory game according to the control instruction, so that the somatosensory game user can pass Make certain actions to control the operation of the somatosensory game, so as to realize effective and intuitive air-space operation of the somatosensory game on the terminal device, without restricting the user's behavior, and improving the game operation efficiency and game operation experience.

为达上述目的，本发明第三方面实施例提出了一种终端设备，包括：To achieve the above purpose, the embodiment of the third aspect of the present invention proposes a terminal device, including:

壳体和位于所述壳体内的处理器和存储器，其中，所述处理器通过读取所述存储器中存储的可执行程序代码来运行与所述可执行程序代码对应的程序，以用于实现如本发明第一方面实施例所述的体感游戏实现方法。a housing and a processor and a memory located in the housing, wherein the processor executes a program corresponding to the executable program code by reading the executable program code stored in the memory, so as to realize The realization method of the somatosensory game as described in the embodiment of the first aspect of the present invention.

为达上述目的，本发明第四方面实施例提出了一种非临时性计算机可读存储介质，其上存储有计算机程序，当计算机程序被处理器执行时实现如第一方面实施例所述的体感游戏实现方法。To achieve the above purpose, the embodiment of the fourth aspect of the present invention proposes a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it realizes the Realization method of somatosensory game.

本发明附加的方面和优点将在下面的描述中部分给出，部分将从下面的描述中变得明显，或通过本发明的实践了解到。Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

附图说明Description of drawings

本发明上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解，其中：The above and/or additional aspects and advantages of the present invention will become apparent and easy to understand from the following description of the embodiments in conjunction with the accompanying drawings, wherein:

图1为本发明实施例提供的一种体感游戏实现方法的流程示意图；FIG. 1 is a schematic flowchart of a method for implementing a somatosensory game provided by an embodiment of the present invention;

图2为本发明实施例提供的不同形式的结构光投影的示意图；Fig. 2 is a schematic diagram of different forms of structured light projection provided by an embodiment of the present invention;

图3为本发明实施例提供的另一种体感游戏实现方法的流程示意图；FIG. 3 is a schematic flowchart of another method for implementing a somatosensory game provided by an embodiment of the present invention;

图4为本发明实施例提供的另一种体感游戏实现方法的流程示意图；Fig. 4 is a schematic flowchart of another method for implementing a somatosensory game provided by an embodiment of the present invention;

图5为本发明实施例提供的一种体感游戏实现装置的结构示意图；Fig. 5 is a schematic structural diagram of a somatosensory game realization device provided by an embodiment of the present invention;

图6为本发明实施例提供的另一种体感游戏实现装置的结构示意图；Fig. 6 is a schematic structural diagram of another somatosensory game implementation device provided by an embodiment of the present invention;

图7为本发明实施例提供的另一种体感游戏实现装置的结构示意图；Fig. 7 is a schematic structural diagram of another somatosensory game realization device provided by an embodiment of the present invention;

图8为本发明实施例提供的另一种体感游戏实现装置的结构示意图；Fig. 8 is a schematic structural diagram of another somatosensory game realization device provided by an embodiment of the present invention;

图9为本发明实施例提供的一种终端设备的结构示意图。FIG. 9 is a schematic structural diagram of a terminal device provided by an embodiment of the present invention.

具体实施方式Detailed ways

下面详细描述本发明的实施例，所述实施例的示例在附图中示出，其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的，旨在用于解释本发明，而不能理解为对本发明的限制。Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

下面参考附图描述本发明实施例的体感游戏实现方法及装置、终端设备。The method, device, and terminal device for implementing a somatosensory game according to the embodiments of the present invention will be described below with reference to the accompanying drawings.

以实现对终端设备上的体感游戏进行有效、直观的操作，以及解决现有技术中用户玩游戏时必须依赖于外部设备，束缚用户的行为方式，降低了游戏操作效率和游戏操作体验的问题。In order to realize the effective and intuitive operation of the somatosensory game on the terminal device, and solve the problems in the prior art that the user must rely on external devices when playing games, restrict the user's behavior, and reduce the game operation efficiency and game operation experience.

图1为本发明实施例提供的体感游戏实现方法的流程示意图。Fig. 1 is a schematic flowchart of a method for realizing a somatosensory game provided by an embodiment of the present invention.

如图1所示，该体感游戏实现方法包括以下步骤：As shown in Figure 1, the implementation method of the somatosensory game includes the following steps:

S101、采用结构光设备向体感游戏用户进行投影，获取各个时间点体感游戏用户的3D模型。S101. Using a structured light device to project onto a motion-sensing game user, and acquiring a 3D model of the motion-sensing game user at each time point.

本实施例提供的体感游戏实现方法的执行主体为体感游戏实现装置，体感游戏实现装置具体可以为安装在终端设备上的硬件或者软件。可选的，该硬件或者软件可以为体感游戏软件本身。该终端设备可以为智能手机、平板电脑、ipad等。The execution body of the method for implementing a somatosensory game provided in this embodiment is a device for implementing a somatosensory game, and the device for implementing a somatosensory game may specifically be hardware or software installed on a terminal device. Optionally, the hardware or software can be the somatosensory game software itself. The terminal device may be a smart phone, a tablet computer, an ipad, and the like.

本实施例中，结构光指的是已知空间方向的投影光线的集合。结构光设备指的是生成结构光，可以将结构光投影到被测对象上的设备。结构光的模式可以包括：点结构光模式、线结构光模式、多线结构光模式、面结构光模式和相位法模式。点结构光模式指的是结构光设备发出的光束投射到被测对象上产生一个光点；光点经摄像机的镜头成像在摄像机的成像平面上，形成一个二维点。线结构光模式指的是结构光设备发出的光束投射到被测对象上产生一条光线；光线经摄像机的镜头成像在摄像机的成像平面上，形成一条可能发生畸变或者断裂的光线。多线结构光模式指的是结构光设备发出的光束投射到被测对象上产生多条光线。面结构光模式指的是结构光设备发出的光束投射到被测对象上产生光面。其中，光的畸变程度与被测对象上各部位的深度呈正比。光的断裂程度与被测对象上的裂缝等相关。In this embodiment, structured light refers to a collection of projection rays with known spatial directions. A structured light device refers to a device that generates structured light and can project the structured light onto the object under test. The modes of structured light may include: point structured light mode, line structured light mode, multi-line structured light mode, surface structured light mode and phase method mode. The point structured light mode means that the light beam emitted by the structured light device is projected onto the measured object to generate a light spot; the light spot is imaged on the imaging plane of the camera through the camera lens to form a two-dimensional point. The line structured light mode refers to that the light beam emitted by the structured light device is projected onto the measured object to generate a light; the light is imaged on the imaging plane of the camera through the lens of the camera, forming a light that may be distorted or broken. The multi-line structured light mode refers to the fact that the beam emitted by the structured light device is projected onto the object under test to generate multiple rays. The surface structured light mode refers to that the light beam emitted by the structured light device is projected onto the measured object to generate a light surface. Wherein, the degree of distortion of light is proportional to the depth of each part on the measured object. The degree of light breakage is related to cracks etc. on the measured object.

结合摄像机的成像平面上的光点、光线或者光面，以及摄像机与结构光设备的位置关系，可以得到三角几何约束关系，并由其可以唯一确定光点、光线或者光面在已知世界坐标系中的空间位置，即确定被测对象上各个部位、各个特征点在已知世界坐标系中的空间位置；进而结合摄像机采集的颜色信息，能够完成对被测对象的三维空间的复原。如图2所示，为不同的结构光设备在被测对象上形成的不同形式的结构光投影。Combining the light point, ray or light surface on the imaging plane of the camera, and the positional relationship between the camera and the structured light device, the triangular geometric constraint relationship can be obtained, and it can uniquely determine the coordinates of the light point, ray or light surface in the known world The spatial position in the system, that is, to determine the spatial position of each part and each feature point on the measured object in the known world coordinate system; and then combined with the color information collected by the camera, the three-dimensional space restoration of the measured object can be completed. As shown in Figure 2, it is different forms of structured light projections formed on the measured object by different structured light devices.

另外，还需要进行说明的是，本实施例中，结构光的模式还可以包括：散斑结构光模式，散斑结构光模式指的是结构光设备发出的光束投射到被测对象上产生非均匀光点阵列。In addition, it needs to be explained that in this embodiment, the mode of structured light may also include: speckle structured light mode, which means that the light beam emitted by the structured light device is projected onto the measured object to generate non- Uniform array of light spots.

本实施例中，具体的，针对各个时间点，体感游戏实现装置可以调用结构光设备向体感游戏用户进行投影；采用摄像机对体感游戏用户进行摄像，获取体感游戏用户的深度图像；结合体感游戏用户的深度图像，以及结构光设备和摄像机之间的位置关系，计算获取体感游戏用户的3D模型。In this embodiment, specifically, for each time point, the somatosensory game implementation device can call the structured light device to project to the somatosensory game user; use the camera to take pictures of the somatosensory game user to obtain the depth image of the somatosensory game user; combine the somatosensory game user The depth image, as well as the positional relationship between the structured light device and the camera, is calculated to obtain the 3D model of the somatosensory game user.

本实施例中，体感游戏实现装置可以预先获取体感游戏用户所在位置，根据体感游戏用户所在位置调整结构光设备的投影角度以及投影范围，以将体感游戏用户所在位置纳入投影范围。In this embodiment, the somatosensory game implementation device can obtain the location of the somatosensory game user in advance, and adjust the projection angle and projection range of the structured light device according to the location of the somatosensory game user, so as to include the location of the somatosensory game user into the projection range.

本实施例中，体感游戏实现装置获取体感游戏用户的深度图像的方式可以为，体感游戏实现装置调用结构光设备向周围的场景进行投影，获取周围的场景中的所有对象的深度图像，对所有对象的深度图像进行分析，获取所有对象的特征点信息，对所有对象的特征点信息进行分析，获取属于体感游戏用户的特征点信息，确定体感游戏用户的位置，进而获取体感游戏用户的深度图像。In this embodiment, the way for the somatosensory game implementation device to obtain the depth image of the somatosensory game user may be that the somatosensory game realization device invokes the structured light device to project to the surrounding scene, acquires the depth images of all objects in the surrounding scene, Analyze the depth image of the object, obtain the feature point information of all objects, analyze the feature point information of all objects, obtain the feature point information belonging to the somatosensory game user, determine the position of the somatosensory game user, and then obtain the depth image of the somatosensory game user .

本实施例中，各个时间点、各个时间点之间的时间差值可以根据需要进行设定，例如根据体感游戏用户的移动速度以及动作速度进行设定。In this embodiment, each time point and the time difference between each time point can be set as required, for example, set according to the moving speed and action speed of the user of the somatosensory game.

S102、对各个时间点体感游戏用户的3D模型进行分析，获取各个时间点体感游戏用户的姿态信息。S102. Analyze the 3D model of the user of the motion sensing game at each time point, and acquire posture information of the user of the motion sensing game at each time point.

本实施例中，体感游戏实现装置可以对各个时间点体感游戏用户的3D模型进行分析，获取各个时间点体感游戏用户的特征点信息，根据各个时间点体感游戏用户的特征点信息，确定各个时间点体感游戏用户的姿态信息。In this embodiment, the somatosensory game implementation device can analyze the 3D models of the somatosensory game users at each time point, obtain the feature point information of the somatosensory game users at each time point, and determine each time point according to the feature point information of the somatosensory game users at each time point. Point the gesture information of the user of the somatosensory game.

本实施例中，体感游戏用户的姿态信息指的是，体感游戏用户摆出的姿态，例如坐姿、站姿、下蹲的姿态、弯腰的姿态、打球的姿态等等。In this embodiment, the posture information of the user of the motion sensing game refers to the posture of the user of the motion sensing game, such as sitting posture, standing posture, squatting posture, bending posture, playing posture and so on.

S103、根据各个时间点体感游戏用户的姿态信息，确定体感游戏用户的动作信息以及与动作信息匹配的控制指令。S103. According to the gesture information of the user of the motion-sensing game at each time point, determine the motion information of the motion-sensing game user and the control instruction matching the motion information.

本实施例中，体感游戏实现装置根据各个时间点体感游戏用户的姿态信息，也就是说根据体感游戏用户在一段时间内摆出的一系列姿态，确定体感游戏用户所做出的动作，根据体感游戏用户所做出的动作确定与所述动作匹配的控制指令。In this embodiment, the somatosensory game implementation device determines the actions made by the somatosensory game user according to the gesture information of the somatosensory game user at each time point, that is to say, according to a series of gestures made by the somatosensory game user within a period of time, The actions made by the game user determine the control instructions matching the actions.

本实施例中，体感游戏用户的动作例如打球动作、跳舞动作、手势动作等等。跳舞动作可以拆分为一系列姿态，例如多个连续的跳舞姿态等。In this embodiment, the actions of the user of the somatosensory game include ball playing, dancing, gestures and so on. Dancing actions can be split into a series of gestures, such as multiple consecutive dancing gestures.

S104、根据控制指令，对体感游戏进行操作。S104. Operate the somatosensory game according to the control instruction.

本实施例中，体感游戏实现装置可以根据控制指令，对体感游戏进行如下操作：控制体感游戏中的人物进行移动、转向、动作等；对体感游戏进行开启或关闭、对体感游戏中的参数进行设置等。In this embodiment, the device for implementing the somatosensory game can perform the following operations on the somatosensory game according to the control instructions: control the characters in the somatosensory game to move, turn, and perform actions, etc.; turn on or off the somatosensory game; settings etc.

本发明实施例的体感游戏实现方法，通过采用结构光设备向体感游戏用户进行投影，获取各个时间点体感游戏用户的3D模型；对各个时间点体感游戏用户的3D模型进行分析，获取各个时间点体感游戏用户的姿态信息；根据各个时间点体感游戏用户的姿态信息，确定体感游戏用户的动作信息以及与动作信息匹配的控制指令；根据控制指令，对体感游戏进行操作，使得体感游戏用户可以通过做出一定的动作来控制体感游戏的操作，从而实现对终端设备上的体感游戏进行有效、直观的隔空操作，不需要束缚用户的行为方式，提高了游戏操作效率和游戏操作体验。The implementation method of the somatosensory game in the embodiment of the present invention uses structured light equipment to project onto the somatosensory game user to obtain the 3D model of the somatosensory game user at each time point; analyze the 3D model of the somatosensory game user at each time point to obtain each time point Gesture information of the somatosensory game user; according to the posture information of the somatosensory game user at each time point, determine the motion information of the somatosensory game user and the control instruction matching the action information; operate the somatosensory game according to the control instruction, so that the somatosensory game user can pass Make certain actions to control the operation of the somatosensory game, so as to realize effective and intuitive air-space operation of the somatosensory game on the terminal device, without restricting the user's behavior, and improving the game operation efficiency and game operation experience.

图3为本发明实施例提供的另一种体感游戏实现方法的流程示意图。如图3所示，在图1所示实施例的基础上，步骤102具体可以包括：Fig. 3 is a schematic flowchart of another method for realizing a somatosensory game provided by an embodiment of the present invention. As shown in FIG. 3, on the basis of the embodiment shown in FIG. 1, step 102 may specifically include:

S1021、针对各个时间点，对体感游戏用户的3D模型进行分析，提取3D模型中的特征点信息。S1021. For each time point, analyze the 3D model of the motion sensing game user, and extract feature point information in the 3D model.

本实施例中，体感游戏实现装置可以对体感游戏用户的3D模型进行分析，提取特定区域例如眼睛所在区域、眉毛所在区域、鼻子所在区域、嘴巴所在区域、耳朵所在区域的特征点信息。In this embodiment, the somatosensory game implementation device can analyze the 3D model of the somatosensory game user, and extract feature point information of specific areas such as the eye area, the eyebrow area, the nose area, the mouth area, and the ear area.

S1022、将3D模型中的特征点信息与预设的各个姿态信息对应的特征点信息进行比对，获取体感游戏用户的3D模型与各个姿态信息之间的匹配度。S1022. Compare the feature point information in the 3D model with the feature point information corresponding to each preset gesture information, and obtain a matching degree between the 3D model of the user of the somatosensory game and each gesture information.

本实施例中，体感游戏实现装置可以预先保存有各个动作中的各个姿态信息对应的特征点信息。体感游戏实现装置获取各个姿态信息对应的特征点信息的方式可以为，提示让体感游戏用户或者体感游戏工作人员作出各个姿态，采用结构光设备对体感游戏用户或者体感游戏工作人员进行投影，获取体感游戏用户或者体感游戏工作人员的3D模型，对3D模型进行分析，从而得到各个姿态信息对应的特征点信息，将姿态信息及对应的特征点信息进行存储，以便后续查询。In this embodiment, the device for implementing a somatosensory game may pre-save feature point information corresponding to each gesture information in each action. The way for the somatosensory game implementation device to obtain the feature point information corresponding to each gesture information may be to prompt the somatosensory game user or the somatosensory game staff to make various gestures, and use the structured light device to project the somatosensory game user or somatosensory game staff to obtain the somatosensory game. The 3D model of the game user or the somatosensory game staff is analyzed to obtain the feature point information corresponding to each gesture information, and the gesture information and the corresponding feature point information are stored for subsequent query.

本实施例中，姿态信息可以为姿态的标识、名称、用户的关节角度等参数中的任意一个或者多个参数。In this embodiment, the gesture information may be any one or more parameters of the gesture's identifier, name, user's joint angle and other parameters.

S1023、将对应的匹配度大于预设阈值的姿态信息确定为体感游戏用户的姿态信息。S1023. Determine the gesture information whose matching degree is greater than the preset threshold as gesture information of the user of the somatosensory game.

本发明实施例的体感游戏实现方法，通过采用结构光设备向体感游戏用户进行投影，获取各个时间点体感游戏用户的3D模型；针对各个时间点，对体感游戏用户的3D模型进行分析，提取3D模型中的特征点信息；将3D模型中的特征点信息与预设的各个姿态信息对应的特征点信息进行比对，获取体感游戏用户的3D模型与各个姿态信息之间的匹配度；将对应的匹配度大于预设阈值的姿态信息确定为体感游戏用户的姿态信息；根据各个时间点体感游戏用户的姿态信息，确定体感游戏用户的动作信息以及与动作信息匹配的控制指令；根据控制指令，对体感游戏进行操作，使得体感游戏用户可以通过做出一定的动作来控制体感游戏的操作，从而实现对终端设备上的体感游戏进行有效、直观的隔空操作，不需要束缚用户的行为方式，提高了游戏操作效率和游戏操作体验。In the implementation method of the somatosensory game in the embodiment of the present invention, the 3D model of the somatosensory game user is obtained at each time point by using structured light equipment to project to the somatosensory game user; for each time point, the 3D model of the somatosensory game user is analyzed to extract the 3D The feature point information in the model; compare the feature point information in the 3D model with the feature point information corresponding to each preset posture information, and obtain the matching degree between the 3D model of the somatosensory game user and each posture information; The posture information whose matching degree is greater than the preset threshold is determined as the posture information of the motion sensing game user; according to the posture information of the motion sensing game user at each time point, determine the motion information of the motion sensing game user and the control instruction matched with the motion information; according to the control instruction, Operate the somatosensory game, so that the user of the somatosensory game can control the operation of the somatosensory game by making certain actions, so as to realize effective and intuitive operation of the somatosensory game on the terminal device without restricting the user's behavior. Improved game operation efficiency and game operation experience.

图4为本发明实施例提供的另一种体感游戏实现方法的流程示意图。如图4所示，在图1所示实施例的基础上，步骤103具体可以包括：Fig. 4 is a schematic flowchart of another implementation method for a somatosensory game provided by an embodiment of the present invention. As shown in FIG. 4, on the basis of the embodiment shown in FIG. 1, step 103 may specifically include:

S1031、根据各个时间点体感游戏用户的姿态信息，确定体感游戏用户的动作信息。S1031. Determine motion information of the motion sensing game user according to the posture information of the motion sensing game user at each time point.

本实施例中，体感游戏实现装置具体可以根据各个时间点体感游戏用户的姿态信息，确定体感游戏用户的姿态序列；根据体感游戏用户的姿态序列，确定与姿态序列匹配的动作信息。In this embodiment, the somatosensory game implementation device can specifically determine the gesture sequence of the somatosensory game user according to the gesture information of the somatosensory game user at each time point; according to the gesture sequence of the somatosensory game user, determine the action information matching the gesture sequence.

本实施例中，体感游戏用户的姿态序列为一段时间内体感游戏用户的连续的多个姿态信息。In this embodiment, the gesture sequence of the user of the motion sensing game is a plurality of continuous gesture information of the user of the motion sensing game within a period of time.

S1032、根据体感游戏用户的动作信息，查询预设的控制指令表，获取与动作信息匹配的控制指令。S1032. According to the action information of the motion sensing game user, query the preset control instruction table, and obtain the control instruction matching the action information.

本实施例中，体感游戏实现装置预先保存有控制指令与动作信息之间的对应关系，或者体感游戏实现装置根据体感游戏用户的指令设置控制指令与动作信息之间的对应关系，生成控制指令表。本实施例中，体感游戏实现装置可以将控制指令表显示给体感游戏用户，以便体感游戏用户了解控制指令与动作信息之间的对应关系，在需要对体感游戏进行控制时，做出与控制指令匹配的动作，以便体感游戏实现装置根据控制指令对体感游戏进行操作，实现隔空操作。In this embodiment, the somatosensory game implementation device pre-stores the correspondence between control instructions and action information, or the somatosensory game implementation device sets the correspondence between control instructions and action information according to the instructions of the somatosensory game user, and generates a control instruction table . In this embodiment, the device for implementing the somatosensory game can display the control command list to the somatosensory game user, so that the somatosensory game user can understand the correspondence between the control command and the action information, and when it is necessary to control the somatosensory game, make a corresponding control command Matching actions, so that the device for realizing the somatosensory game can operate the somatosensory game according to the control instructions to realize air-distance operation.

其中，体感游戏实现装置可以在体感游戏用户启动体感游戏后，将控制指令表显示给体感游戏用户。Wherein, the device for realizing the motion-sensing game may display the control instruction table to the motion-sensing game user after the motion-sensing game user starts the motion-sensing game.

本发明实施例的体感游戏实现方法，通过采用结构光设备向体感游戏用户进行投影，获取各个时间点体感游戏用户的3D模型；对各个时间点体感游戏用户的3D模型进行分析，获取各个时间点体感游戏用户的姿态信息；根据各个时间点体感游戏用户的姿态信息，确定体感游戏用户的动作信息；根据体感游戏用户的动作信息，查询预设的控制指令表，获取与动作信息匹配的控制指令；根据控制指令，对体感游戏进行操作，使得体感游戏用户可以通过做出一定的动作来控制体感游戏的操作，从而实现对终端设备上的体感游戏进行有效、直观的隔空操作，不需要束缚用户的行为方式，提高了游戏操作效率和游戏操作体验。The implementation method of the somatosensory game in the embodiment of the present invention uses structured light equipment to project onto the somatosensory game user to obtain the 3D model of the somatosensory game user at each time point; analyze the 3D model of the somatosensory game user at each time point to obtain each time point Gesture information of somatosensory game users; according to the posture information of somatosensory game users at various time points, determine the action information of somatosensory game users; according to the action information of somatosensory game users, query the preset control command table to obtain control commands that match the action information ;According to the control instructions, operate the somatosensory game, so that the user of the somatosensory game can control the operation of the somatosensory game by making certain actions, so as to realize effective and intuitive air-space operation of the somatosensory game on the terminal device without restraint The user's behavior mode improves the game operation efficiency and game operation experience.

图5为本发明实施例提供的一种体感游戏实现装置的结构示意图。如图5所示，该体感游戏实现装置包括：投影模块51、分析模块52、确定模块53和操作模块54。Fig. 5 is a schematic structural diagram of a somatosensory game realization device provided by an embodiment of the present invention. As shown in FIG. 5 , the somatosensory game realization device includes: a projection module 51 , an analysis module 52 , a determination module 53 and an operation module 54 .

其中，投影模块51，用于采用结构光设备向体感游戏用户进行投影，获取各个时间点所述体感游戏用户的3D模型；Wherein, the projection module 51 is used to project to the somatosensory game user by using the structured light device, and obtain the 3D model of the somatosensory game user at each time point;

分析模块52，用于对各个时间点所述体感游戏用户的3D模型进行分析，获取各个时间点所述体感游戏用户的姿态信息；An analysis module 52, configured to analyze the 3D model of the somatosensory game user at each time point, and obtain posture information of the somatosensory game user at each time point;

确定模块53，用于根据各个时间点所述体感游戏用户的姿态信息，确定所述体感游戏用户的动作信息以及与所述动作信息匹配的控制指令；A determining module 53, configured to determine action information of the somatosensory game user and a control instruction matching the action information according to the posture information of the somatosensory game user at each time point;

操作模块54，用于根据所述控制指令，对所述体感游戏进行操作。The operating module 54 is configured to operate the somatosensory game according to the control instruction.

本实施例提供的体感游戏实现装置具体可以为安装在终端设备上的硬件或者软件。可选的，该硬件或者软件可以为体感游戏软件本身。该终端设备可以为智能手机、平板电脑、ipad等。The apparatus for implementing a somatosensory game provided in this embodiment may specifically be hardware or software installed on a terminal device. Optionally, the hardware or software can be the somatosensory game software itself. The terminal device may be a smart phone, a tablet computer, an ipad, and the like.

本实施例中，体感游戏实现装置可以对各个时间点体感游戏用户的3D模型进行分析，获取各个时间点体感游戏用户的特征点信息，根据各个时间点体感游戏用户的特征点信息，确定各个时间点体感游戏用户的姿态信息。In this embodiment, the somatosensory game implementation device can analyze the 3D models of the somatosensory game users at each time point, obtain the feature point information of the somatosensory game users at each time point, and determine each time point according to the feature point information of the somatosensory game users at each time point. Point the gesture information of the user of the somatosensory game.

本实施例中，体感游戏用户的姿态信息指的是，体感游戏用户摆出的姿态，例如坐姿、站姿、下蹲的姿态、弯腰的姿态、打球的姿态等等。In this embodiment, the posture information of the user of the motion sensing game refers to the posture of the user of the motion sensing game, such as sitting posture, standing posture, squatting posture, bending posture, playing posture and so on.

本实施例中，体感游戏实现装置根据各个时间点体感游戏用户的姿态信息，也就是说根据体感游戏用户在一段时间内摆出的一系列姿态，确定体感游戏用户所做出的动作，根据体感游戏用户所做出的动作确定与所述动作匹配的控制指令。In this embodiment, the somatosensory game implementation device determines the actions made by the somatosensory game user according to the gesture information of the somatosensory game user at each time point, that is to say, according to a series of gestures made by the somatosensory game user within a period of time, The actions made by the game user determine the control instructions matching the actions.

本实施例中，体感游戏用户的动作例如打球动作、跳舞动作、手势动作等等。跳舞动作可以拆分为一系列姿态，例如多个连续的跳舞姿态等。In this embodiment, the actions of the user of the somatosensory game include ball playing, dancing, gestures and so on. Dancing actions can be split into a series of gestures, such as multiple consecutive dancing gestures.

本实施例中，体感游戏实现装置可以根据控制指令，对体感游戏进行如下操作：控制体感游戏中的人物进行移动、转向、动作等；对体感游戏进行开启或关闭、对体感游戏中的参数进行设置等。In this embodiment, the device for implementing the somatosensory game can perform the following operations on the somatosensory game according to the control instructions: control the characters in the somatosensory game to move, turn, and perform actions, etc.; turn on or off the somatosensory game; settings etc.

图5的基础之上，图6为本发明实施例提供的另一种体感游戏实现装置的结构示意图。如图6所示，所述投影模块51包括：投影单元511、摄像单元512和计算单元513。On the basis of FIG. 5 , FIG. 6 is a schematic structural diagram of another somatosensory game realization device provided by an embodiment of the present invention. As shown in FIG. 6 , the projection module 51 includes: a projection unit 511 , a camera unit 512 and a calculation unit 513 .

其中，投影单元511，用于针对各个时间点，采用结构光设备向体感游戏用户进行投影；Wherein, the projection unit 511 is used for projecting to the somatosensory game user by using the structured light device at each time point;

摄像单元512，用于采用摄像机对所述体感游戏用户进行摄像，获取所述体感游戏用户的深度图像；The camera unit 512 is configured to use a camera to take pictures of the user of the somatosensory game, and obtain a depth image of the user of the somatosensory game;

计算单元513，用于结合所述体感游戏用户的深度图像，以及所述结构光设备和所述摄像机之间的位置关系，计算获取所述体感游戏用户的3D模型。The computing unit 513 is configured to calculate and acquire a 3D model of the somatosensory game user by combining the depth image of the somatosensory game user and the positional relationship between the structured light device and the camera.

本实施例中，体感游戏实现装置可以预先获取体感游戏用户所在位置，根据体感游戏用户所在位置调整结构光设备的投影角度以及投影范围，以将体感游戏用户所在位置纳入投影范围。In this embodiment, the somatosensory game implementation device can obtain the location of the somatosensory game user in advance, and adjust the projection angle and projection range of the structured light device according to the location of the somatosensory game user, so as to include the location of the somatosensory game user into the projection range.

本实施例中，体感游戏实现装置获取体感游戏用户的深度图像的方式可以为，体感游戏实现装置调用结构光设备向周围的场景进行投影，获取周围的场景中的所有对象的深度图像，对所有对象的深度图像进行分析，获取所有对象的特征点信息，对所有对象的特征点信息进行分析，获取属于体感游戏用户的特征点信息，确定体感游戏用户的位置，进而获取体感游戏用户的深度图像。In this embodiment, the way for the somatosensory game realization device to obtain the depth image of the somatosensory game user may be that the somatosensory game realization device invokes the structured light device to project to the surrounding scene, acquires the depth images of all objects in the surrounding scene, and for all Analyze the depth image of the object, obtain the feature point information of all objects, analyze the feature point information of all objects, obtain the feature point information belonging to the somatosensory game user, determine the position of the somatosensory game user, and then obtain the depth image of the somatosensory game user .

本实施例中，各个时间点、各个时间点之间的时间差值可以根据需要进行设定，例如根据体感游戏用户的移动速度以及动作速度进行设定。In this embodiment, each time point and the time difference between each time point can be set as required, for example, set according to the moving speed and action speed of the user of the somatosensory game.

本发明实施例的体感游戏实现装置，通过采用结构光设备向体感游戏用户进行投影，获取各个时间点体感游戏用户的3D模型；对各个时间点体感游戏用户的3D模型进行分析，获取各个时间点体感游戏用户的姿态信息；根据各个时间点体感游戏用户的姿态信息，确定体感游戏用户的动作信息以及与动作信息匹配的控制指令；根据控制指令，对体感游戏进行操作，使得体感游戏用户可以通过做出一定的动作来控制体感游戏的操作，从而实现对终端设备上的体感游戏进行有效、直观的隔空操作，不需要束缚用户的行为方式，提高了游戏操作效率和游戏操作体验。The somatosensory game implementation device of the embodiment of the present invention uses structured light equipment to project onto the somatosensory game user to obtain the 3D model of the somatosensory game user at each time point; analyze the 3D model of the somatosensory game user at each time point to obtain each time point Gesture information of the somatosensory game user; according to the posture information of the somatosensory game user at each time point, determine the motion information of the somatosensory game user and the control instruction matching the action information; operate the somatosensory game according to the control instruction, so that the somatosensory game user can pass Make certain actions to control the operation of the somatosensory game, so as to realize effective and intuitive air-space operation of the somatosensory game on the terminal device, without restricting the user's behavior, and improving the game operation efficiency and game operation experience.

图5的基础之上，图7为本发明实施例提供的另一种体感游戏实现装置的结构示意图。如图7所示，所述分析模块52包括：提取单元521、比对单元522和第一确定单元523。On the basis of FIG. 5 , FIG. 7 is a schematic structural diagram of another somatosensory game realization device provided by an embodiment of the present invention. As shown in FIG. 7 , the analysis module 52 includes: an extraction unit 521 , a comparison unit 522 and a first determination unit 523 .

其中，提取单元521，用于针对各个时间点，对所述体感游戏用户的3D模型进行分析，提取所述3D模型中的特征点信息；Wherein, the extracting unit 521 is configured to analyze the 3D model of the somatosensory game user at each time point, and extract feature point information in the 3D model;

比对单元522，用于将所述3D模型中的特征点信息与预设的各个姿态信息对应的特征点信息进行比对，获取所述体感游戏用户的3D模型与各个姿态信息之间的匹配度；The comparison unit 522 is configured to compare the feature point information in the 3D model with the feature point information corresponding to each preset posture information, and obtain the matching between the 3D model of the somatosensory game user and each posture information Spend;

第一确定单元523，用于将对应的匹配度大于预设阈值的姿态信息确定为所述体感游戏用户的姿态信息。The first determining unit 523 is configured to determine gesture information whose matching degree is greater than a preset threshold as gesture information of the user of the somatosensory game.

本实施例中，体感游戏实现装置可以对体感游戏用户的3D模型进行分析，提取特定区域例如眼睛所在区域、眉毛所在区域、鼻子所在区域、嘴巴所在区域、耳朵所在区域的特征点信息。In this embodiment, the somatosensory game implementation device can analyze the 3D model of the somatosensory game user, and extract feature point information of specific areas such as the eye area, the eyebrow area, the nose area, the mouth area, and the ear area.

本实施例中，体感游戏实现装置可以预先保存有各个动作中的各个姿态信息对应的特征点信息。体感游戏实现装置获取各个姿态信息对应的特征点信息的方式可以为，提示让体感游戏用户或者体感游戏工作人员作出各个姿态，采用结构光设备对体感游戏用户或者体感游戏工作人员进行投影，获取体感游戏用户或者体感游戏工作人员的3D模型，对3D模型进行分析，从而得到各个姿态信息对应的特征点信息，将姿态信息及对应的特征点信息进行存储，以便后续查询。In this embodiment, the device for implementing a somatosensory game may pre-save feature point information corresponding to each gesture information in each action. The way for the somatosensory game implementation device to obtain the feature point information corresponding to each gesture information may be to prompt the somatosensory game user or the somatosensory game staff to make various gestures, and use the structured light device to project the somatosensory game user or somatosensory game staff to obtain the somatosensory game. The 3D model of the game user or the somatosensory game staff is analyzed to obtain the feature point information corresponding to each gesture information, and the gesture information and the corresponding feature point information are stored for subsequent query.

本实施例中，姿态信息可以为姿态的标识、名称、用户的关节角度等参数中的任意一个或者多个参数。In this embodiment, the gesture information may be any one or more parameters of the gesture's identifier, name, user's joint angle and other parameters.

本发明实施例的体感游戏实现装置，通过采用结构光设备向体感游戏用户进行投影，获取各个时间点体感游戏用户的3D模型；针对各个时间点，对体感游戏用户的3D模型进行分析，提取3D模型中的特征点信息；将3D模型中的特征点信息与预设的各个姿态信息对应的特征点信息进行比对，获取体感游戏用户的3D模型与各个姿态信息之间的匹配度；将对应的匹配度大于预设阈值的姿态信息确定为体感游戏用户的姿态信息；根据各个时间点体感游戏用户的姿态信息，确定体感游戏用户的动作信息以及与动作信息匹配的控制指令；根据控制指令，对体感游戏进行操作，使得体感游戏用户可以通过做出一定的动作来控制体感游戏的操作，从而实现对终端设备上的体感游戏进行有效、直观的隔空操作，不需要束缚用户的行为方式，提高了游戏操作效率和游戏操作体验。The somatosensory game implementation device of the embodiment of the present invention obtains the 3D model of the somatosensory game user at each time point by using structured light equipment to project to the somatosensory game user; for each time point, analyzes the 3D model of the somatosensory game user to extract the 3D The feature point information in the model; compare the feature point information in the 3D model with the feature point information corresponding to each preset posture information, and obtain the matching degree between the 3D model of the somatosensory game user and each posture information; The posture information whose matching degree is greater than the preset threshold is determined as the posture information of the motion sensing game user; according to the posture information of the motion sensing game user at each time point, determine the motion information of the motion sensing game user and the control instruction matched with the motion information; according to the control instruction, Operate the somatosensory game, so that the user of the somatosensory game can control the operation of the somatosensory game by making certain actions, so as to realize effective and intuitive operation of the somatosensory game on the terminal device without restricting the user's behavior. Improved game operation efficiency and game operation experience.

图5的基础之上，图8为本发明实施例提供的另一种体感游戏实现装置的结构示意图。如图8所示，所述确定模块53包括：第二确定单元531和查询单元532。On the basis of FIG. 5 , FIG. 8 is a schematic structural diagram of another somatosensory game implementation device provided by an embodiment of the present invention. As shown in FIG. 8 , the determination module 53 includes: a second determination unit 531 and a query unit 532 .

其中，第二确定单元531，用于根据各个时间点所述体感游戏用户的姿态信息，确定所述体感游戏用户的动作信息；Wherein, the second determining unit 531 is configured to determine the action information of the somatosensory game user according to the posture information of the somatosensory game user at each time point;

查询单元532，用于根据所述体感游戏用户的动作信息，查询预设的控制指令表，获取与所述动作信息匹配的控制指令。The query unit 532 is configured to query a preset control instruction table according to the action information of the user of the somatosensory game, and obtain a control instruction matching the action information.

本实施例中，所述第二确定单元531具体用于，根据各个时间点所述体感游戏用户的姿态信息，确定所述体感游戏用户的姿态序列；根据所述体感游戏用户的姿态序列，确定与所述姿态序列匹配的动作信息。In this embodiment, the second determining unit 531 is specifically configured to, according to the posture information of the somatosensory game user at each time point, determine the gesture sequence of the somatosensory game user; according to the gesture sequence of the somatosensory game user, determine Action information matching the pose sequence.

本实施例中，体感游戏实现装置具体可以根据各个时间点体感游戏用户的姿态信息，确定体感游戏用户的姿态序列；根据体感游戏用户的姿态序列，确定与姿态序列匹配的动作信息。In this embodiment, the somatosensory game implementation device can specifically determine the gesture sequence of the somatosensory game user according to the gesture information of the somatosensory game user at each time point; according to the gesture sequence of the somatosensory game user, determine the action information matching the gesture sequence.

本实施例中，体感游戏用户的姿态序列为一段时间内体感游戏用户的连续的多个姿态信息。In this embodiment, the gesture sequence of the user of the motion sensing game is a plurality of continuous gesture information of the user of the motion sensing game within a period of time.

本实施例中，体感游戏实现装置预先保存有控制指令与动作信息之间的对应关系，或者体感游戏实现装置根据体感游戏用户的指令设置控制指令与动作信息之间的对应关系，生成控制指令表。本实施例中，体感游戏实现装置可以将控制指令表显示给体感游戏用户，以便体感游戏用户了解控制指令与动作信息之间的对应关系，在需要对体感游戏进行控制时，做出与控制指令匹配的动作，以便体感游戏实现装置根据控制指令对体感游戏进行操作，实现隔空操作。In this embodiment, the somatosensory game implementation device pre-stores the correspondence between control instructions and action information, or the somatosensory game implementation device sets the correspondence between control instructions and action information according to the instructions of the somatosensory game user, and generates a control instruction table . In this embodiment, the device for implementing the somatosensory game can display the control command list to the somatosensory game user, so that the somatosensory game user can understand the correspondence between the control command and the action information, and when it is necessary to control the somatosensory game, make a corresponding control command Matching actions, so that the device for realizing the somatosensory game can operate the somatosensory game according to the control instructions to realize air-distance operation.

其中，体感游戏实现装置可以在体感游戏用户启动体感游戏后，将控制指令表显示给体感游戏用户。Wherein, the device for realizing the motion-sensing game may display the control command list to the motion-sensing game user after the motion-sensing game user starts the motion-sensing game.

本发明实施例的体感游戏实现装置，通过采用结构光设备向体感游戏用户进行投影，获取各个时间点体感游戏用户的3D模型；对各个时间点体感游戏用户的3D模型进行分析，获取各个时间点体感游戏用户的姿态信息；根据各个时间点体感游戏用户的姿态信息，确定体感游戏用户的动作信息；根据体感游戏用户的动作信息，查询预设的控制指令表，获取与动作信息匹配的控制指令；根据控制指令，对体感游戏进行操作，使得体感游戏用户可以通过做出一定的动作来控制体感游戏的操作，从而实现对终端设备上的体感游戏进行有效、直观的隔空操作，不需要束缚用户的行为方式，提高了游戏操作效率和游戏操作体验。The somatosensory game implementation device of the embodiment of the present invention uses structured light equipment to project onto the somatosensory game user to obtain the 3D model of the somatosensory game user at each time point; analyze the 3D model of the somatosensory game user at each time point to obtain each time point Gesture information of somatosensory game users; according to the posture information of somatosensory game users at various time points, determine the action information of somatosensory game users; according to the action information of somatosensory game users, query the preset control command table to obtain control commands that match the action information ;According to the control instructions, operate the somatosensory game, so that the user of the somatosensory game can control the operation of the somatosensory game by making certain actions, so as to realize effective and intuitive air-space operation of the somatosensory game on the terminal device without restraint The user's behavior mode improves the game operation efficiency and game operation experience.

本发明实施例还提供一种终端设备。上述终端设备中包括图像处理电路，图像处理电路可以利用硬件和/或软件组件实现，可包括定义ISP(Image Signal Processing，图像信号处理)管线的各种处理单元。图9为一个实施例中图像处理电路的示意图。如图9所示，为便于说明，仅示出与本发明实施例相关的图像处理技术的各个方面。The embodiment of the present invention also provides a terminal device. The above-mentioned terminal device includes an image processing circuit, which may be implemented by hardware and/or software components, and may include various processing units defining an ISP (Image Signal Processing, image signal processing) pipeline. FIG. 9 is a schematic diagram of an image processing circuit in one embodiment. As shown in FIG. 9 , for ease of description, only various aspects of the image processing technology related to the embodiment of the present invention are shown.

如图9所示，图像处理电路900包括成像设备910、ISP处理器930和控制逻辑器940。成像设备910可包括具有一个或多个透镜912、图像传感器914的照相机和结构光投射器916。结构光投射器916将结构光投影至被测物。其中，该结构光图案可为激光条纹、格雷码、正弦条纹、或者，随机排列的散斑图案等。图像传感器914捕捉投影至被测物形成的结构光图像，并将结构光图像发送至ISP处理器930，由ISP处理器930对结构光图像进行解调获取被测物的深度信息。同时，图像传感器914也可以捕捉被测物的色彩信息。当然，也可以由两个图像传感器914分别捕捉被测物的结构光图像和色彩信息。As shown in FIG. 9 , the image processing circuit 900 includes an imaging device 910 , an ISP processor 930 and a control logic 940 . Imaging device 910 may include a camera having one or more lenses 912 , an image sensor 914 , and a structured light projector 916 . The structured light projector 916 projects the structured light onto the object under test. Wherein, the structured light pattern may be laser stripes, gray codes, sinusoidal stripes, or randomly arranged speckle patterns and the like. The image sensor 914 captures the structured light image projected onto the measured object, and sends the structured light image to the ISP processor 930, and the ISP processor 930 demodulates the structured light image to obtain the depth information of the measured object. At the same time, the image sensor 914 can also capture the color information of the measured object. Of course, the structured light image and color information of the object under test may also be captured by the two image sensors 914 respectively.

其中，以散斑结构光为例，ISP处理器930对结构光图像进行解调，具体包括，从该结构光图像中采集被测物的散斑图像，将被测物的散斑图像与参考散斑图像按照预定算法进行图像数据计算，获取被测物上散斑图像的各个散斑点相对于参考散斑图像中的参考散斑点的移动距离。利用三角法转换计算得到散斑图像的各个散斑点的深度值，并根据该深度值得到被测物的深度信息。Wherein, taking speckle structured light as an example, the ISP processor 930 demodulates the structured light image, which specifically includes collecting the speckle image of the object under test from the structured light image, and combining the speckle image of the object under test with the reference The image data of the speckle image is calculated according to a predetermined algorithm, and the moving distance of each speckle point in the speckle image on the object under test relative to the reference speckle point in the reference speckle image is obtained. The depth value of each speckle point of the speckle image is converted and calculated by using the triangulation method, and the depth information of the measured object is obtained according to the depth value.

当然，还可以通过双目视觉的方法或基于飞行时差TOF的方法来获取该深度图像信息等，在此不做限定，只要能够获取或通过计算得到被测物的深度信息的方法都属于本实施方式包含的范围。Of course, the depth image information can also be obtained through binocular vision or a method based on time-of-flight TOF, and there is no limitation here, as long as the method that can obtain or calculate the depth information of the measured object belongs to this implementation The range covered by the method.

在ISP处理器930接收到图像传感器914捕捉到的被测物的色彩信息之后，可被测物的色彩信息对应的图像数据进行处理。ISP处理器930对图像数据进行分析以获取可用于确定和/或成像设备910的一个或多个控制参数的图像统计信息。图像传感器914可包括色彩滤镜阵列(如Bayer滤镜)，图像传感器914可获取用图像传感器914的每个成像像素捕捉的光强度和波长信息，并提供可由ISP处理器930处理的一组原始图像数据。After the ISP processor 930 receives the color information of the object under test captured by the image sensor 914 , it can process the image data corresponding to the color information of the object under test. ISP processor 930 analyzes the image data to obtain image statistics that may be used to determine and/or control one or more parameters of imaging device 910 . Image sensor 914 may include a color filter array (such as a Bayer filter), and image sensor 914 may obtain light intensity and wavelength information captured with each imaging pixel of image sensor 914 and provide a set of raw images that may be processed by ISP processor 930. image data.

ISP处理器930按多种格式逐个像素地处理原始图像数据。例如，每个图像像素可具有8、10、12或14比特的位深度，ISP处理器930可对原始图像数据进行一个或多个图像处理操作、收集关于图像数据的图像统计信息。其中，图像处理操作可按相同或不同的位深度精度进行。The ISP processor 930 processes raw image data on a pixel-by-pixel basis in various formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the ISP processor 930 may perform one or more image processing operations on the raw image data, collect image statistics about the image data. Among other things, image processing operations can be performed with the same or different bit depth precision.

ISP处理器930还可从图像存储器920接收像素数据。图像存储器920可为存储器装置的一部分、存储设备、或电子设备内的独立的专用存储器，并可包括DMA(Direct MemoryAccess，直接直接存储器存取)特征。ISP processor 930 may also receive pixel data from image memory 920 . The image memory 920 may be a part of a memory device, a storage device, or an independent dedicated memory in an electronic device, and may include a DMA (Direct Memory Access, Direct Memory Access) feature.

当接收到原始图像数据时，ISP处理器930可进行一个或多个图像处理操作。When receiving raw image data, the ISP processor 930 may perform one or more image processing operations.

在ISP处理器930获取到被测物的色彩信息和深度信息后，可对其进行融合，得到三维图像。其中，可通过外观轮廓提取方法或轮廓特征提取方法中的至少一种提取相应的被测物的特征。例如通过主动形状模型法ASM、主动外观模型法AAM、主成分分析法PCA、离散余弦变换法DCT等方法，提取被测物的特征，在此不做限定。再将分别从深度信息中提取到被测物的特征以及从色彩信息中提取到被测物的特征进行配准和特征融合处理。这里指的融合处理可以是将深度信息以及色彩信息中提取出的特征直接组合，也可以是将不同图像中相同的特征进行权重设定后组合，也可以有其他融合方式，最终根据融合后的特征，生成三维图像。After the ISP processor 930 acquires the color information and depth information of the object under test, they can be fused to obtain a three-dimensional image. Wherein, the feature of the corresponding object under test may be extracted by at least one of an appearance contour extraction method or a contour feature extraction method. For example, the features of the measured object are extracted by active shape modeling method ASM, active appearance modeling method AAM, principal component analysis method PCA, discrete cosine transform method DCT and other methods, which are not limited here. Then, the features of the measured object extracted from the depth information and the features of the measured object extracted from the color information are subjected to registration and feature fusion processing. The fusion processing referred to here can be to directly combine the features extracted from the depth information and color information, or to combine the same features in different images after setting weights, or there can be other fusion methods, and finally according to the fused features to generate a 3D image.

三维图像的图像数据可发送给图像存储器920，以便在被显示之前进行另外的处理。ISP处理器930从图像存储器920接收处理数据，并对所述处理数据进行原始域中以及RGB和YCbCr颜色空间中的图像数据处理。三维图像的图像数据可输出给显示器960，以供用户观看和/或由图形引擎或GPU(Graphics Processing Unit，图形处理器)进一步处理。此外，ISP处理器930的输出还可发送给图像存储器920，且显示器960可从图像存储器920读取图像数据。在一个实施例中，图像存储器920可被配置为实现一个或多个帧缓冲器。此外，ISP处理器930的输出可发送给编码器/解码器950，以便编码/解码图像数据。编码的图像数据可被保存，并在显示于显示器960设备上之前解压缩。编码器/解码器950可由CPU或GPU或协处理器实现。Image data for a three-dimensional image may be sent to image memory 920 for additional processing before being displayed. The ISP processor 930 receives processed data from the image memory 920 and performs image data processing on the processed data in the raw domain and in the RGB and YCbCr color spaces. The image data of the three-dimensional image may be output to the display 960 for viewing by the user and/or for further processing by a graphics engine or a GPU (Graphics Processing Unit, graphics processor). In addition, the output of the ISP processor 930 can also be sent to the image memory 920 , and the display 960 can read image data from the image memory 920 . In one embodiment, image memory 920 may be configured to implement one or more frame buffers. Also, the output of the ISP processor 930 may be sent to an encoder/decoder 950 for encoding/decoding image data. The encoded image data may be saved and decompressed prior to display on the display 960 device. The encoder/decoder 950 may be implemented by a CPU or GPU or a coprocessor.

ISP处理器930确定的图像统计信息可发送给控制逻辑器940单元。控制逻辑器940可包括执行一个或多个例程(如固件)的处理器和/或微控制器，一个或多个例程可根据接收的图像统计信息，确定成像设备910的控制参数。The image statistics determined by the ISP processor 930 may be sent to the control logic 940 unit. Control logic 940 may include a processor and/or microcontroller executing one or more routines (eg, firmware) that may determine control parameters for imaging device 910 based on received image statistics.

以下为运用图9中图像处理技术实现体感游戏实现方法的步骤：The following are the steps of using the image processing technology in Fig. 9 to realize the realization method of the somatosensory game:

采用结构光设备向体感游戏用户进行投影，获取各个时间点所述体感游戏用户的3D模型；Use structured light equipment to project to the somatosensory game user, and obtain the 3D model of the somatosensory game user at each time point;

对各个时间点所述体感游戏用户的3D模型进行分析，获取各个时间点所述体感游戏用户的姿态信息；Analyzing the 3D model of the user of the somatosensory game at each time point, and obtaining the gesture information of the user of the somatosensory game at each time point;

根据各个时间点所述体感游戏用户的姿态信息，确定所述体感游戏用户的动作信息以及与所述动作信息匹配的控制指令；According to the posture information of the somatosensory game user at each time point, determine the motion information of the somatosensory game user and the control instruction matching the motion information;

根据所述控制指令，对所述体感游戏进行操作。According to the control instruction, the somatosensory game is operated.

为了实现上述实施例，本发明还提出一种非临时性计算机可读存储介质，其上存储有计算机程序，当该计算机程序被处理器执行时能够实现如前述实施例所述的体感游戏实现方法。In order to realize the above-mentioned embodiments, the present invention also proposes a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the somatosensory game implementation method as described in the above-mentioned embodiments can be realized .

在本说明书的描述中，参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中，对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且，描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外，在不相互矛盾的情况下，本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。In the description of this specification, descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples. In addition, those skilled in the art can combine and combine different embodiments or examples and features of different embodiments or examples described in this specification without conflicting with each other.

此外，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本发明的描述中，“多个”的含义是至少两个，例如两个，三个等，除非另有明确具体的限定。In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present invention, "plurality" means at least two, such as two, three, etc., unless specifically defined otherwise.

流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为，表示包括一个或更多个用于实现定制逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分，并且本发明的优选实施方式的范围包括另外的实现，其中可以不按所示出或讨论的顺序，包括根据所涉及的功能按基本同时的方式或按相反的顺序，来执行功能，这应被本发明的实施例所属技术领域的技术人员所理解。Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing custom logical functions or steps of a process , and the scope of preferred embodiments of the invention includes alternative implementations in which functions may be performed out of the order shown or discussed, including substantially concurrently or in reverse order depending on the functions involved, which shall It is understood by those skilled in the art to which the embodiments of the present invention pertain.

在流程图中表示或在此以其他方式描述的逻辑和/或步骤，例如，可以被认为是用于实现逻辑功能的可执行指令的定序列表，可以具体实现在任何计算机可读介质中，以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用，或结合这些指令执行系统、装置或设备而使用。就本说明书而言，"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下：具有一个或多个布线的电连接部(电子装置)，便携式计算机盘盒(磁装置)，随机存取存储器(RAM)，只读存储器(ROM)，可擦除可编辑只读存储器(EPROM或闪速存储器)，光纤装置，以及便携式光盘只读存储器(CDROM)。另外，计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质，因为可以例如通过对纸或其他介质进行光学扫描，接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序，然后将其存储在计算机存储器中。The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium, For use with instruction execution systems, devices, or devices (such as computer-based systems, systems including processors, or other systems that can fetch instructions from instruction execution systems, devices, or devices and execute instructions), or in conjunction with these instruction execution systems, devices or equipment used. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use in or in conjunction with an instruction execution system, device or device. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connection with one or more wires (electronic device), portable computer disk case (magnetic device), random access memory (RAM), Read Only Memory (ROM), Erasable and Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, since the program can be read, for example, by optically scanning the paper or other medium, followed by editing, interpretation or other suitable processing if necessary. The program is processed electronically and stored in computer memory.

应当理解，本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中，多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。如，如果用硬件来实现和在另一实施方式中一样，可用本领域公知的下列技术中的任一项或他们的组合来实现：具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路，具有合适的组合逻辑门电路的专用集成电路，可编程门阵列(PGA)，现场可编程门阵列(FPGA)等。It should be understood that various parts of the present invention can be realized by hardware, software, firmware or their combination. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented by any one or a combination of the following techniques known in the art: a discrete Logic circuits, ASICs with suitable combinational logic gates, Programmable Gate Arrays (PGA), Field Programmable Gate Arrays (FPGA), etc.

本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成，所述的程序可以存储于一种计算机可读存储介质中，该程序在执行时，包括方法实施例的步骤之一或其组合。Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. During execution, one or a combination of the steps of the method embodiments is included.

此外，在本发明各个实施例中的各功能单元可以集成在一个处理模块中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时，也可以存储在一个计算机可读取存储介质中。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.

上述提到的存储介质可以是只读存储器，磁盘或光盘等。尽管上面已经示出和描述了本发明的实施例，可以理解的是，上述实施例是示例性的，不能理解为对本发明的限制，本领域的普通技术人员在本发明的范围内可以对上述实施例进行变化、修改、替换和变型。The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like. Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present invention, those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.

Claims (14)

  1. A kind of 1. somatic sensation television game implementation method, it is characterised in that including：
    Projected using structure light device to somatic sensation television game user, obtain the 3D moulds of somatic sensation television game user described in Each point in time Type；
    The 3D models of somatic sensation television game user described in Each point in time are analyzed, somatic sensation television game described in Each point in time is obtained and uses The attitude information at family；
    The attitude information of somatic sensation television game user according to Each point in time, determine the action message of the somatic sensation television game user with And the control instruction matched with the action message；
    According to the control instruction, the somatic sensation television game is operated.
  2. 2. according to the method for claim 1, it is characterised in that described to be carried out using structure light device to somatic sensation television game user Projection, the 3D models of somatic sensation television game user described in Each point in time are obtained, including：
    For Each point in time, projected using structure light device to somatic sensation television game user；
    The somatic sensation television game user is imaged using video camera, obtains the depth image of the somatic sensation television game user；
    Closed with reference to the position between the depth image of the somatic sensation television game user, and the structure light device and the video camera System, calculate the 3D models for obtaining the somatic sensation television game user.
  3. 3. method according to claim 1 or 2, it is characterised in that structure light caused by the structure light device is non-equal Even structure light.
  4. 4. according to the method for claim 1, it is characterised in that the 3D to somatic sensation television game user described in Each point in time Model is analyzed, and obtains the attitude information of somatic sensation television game user described in Each point in time, including：
    For Each point in time, the 3D models of the somatic sensation television game user are analyzed, extract the feature in the 3D models Point information；
    Characteristic point information in the 3D models is compared with characteristic point information corresponding to default each attitude information, obtained Take the matching degree between the 3D models of the somatic sensation television game user and each attitude information；
    Corresponding matching degree is defined as to the attitude information of the somatic sensation television game user more than the attitude information of predetermined threshold value.
  5. 5. according to the method for claim 1, it is characterised in that the somatic sensation television game user's according to Each point in time Attitude information, the control instruction for determining the action message of the somatic sensation television game user and being matched with the action message, including：
    The attitude information of somatic sensation television game user according to Each point in time, determine the action message of the somatic sensation television game user；
    According to the action message of the somatic sensation television game user, default control instruction table is inquired about, is obtained and the action message The control instruction matched somebody with somebody.
  6. 6. according to the method for claim 5, it is characterised in that the somatic sensation television game user's according to Each point in time Attitude information, the action message of the somatic sensation television game user is determined, including：
    The attitude information of somatic sensation television game user according to Each point in time, determine the posture sequence of the somatic sensation television game user；
    According to the posture sequence of the somatic sensation television game user, it is determined that the action message with the posture sequences match.
  7. A kind of 7. somatic sensation television game realization device, it is characterised in that including：
    Projection module, for being projected using structure light device to somatic sensation television game user, obtain body-sensing described in Each point in time The 3D models of game user；
    Analysis module, for analyzing the 3D models of somatic sensation television game user described in Each point in time, obtain Each point in time The attitude information of the somatic sensation television game user；
    Determining module, for the attitude information of the somatic sensation television game user according to Each point in time, determine that the somatic sensation television game is used The action message at family and the control instruction matched with the action message；
    Operation module, for according to the control instruction, being operated to the somatic sensation television game.
  8. 8. device according to claim 7, it is characterised in that the projection module includes：
    Projecting cell, for for Each point in time, being projected using structure light device to somatic sensation television game user；
    Image unit, for being imaged using video camera to the somatic sensation television game user, obtain the somatic sensation television game user's Depth image；
    Computing unit, for the depth image with reference to the somatic sensation television game user, and the structure light device and the shooting Position relationship between machine, calculate the 3D models for obtaining the somatic sensation television game user.
  9. 9. the device according to claim 7 or 8, it is characterised in that structure light caused by the structure light device is non-equal Even structure light.
  10. 10. device according to claim 7, it is characterised in that the analysis module includes：
    Extraction unit, for for Each point in time, analyzing the 3D models of the somatic sensation television game user, extracting the 3D Characteristic point information in model；
    Comparing unit, for the characteristic point corresponding with default each attitude information of the characteristic point information in the 3D models to be believed Breath is compared, and obtains the matching degree between the 3D models of the somatic sensation television game user and each attitude information；
    First determining unit, the attitude information for corresponding matching degree to be more than to predetermined threshold value are defined as the somatic sensation television game and used The attitude information at family.
  11. 11. device according to claim 7, it is characterised in that the determining module includes：
    Second determining unit, for the attitude information of the somatic sensation television game user according to Each point in time, determine the body-sensing trip The action message of play user；
    Query unit, for the action message according to the somatic sensation television game user, inquire about default control instruction table, acquisition and institute State the control instruction of action message matching.
  12. 12. device according to claim 11, it is characterised in that second determining unit is specifically used for,
    The attitude information of somatic sensation television game user according to Each point in time, determine the posture sequence of the somatic sensation television game user；
    According to the posture sequence of the somatic sensation television game user, it is determined that the action message with the posture sequences match.
  13. 13. a kind of terminal device, it is characterised in that including following one or more assemblies：Housing and in the housing Processor and memory, wherein, the processor is run by reading the executable program code stored in the memory Program corresponding with the executable program code, for realizing that the somatic sensation television game as described in any in claim 1-6 is real Existing method.
  14. 14. a kind of non-transitorycomputer readable storage medium, is stored thereon with computer program, it is characterised in that the calculating The somatic sensation television game implementation method as described in any in claim 1-6 is realized when machine program is executed by processor.
CN201710676899.2A 2017-08-09 2017-08-09 Somatosensory game realization method and device, terminal equipment Pending CN107656611A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710676899.2A CN107656611A (en) 2017-08-09 2017-08-09 Somatosensory game realization method and device, terminal equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710676899.2A CN107656611A (en) 2017-08-09 2017-08-09 Somatosensory game realization method and device, terminal equipment

Publications (1)

Publication Number Publication Date
CN107656611A true CN107656611A (en) 2018-02-02

Family

ID=61128416

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710676899.2A Pending CN107656611A (en) 2017-08-09 2017-08-09 Somatosensory game realization method and device, terminal equipment

Country Status (1)

Country Link
CN (1) CN107656611A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108460802A (en) * 2018-04-28 2018-08-28 哈尔滨若朋机器人有限责任公司 Intelligent body-sensing target system and operation method
CN108536297A (en) * 2018-03-29 2018-09-14 北京微播视界科技有限公司 The implementation method and device of human-computer interaction application program for more people
CN109200576A (en) * 2018-09-05 2019-01-15 深圳市三宝创新智能有限公司 Somatic sensation television game method, apparatus, equipment and the storage medium of robot projection
CN109453517A (en) * 2018-10-16 2019-03-12 Oppo广东移动通信有限公司 virtual character control method and device, storage medium and mobile terminal
CN110658742A (en) * 2019-09-05 2020-01-07 四川省康复辅具技术服务中心 Wheelchair control system and method for multi-modal cooperative manipulation
CN111582036A (en) * 2020-04-09 2020-08-25 天津大学 A cross-view person recognition method based on shape and pose under wearable devices
CN114681909A (en) * 2020-12-26 2022-07-01 华为技术有限公司 Control method and electronic device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007050776A2 (en) * 2005-10-25 2007-05-03 University Of Kentucky Research Foundation System and method for 3d imaging using structured light illumination
CN101388114A (en) * 2008-09-03 2009-03-18 北京中星微电子有限公司 Method and system for estimating human body attitudes
CN106331801A (en) * 2016-08-31 2017-01-11 北京乐动卓越科技有限公司 Man-machine interaction method and system of smart television motion sensing game

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007050776A2 (en) * 2005-10-25 2007-05-03 University Of Kentucky Research Foundation System and method for 3d imaging using structured light illumination
CN101388114A (en) * 2008-09-03 2009-03-18 北京中星微电子有限公司 Method and system for estimating human body attitudes
CN106331801A (en) * 2016-08-31 2017-01-11 北京乐动卓越科技有限公司 Man-machine interaction method and system of smart television motion sensing game

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108536297A (en) * 2018-03-29 2018-09-14 北京微播视界科技有限公司 The implementation method and device of human-computer interaction application program for more people
CN108460802A (en) * 2018-04-28 2018-08-28 哈尔滨若朋机器人有限责任公司 Intelligent body-sensing target system and operation method
CN109200576A (en) * 2018-09-05 2019-01-15 深圳市三宝创新智能有限公司 Somatic sensation television game method, apparatus, equipment and the storage medium of robot projection
CN109453517A (en) * 2018-10-16 2019-03-12 Oppo广东移动通信有限公司 virtual character control method and device, storage medium and mobile terminal
CN109453517B (en) * 2018-10-16 2022-06-10 Oppo广东移动通信有限公司 Virtual character control method and device, storage medium, and mobile terminal
CN110658742A (en) * 2019-09-05 2020-01-07 四川省康复辅具技术服务中心 Wheelchair control system and method for multi-modal cooperative manipulation
CN111582036A (en) * 2020-04-09 2020-08-25 天津大学 A cross-view person recognition method based on shape and pose under wearable devices
CN114681909A (en) * 2020-12-26 2022-07-01 华为技术有限公司 Control method and electronic device
CN114681909B (en) * 2020-12-26 2025-10-28 华为技术有限公司 Control method and electronic device
US12558613B2 (en) 2020-12-26 2026-02-24 Huawei Technologies Co., Ltd. Control method and electronic device

Similar Documents

Publication Publication Date Title
CN107481304B (en) Method and device for constructing virtual image in game scene
CN107563304B (en) Terminal device unlocking method and device, and terminal device
CN107656611A (en) Somatosensory game realization method and device, terminal equipment
US10469829B2 (en) Information processor and information processing method
CN107479801B (en) Terminal display method and device based on user expression and terminal
CN109118569A (en) Rendering method and device based on threedimensional model
CN107395974B (en) Image processing system and method
CN107452034B (en) Image processing method and device thereof
CN107480613A (en) Face identification method, device, mobile terminal and computer-readable recording medium
CN107592449B (en) Three-dimensional model establishing method and device and mobile terminal
CN107481317A (en) Face adjustment method and device for 3D model of human face
CN107469355A (en) Game character image creation method and device, terminal equipment
CN107517346B (en) Photographing method, device and mobile device based on structured light
CN107480615B (en) Beauty treatment method and device and mobile equipment
CN108682050B (en) Three-dimensional model-based beautifying method and device
CN107480612A (en) Recognition methods, device and the terminal device of figure action
CN107551549A (en) Game Image Adjustment Method and Device
CN107343148B (en) Image completion method, device and terminal
CN107423716A (en) Face state monitoring method and device
CN107493427A (en) Focusing method and device for mobile terminal and mobile terminal
CN107481318A (en) Method, device and terminal equipment for replacing user avatar
CN107370951A (en) Image processing system and method
CN107293162A (en) Auxiliary method and device for sports teaching, terminal equipment
CN107437268A (en) Photographing method, device, mobile terminal and computer storage medium
CN107493411A (en) Image processing system and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180202