CN115291729B - Reminding method of head-mounted equipment and head-mounted equipment - Google Patents

Reminding method of head-mounted equipment and head-mounted equipment

Info

Publication number
CN115291729B
CN115291729B CN202210959056.4A CN202210959056A CN115291729B CN 115291729 B CN115291729 B CN 115291729B CN 202210959056 A CN202210959056 A CN 202210959056A CN 115291729 B CN115291729 B CN 115291729B
Authority
CN
China
Prior art keywords
real
head
head posture
time
reminding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210959056.4A
Other languages
Chinese (zh)
Other versions
CN115291729A (en
Inventor
刘锐
许国军
杨培
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Luxshare Precision Technology Nanjing Co Ltd
Original Assignee
Luxshare Precision Technology Nanjing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Luxshare Precision Technology Nanjing Co Ltd filed Critical Luxshare Precision Technology Nanjing Co Ltd
Priority to CN202210959056.4A priority Critical patent/CN115291729B/en
Priority to TW111136610A priority patent/TWI836631B/en
Publication of CN115291729A publication Critical patent/CN115291729A/en
Application granted granted Critical
Publication of CN115291729B publication Critical patent/CN115291729B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Toys (AREA)
  • Adjustment Of The Magnetic Head Position Track Following On Tapes (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a reminding method of a head-mounted device and the head-mounted device. The reminding method of the head-mounted equipment comprises the steps of obtaining and storing an initial head posture value and a real-time head posture value, judging whether the initial head posture value and the real-time head posture value change or not based on the real-time head posture value obtained in a first preset time period, storing the last real-time head posture value obtained in the first preset time period as a basic head posture value if the initial head posture value and the real-time head posture value change, executing preset reminding operation if the initial head posture value and the real-time head posture value change, judging whether the real-time head posture value change or not based on the real-time head posture value obtained in a second preset time period after the first preset time period, storing the last real-time head posture value obtained in the second preset time period as a current basic head posture value if the last real-time head posture value obtained in the second preset time period is the same as the initial head posture value or the basic head posture value stored previously, and executing preset reminding operation if the final real-time head posture value obtained in the second preset time period is the same as the initial head posture value or the basic head posture value stored previously.

Description

Reminding method of head-mounted equipment and head-mounted equipment
Technical Field
The application relates to the technical field of head-mounted equipment, in particular to a reminding method of the head-mounted equipment and the head-mounted equipment.
Background
With the development and progress of technology, computers, communication products and consumer electronics products (such as mobile phones, computers, tablet computers, etc.) are one of the indispensable products nowadays, especially the head-mounted equipment with entertainment function, which is easy for users to deeply immerse and forget themselves when using, and can cause certain fatigue to human bodies (such as cervical vertebrae) in long term and cause injury when serious.
However, the existing head-mounted devices on the market usually only pay attention to the product quality, and often neglect the possible damage to the cervical vertebra of the user when the user uses the head-mounted device for a long time.
Therefore, how to provide a technical solution to the above-mentioned problems is a problem that needs to be solved by those skilled in the art.
Disclosure of Invention
The embodiment of the application provides a reminding method of a head-mounted device and the head-mounted device, which can solve the problem that the cervical vertebra of a user is possibly injured when the user uses the head-mounted device for a long time.
In order to solve the technical problems, the application is realized as follows:
The application provides a reminding method of head-mounted equipment, which comprises the steps of acquiring six-axis posture data continuously output by a sensing module based on a starting instruction to acquire and store real-time head posture values, wherein the acquired first real-time head posture value is an initial head posture value, judging whether a change exists or not based on the real-time head posture value acquired in the first preset time length when the accumulated time length of the acquired real-time head posture value reaches the first preset time length, storing the last real-time head posture value acquired in the first preset time length as a basic head posture value if the change exists, executing preset reminding operation if the change exists, and judging whether the change exists or not based on the real-time head posture value acquired in the second preset time length after the accumulated time length of the acquired real-time head posture value is longer than the first preset time length, storing the last real-time head posture value acquired in the second preset time length as a current basic head posture value if the change exists, and executing the preset operation if the last real-time head posture value acquired in the second preset time length is the same as the initial head posture value or storing the initial head posture value, executing preset operation if the first preset time length is not changed, and executing preset reminding operation further.
The application provides a head-mounted device which comprises a sensing module, a storage module, a reminding module and a processing module, wherein the processing module is connected with the sensing module, the storage module and the reminding module. The sensing module is used for continuously outputting six-axis posture data, the storage module is used for storing an initial head posture value and a real-time head posture value, and the reminding module is used for executing preset reminding operation. The processing module is used for executing the following steps of acquiring six-axis posture data continuously output by the sensing module based on a starting instruction to acquire a real-time head posture value, wherein the acquired first real-time head posture value is an initial head posture value, judging whether a change exists or not based on the real-time head posture value acquired in the first preset time length when the accumulated time length of the acquired real-time head posture value reaches the first preset time length, storing the last real-time head posture value acquired in the first preset time length as a basic head posture value if the change exists, controlling the reminding module to execute a preset reminding operation if the change does not exist, and judging whether the change exists or not based on the real-time head posture value acquired in the second preset time length after the accumulated time length of the acquired real-time head posture value is longer than the first preset time length, storing the last real-time head posture value acquired in the second preset time length as a current basic head posture value if the change exists, further controlling the last real-time head posture value acquired in the second preset time length to be identical to the initial head posture value or the previously stored basic head posture value, and executing the preset reminding operation if the change does not exist, and executing the preset reminding operation when the first reminding module is not executed.
According to the reminding method of the head-mounted device and the head-mounted device, when a user uses the head-mounted device to perform immersion experience, whether the head of the user is basically unchanged can be judged through the real-time head posture value, and when the head of the user is in one posture for a long time, the user is reminded of adjusting the state of the user (for example, suggesting to change the posture or rest), so that fatigue of cervical vertebra is prevented. In addition, through setting of the second preset duration, the basic head posture value and the initial head posture value, the limb activity state of the user is perceived in detail, and the user can be reminded of being better experienced by the user when the head of the user returns to the original posture after being changed from the fine head posture.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute a limitation on the application. In the drawings:
FIG. 1 is a block diagram of one embodiment of a head mounted device according to the present application;
FIG. 2 is a flowchart of a method for reminding a headset device according to an embodiment of the application;
FIG. 3 is a flowchart of a method of reminding a headset device according to another embodiment of the application;
FIG. 4 is a flowchart of a method of reminding a headset according to another embodiment of the application, and
Fig. 5 is a flowchart of a method of reminding a headset according to another embodiment of the application.
Detailed Description
Embodiments of the present invention will be described below with reference to the accompanying drawings. In the drawings, like reference numerals designate identical or similar components or process flows.
It should be appreciated that the use of the terms "comprising," "including," and the like in this specification are intended to specify the presence of stated features, values, method steps, operation processes, and/or components, but do not preclude the addition of further features, values, method steps, operation processes, components, or groups thereof.
It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may be present. Conversely, when an element is described as being "directly connected" or "directly coupled" to another element, there are no intervening elements present.
Referring to fig. 1, a block diagram of an embodiment of a head-mounted device according to the present application is shown. As shown in fig. 1, the head-mounted device 100 includes a sensing module 110, a storage module 120, a reminding module 130 and a processing module 140, wherein the processing module 140 is connected with the sensing module 110, the storage module 120 and the reminding module 130. Wherein the head-mounted device 100 may be, but is not limited to, a Virtual Reality (VR) device, an augmented Reality (Augmented Reality, AR) device, or a Mixed Reality (MR) device, the sensing module 110 may be, but is not limited to, a six-axis inertial measurement unit (Inertial Measurement Unit, IMU), the storage module 120 may include, but is not limited to, removable storage, volatile read-write memory, read-only memory (ROM), or any combination thereof, the removable storage may include a memory card, the volatile read-write memory may include Static Random Access Memory (SRAM) and Dynamic Random Access Memory (DRAM), the read-only memory may include programmable read-only memory (PROM) and electrically erasable programmable read-only memory (EEPROM), the processing module 140 may be, but is not limited to, an Application SPECIFIC INTEGRATED Circuit, ASIC), a programmable logic device (Programmable Logic Device, PLD), a field programmable gate array (Field Programmable GATE ARRAY, FPGA), a controller, a microcontroller, a microprocessor, or a digital signal processor (DIGITAL SIGNAL processing, DSP).
The sensing module 110 is configured to continuously output six-axis gesture data. In particular, the sensing module 110 may include a gyroscope 112, an accelerometer 114, and a magnetometer 116, the gyroscope 112 may be used to measure rotational movement of the head-mounted device 100, the accelerometer 114 may be used to detect a force condition of the head-mounted device 100, and the magnetometer 116 may be used to detect an orientation of the head-mounted device 100.
The storage module 120 is configured to store an initial head pose value and a real-time head pose value. In addition, the storage module 120 may also store data and/or instructions that the headset 100 may execute or use to implement the reminder method of the smart headset described in the present application.
The reminding module 130 is used for executing a predetermined reminding operation. In one example, the reminding module 130 may include a display module 132, a broadcasting module 134 and a vibration module 136 connected to the processing module 140, where the display module 132 may be used to remind the user of the head gesture in the form of a bullet screen, the vibration module 136 may be used to remind the user of the head gesture in the form of a vibration, and the broadcasting module 134 may be used to remind the user of the head gesture in the form of a playing voice (that is, the predetermined reminding operation may be a bullet screen reminder, a vibration reminder and a voice playing reminder). It should be noted that the display module 132 provides a display screen when the user uses the head-mounted device 100.
The processing module 140 is configured to collect six-axis posture data continuously output by the sensing module 110 based on the start instruction, so as to obtain a real-time head posture value. Specifically, the processing module 140 may continuously acquire gyroscope data measured by the gyroscope 112, accelerometer data detected by the accelerometer 114, and magnetometer data detected by the magnetometer 116 via a software developer kit (Software Development Kit, SDK) to continuously acquire real-time head pose values. The acquired first real-time head posture value is an initial head posture value.
In one embodiment, the processing module 140 may obtain the gyroscope data measured by the gyroscope 112, the accelerometer data detected by the accelerometer 114 and the magnetometer data detected by the magnetometer 116 through the software developer kit after the headset 100 is powered on to determine whether the user wears the headset 100, and automatically generate the start instruction when the processing module 140 determines that the user wears the headset 100 (i.e. the processing module 140 automatically starts to execute the data and/or the instruction of the reminding method of the smart headset described in the present application after the user wears the headset 100). In another embodiment, the user may transmit the start instruction to the headset 100 by operating an input device (not drawn) connected to the headset 100, so that the processing module 140 starts to execute the data and/or instructions of the reminding method of the headset described in the present application, and at the same time, the user may also transmit the close instruction to the headset 100 by operating an input device connected to the headset 100, so that the processing module 140 stops executing the data and/or instructions of the reminding method of the headset described in the present application.
In this embodiment, the processing module 140 is further configured to determine whether there is a change based on the real-time head pose value acquired within the first preset duration when the accumulated duration of acquiring the real-time head pose value reaches the first preset duration, store the last real-time head pose value acquired within the first preset duration as the base head pose value if there is a change, and control the reminder module 130 to perform a predetermined reminder operation if there is no change. Specifically, the processing module 140 may perform logic analysis processing on the six-axis gesture data output by the sensing module 110 through the algorithm processing module (i.e. software of specific logic), determine whether there is a change in the head gesture of the user within a first preset duration after receiving the start instruction, if so, store the basic head gesture value, and if not (represent that the user maintains the same head gesture within the first preset duration), control the reminding module 130 to remind the user to pay attention to the head gesture in a bullet screen, vibration and/or voice playing mode. The first preset duration may be a default preset duration (for example, five minutes) or a duration that a user may set by himself according to an actual requirement.
In this embodiment, the processing module 140 is further configured to determine whether there is a change based on the real-time head pose value acquired in the second preset time period every second preset time period after the accumulated time period of the real-time head pose values is longer than the first preset time period, store the last real-time head pose value acquired in the second preset time period as the current basic head pose value if there is a change, and further control the reminding module 130 to perform a predetermined reminding operation when the last real-time head pose value acquired in the second preset time period is the same as the initial head pose value or the previously stored basic head pose value, and control the reminding module 130 to perform the predetermined reminding operation if there is no change, where the second preset time period is longer than the first preset time period.
Specifically, the processing module 140 starts to continuously acquire real-time head posture values based on the start instruction, and after the first preset duration, determines whether there is a change in the head posture of the user within the second preset duration every second preset duration, if so, stores the last real-time head posture value acquired within the second preset duration as a current basic head posture value, and when the head posture of the user returns to the original posture (i.e., the last real-time head posture value acquired within the second preset duration is the same as the initial head posture value or the previously stored basic head posture value) due to a slight change, the processing module 140 further controls the reminding module 130 to remind the user of the head posture in a bullet screen, vibration and/or voice playing mode, and if not, the processing module 140 controls the reminding module 130 to remind the user of the head posture in a bullet screen, vibration and/or voice playing mode. The second preset duration may be a default preset duration (for example, ten minutes) or a duration that the user may set by himself according to actual needs, and the second preset duration is longer than the first preset duration, so the head-mounted device 100 may sense the limb activity state of the user in more detail, and better experience is provided to the user.
In an embodiment, the head-mounted device 100 may further include a camera module 150, where the camera module 150 is connected to the processing module 140 and is used for continuously capturing an environmental image (i.e. an image of the environment in which the head-mounted device 100 is used). The processing module 140 may be further configured to obtain the real-time head pose value by using the six-axis pose data continuously output by the sensing module 110 and the environment image continuously captured by the image capturing module 150 through a fusion algorithm. In other words, the processing module 140 may use the six-axis pose number continuously output by the sensing module 110 to obtain the real-time head pose value, and may also use the environmental image continuously captured by the image capturing module 150 to assist in obtaining the real-time head pose value. The camera module 150 may be a wide-angle camera, and the range of the field angle of the camera module 150 may be greater than 120 degrees.
In an embodiment, the processing module 140 may be further configured to count the real-time head posture values acquired within the third preset duration when the accumulated duration of acquiring the real-time head posture values reaches the third preset duration, and control the reminding module 130 to perform the predetermined reminding operation when the accumulated number of times of judging a certain real-time head posture value exceeds the threshold. In other words, the processing module 140 may further control the reminding module 130 to remind the user to pay attention to the head pose in the form of a bullet screen, vibration and/or voice playing when the number of times the head of the user is maintained in the same pose within the third preset time period exceeds the threshold. The third preset time length is longer than the second preset time length, and the size of the threshold value can be adjusted according to actual requirements.
In one embodiment, the reminding module 130 may include a display module 132 connected to the processing module 140, and the head-mounted device 100 may further include a database 160 connected to the processing module 140, and the processing module 140 may be further configured to search for corresponding remission activity data in the database 160 based on the real-time head pose value with the accumulated number exceeding the threshold, and control the display module 132 to display the remission activity data in a bullet screen form, so as to suggest the user to perform the remission activity. Wherein the mitigation activity data may include, but is not limited to, a head pose in a direction opposite to the real-time head pose value for which the accumulated number exceeds the threshold, and a length of time the mitigation activity is recommended, the mitigation activity data included in database 160 may be updated synchronously as the headset 100 updates its application or firmware.
Please refer to fig. 2, which is a flowchart illustrating an embodiment of a method for reminding a headset device according to the present application. As shown in FIG. 2, the reminding method of the head-mounted device comprises the steps of acquiring six-axis posture data continuously output by a sensing module based on a starting instruction to acquire and store real-time head posture values, wherein the acquired first real-time head posture value is an initial head posture value (step 210), judging whether a change exists or not based on the real-time head posture value acquired in the first preset time period when the accumulated time length of the acquired real-time head posture values reaches the first preset time period (step 220), storing the last real-time head posture value acquired in the first preset time period as a basic head posture value if the change exists (step 230), executing a preset reminding operation (step 240) if the last real-time head posture value acquired in the first preset time period does not exist, judging whether the change exists or not based on the real-time head posture value acquired in the second preset time period after the accumulated time length of the acquired and storing the real-time head posture value is longer than the first preset time period (step 250), storing the last real-time head posture value acquired in the second preset time period as the current basic head posture value if the change exists (step 260), and executing a preset reminding operation (step 260) if the last real-time head posture value acquired in the second preset time period is not changed, and executing the preset operation. The second preset time period is longer than the first preset time period.
Therefore, the reminding method of the head-mounted equipment can judge whether the head of the user is basically unchanged all the time through the real-time head posture value, and remind the user of adjusting the state of the user when the head of the user is in one posture for a long time, so that the fatigue of the cervical vertebra is prevented. In addition, through setting of the second preset duration, the basic head posture value and the initial head posture value, the limb activity state of the user is perceived in detail, and the user can be reminded of being better experienced by the user when the head of the user returns to the original posture after being changed from the fine head posture. The detailed description will refer to the related descriptions of the above embodiments, and will not be repeated here.
In one embodiment, step 210 may include acquiring six-axis posture data continuously output by the sensing module and acquiring an environmental image continuously captured by the camera module based on the start command, and acquiring and storing the real-time head posture value by using the six-axis posture data and the environmental image through a fusion algorithm. Therefore, the head-mounted device can utilize the environment image continuously shot by the camera module to assist in acquiring the real-time head posture value. The detailed description will refer to the related descriptions of the above embodiments, and will not be repeated here.
In one embodiment, the performing of the predetermined reminding operation in step 240 and step 270 may include reminding the user of the head pose in the form of a barrage, a play voice, and/or a vibration. Thus, the user can also notice the need to adjust his own state while using the head-mounted device to make an immersive experience. The detailed description will refer to the related descriptions of the above embodiments, and will not be repeated here.
Please refer to fig. 3, which is a flowchart illustrating another embodiment of a method for reminding a headset device according to the present application. As shown in fig. 3, the reminding method of the head-mounted device may further include, in addition to steps 210 to 270, automatically generating a start command (step 202) when detecting that the user wears the head-mounted device before step 210. Accordingly, after the user wears the head-mounted device 100, the head-mounted device 100 automatically starts to perform steps 210 to 270. The detailed description will refer to the related descriptions of the above embodiments, and will not be repeated here. It should be noted that, to avoid overcomplicating the drawing of fig. 3, the drawing steps 250 to 270 are omitted.
Fig. 4 is a flowchart of a method for reminding a headset device according to another embodiment of the application. As shown in fig. 4, the reminding method of the head-mounted device may further include, in addition to steps 210 to 270, receiving a start command from the input device (step 204) before step 210. Therefore, the user can start the head-mounted device 100 to execute steps 210 to 270 according to the requirement. The detailed description will refer to the related descriptions of the above embodiments, and will not be repeated here. It should be noted that, to avoid overcomplicating the drawing of fig. 4, drawing steps 250 to 270 are omitted.
Fig. 5 is a flowchart of a method for reminding a headset device according to another embodiment of the application. As shown in fig. 5, the reminding method of the head-mounted device may further include, in addition to steps 210 to 270, counting real-time head posture values acquired within a third preset time period when the accumulated time period for acquiring and storing the real-time head posture values reaches the third preset time period (step 310), and executing a predetermined reminding operation when it is determined that the accumulated number of times of a certain real-time head posture value exceeds a threshold value (step 320). The third preset time period is longer than the second preset time period. Therefore, the reminding method of the head-mounted device can monitor the head gesture of the user for a long time and remind the user of paying attention to the head gesture. The detailed description will refer to the related descriptions of the above embodiments, and will not be repeated here. It should be noted that, to avoid overcomplicating the drawing of fig. 5, the drawing steps 220 to 270 are omitted.
In one embodiment, the reminding method of the head-mounted device can further comprise searching corresponding remission activity data in the database based on the real-time head posture value with the accumulated times exceeding the threshold value, and displaying the remission activity data in a bullet screen form to recommend the user to perform the remission activity (step 330). The detailed description will refer to the related descriptions of the above embodiments, and will not be repeated here.
It should be noted that, if there is no causal relationship between the above steps, the present application is not limited to the execution sequence.
In summary, in the application, when the user uses the head-mounted device to perform immersive experience, whether the head of the user is basically unchanged can be judged through the real-time head posture value, and when the head of the user is in one posture for a long time, the user is reminded of adjusting the state of the user (for example, suggesting to change the posture or rest), so that the fatigue of the cervical vertebra is prevented. In addition, through setting of the second preset duration, the basic head posture value and the initial head posture value, the limb activity state of the user is perceived in detail, and the user can be reminded of being better experienced by the user when the head of the user returns to the original posture after being changed from the fine head posture. In addition, through the third preset duration and the setting of the database, the head gesture of the user can be monitored for a long time, and besides reminding the user of paying attention to the head gesture, the data of the relieving activity can be displayed to suggest the user to perform the corresponding relieving activity.
While the invention has been illustrated by the above examples, it should be noted that the description is not intended to limit the invention. On the contrary, this invention covers modifications and similar arrangements apparent to those skilled in the art. Therefore, the scope of the claims is to be accorded the broadest interpretation so as to encompass all such obvious modifications and similar arrangements.

Claims (12)

1. A method of reminding a headset, comprising:
based on a starting instruction, acquiring six-axis posture data continuously output by a sensing module to acquire and store a real-time head posture value, wherein the acquired first real-time head posture value is an initial head posture value;
When the accumulated time length of acquiring and storing the real-time head posture values reaches a first preset time length, judging whether a change exists based on the real-time head posture values acquired in the first preset time length, storing the last real-time head posture value acquired in the first preset time length as a basic head posture value if the change exists, executing a preset reminding operation if the last real-time head posture value acquired in the first preset time length does not exist, and
And judging whether the real-time head posture value acquired in the second preset time period changes or not according to the real-time head posture value acquired in the second preset time period after acquiring and storing the accumulated time length of the real-time head posture value is longer than the first preset time period, storing the last real-time head posture value acquired in the second preset time period as the current basic head posture value if the real-time head posture value is changed, and further executing the preset reminding operation if the accumulated time length of the real-time head posture value is longer than the first preset time period and the last real-time head posture value acquired in the second preset time period is the same as the initial head posture value or the previously stored basic head posture value, and executing the preset reminding operation if the real-time head posture value is not changed.
2. The method of reminding a headset of claim 1, further comprising:
and when detecting that the user wears the head-mounted equipment, automatically generating the starting instruction.
3. The method of reminding a headset of claim 1, further comprising:
The start instruction from the input device is received.
4. The method for reminding a head-mounted device according to claim 1, wherein the step of acquiring and storing the real-time head posture value by acquiring six-axis posture data continuously output by the sensing module based on the start command comprises:
based on the starting instruction, acquiring the six-axis attitude data continuously output by the sensing module and acquiring an environment image continuously shot by the camera module, and acquiring and storing the real-time head attitude value by utilizing the six-axis attitude data and the environment image through a fusion algorithm.
5. The method of reminding a headset of claim 1, wherein the step of performing a predetermined reminding operation comprises:
Reminding the user of the head gesture in the form of bullet screen, voice playing and/or vibration.
6. The method of reminding a headset of claim 1, further comprising:
When the accumulated time length of acquiring and storing the real-time head posture values reaches a third preset time length, counting the real-time head posture values acquired in the third preset time length, wherein the third preset time length is longer than the second preset time length, and
And when the accumulated times of a certain real-time head posture value exceeds a threshold value, executing the preset reminding operation.
7. The method of reminding a headset of claim 6, further comprising:
searching corresponding relieving activity data in a database based on the real-time head posture values with the accumulated times exceeding the threshold value, displaying the relieving activity data in a bullet screen form, and suggesting the user to perform the relieving activity.
8. A head-mounted device, comprising:
the sensing module is used for continuously outputting six-axis attitude data;
The storage module is used for storing the initial head posture value and the real-time head posture value;
A reminding module for executing a predetermined reminding operation, and
The processing module is connected with the sensing module, the storage module and the reminding module and is used for executing the following steps:
Based on a starting instruction, acquiring the six-axis posture data continuously output by the sensing module to acquire the real-time head posture value, wherein the acquired first real-time head posture value is the initial head posture value;
When the accumulated time length of acquiring the real-time head posture values reaches a first preset time length, judging whether a change exists based on the real-time head posture values acquired in the first preset time length, if so, storing the last real-time head posture value acquired in the first preset time length as a basic head posture value, if not, controlling the reminding module to execute the preset reminding operation, and
And when the accumulated time length of the real-time head posture values is longer than the first preset time length, judging whether the real-time head posture values are changed or not based on the real-time head posture values acquired in the second preset time length every second preset time length, if so, storing the last real-time head posture value acquired in the second preset time length as the current basic head posture value, and further controlling the reminding module to execute the preset reminding operation when the last real-time head posture value acquired in the second preset time length is the same as the initial head posture value or the previously stored basic head posture value, and if not, controlling the reminding module to execute the preset reminding operation, wherein the second preset time length is longer than the first preset time length.
9. The head-mounted device of claim 8, further comprising a camera module coupled to the processing module for continuously capturing an environmental image, wherein the processing module is further configured to obtain the real-time head pose value by using the six-axis pose data continuously output by the sensing module and the environmental image continuously captured by the camera module through a fusion algorithm.
10. The head-mounted device of claim 8, wherein the reminding module comprises a display module, a broadcasting module and/or a vibration module connected with the processing module, wherein the display module is used for reminding a user of the head gesture in a bullet screen mode, the vibration module is used for reminding the user of the head gesture in a vibration mode, and the broadcasting module is used for reminding the user of the head gesture in a playing voice mode.
11. The head-mounted device of claim 8, wherein the processing module is further configured to count the real-time head pose values obtained during a third preset time period when the accumulated time period for obtaining the real-time head pose values reaches the third preset time period, and to control the reminder module to perform the predetermined reminder operation when the accumulated time of one of the real-time head pose values exceeds a threshold value, wherein the third preset time period is longer than the second preset time period.
12. The head-mounted device of claim 11 wherein the reminder module comprises a display module coupled to the processing module, the head-mounted device further comprising a database coupled to the processing module, the processing module further configured to search for corresponding relief activity data in the database based on the real-time head pose values accumulated for a number of times exceeding the threshold, and control the display module to display the relief activity data in a bullet screen to suggest a user to perform a relief activity.
CN202210959056.4A 2022-08-10 2022-08-10 Reminding method of head-mounted equipment and head-mounted equipment Active CN115291729B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202210959056.4A CN115291729B (en) 2022-08-10 2022-08-10 Reminding method of head-mounted equipment and head-mounted equipment
TW111136610A TWI836631B (en) 2022-08-10 2022-09-27 Reminding method of head-mounted device and head-mounted device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210959056.4A CN115291729B (en) 2022-08-10 2022-08-10 Reminding method of head-mounted equipment and head-mounted equipment

Publications (2)

Publication Number Publication Date
CN115291729A CN115291729A (en) 2022-11-04
CN115291729B true CN115291729B (en) 2025-07-22

Family

ID=83829025

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210959056.4A Active CN115291729B (en) 2022-08-10 2022-08-10 Reminding method of head-mounted equipment and head-mounted equipment

Country Status (2)

Country Link
CN (1) CN115291729B (en)
TW (1) TWI836631B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115886816B (en) * 2022-11-15 2024-05-10 立讯精密科技(南京)有限公司 VR/AR equipment and fatigue detection method based on same
CN118968704A (en) * 2023-05-15 2024-11-15 华为技术有限公司 Fatigue reminder method, device and electronic equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109528205A (en) * 2018-11-15 2019-03-29 歌尔科技有限公司 A kind of reminding method, device, helmet and computer readable storage medium
CN111447496A (en) * 2020-03-24 2020-07-24 深圳创维-Rgb电子有限公司 A method, device, storage medium and smart TV for correcting user posture

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3326851B2 (en) * 1993-03-08 2002-09-24 株式会社デンソー Method and apparatus for recognizing three-dimensional position and orientation based on vision
JP5993127B2 (en) * 2011-10-25 2016-09-14 オリンパス株式会社 Head-mounted display device, information terminal, program, information storage medium, image processing system, head-mounted display device control method, and information terminal control method
US9709806B2 (en) * 2013-02-22 2017-07-18 Sony Corporation Head-mounted display and image display apparatus
CN104182046A (en) * 2014-08-22 2014-12-03 京东方科技集团股份有限公司 Eye control reminding method, eye control image display method and display system
JP6534292B2 (en) * 2015-04-24 2019-06-26 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America Head mounted display and control method of head mounted display
CN105892658B (en) * 2016-03-30 2019-07-23 华为技术有限公司 Method for predicting head posture based on head-mounted display device and head-mounted display device
US10503247B2 (en) * 2017-05-09 2019-12-10 Microsoft Technology Licensing, Llc Calibration of stereo cameras and handheld object
CN107491171A (en) * 2017-08-16 2017-12-19 歌尔科技有限公司 Virtual reality helmet eyeshield control method and virtual reality helmet
CN108040276A (en) * 2017-11-27 2018-05-15 信利光电股份有限公司 A kind of Intelligent television control method and relevant apparatus
CN111630435B (en) * 2017-12-15 2025-03-14 奇跃公司 Enhanced posture determination for display devices
CN109753155B (en) * 2019-01-02 2021-01-22 京东方科技集团股份有限公司 Head mounted display device, driving method thereof, and virtual reality display device
CN109725730B (en) * 2019-01-02 2023-05-26 京东方科技集团股份有限公司 Head-mounted display device and driving method thereof, display system and driving method thereof
CN111079513B (en) * 2019-10-28 2022-01-18 珠海格力电器股份有限公司 Posture reminding method and device, mobile terminal and storage medium
TW202123691A (en) * 2019-12-05 2021-06-16 未來市股份有限公司 Head mounted display system and rotation center correcting method thereof

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109528205A (en) * 2018-11-15 2019-03-29 歌尔科技有限公司 A kind of reminding method, device, helmet and computer readable storage medium
CN111447496A (en) * 2020-03-24 2020-07-24 深圳创维-Rgb电子有限公司 A method, device, storage medium and smart TV for correcting user posture

Also Published As

Publication number Publication date
TWI836631B (en) 2024-03-21
CN115291729A (en) 2022-11-04
TW202303226A (en) 2023-01-16

Similar Documents

Publication Publication Date Title
CN115291729B (en) Reminding method of head-mounted equipment and head-mounted equipment
KR102463281B1 (en) Electronic apparatus for providing mode switching and storage medium
US9998665B2 (en) Camera mode selection based on context
KR102504308B1 (en) Method and terminal for controlling brightness of screen and computer-readable recording medium
CN110322858B (en) Screen display method, electronic device, and computer storage medium
CN105577945A (en) Eyesight protection control method and device and mobile terminal
EP3255376A1 (en) Scene change detection in a dimensioner
US11493764B2 (en) Method for dynamically displaying real-world scene, electronic device, and computer readable medium
CN108989688B (en) Virtual camera anti-fluttering method, device, electronic equipment and readable storage medium storing program for executing
KR102566143B1 (en) Fodable electronic device for providing information related to event and operating method thereof
KR102572675B1 (en) Method and electronic device for adaptively configuring user interface
KR102354016B1 (en) Method for changing the size of contents displayed on display and electronic device thereof
US20170263216A1 (en) Method for Adjusting Screen Displaying Direction and Terminal
CN108600535A (en) Eye protection method for electronic equipment and electronic equipment
US20250126394A1 (en) State Determination Method, Electronic Device, and Readable Storage Medium
US11169769B2 (en) Electronic device and volume adjustment method of electronic device
CN109831817B (en) Terminal control method, device, terminal and storage medium
TWI497045B (en) Electronic device capable of detecting operating environment to switch operating states of peripheral components and method thereof
CN109144363B (en) Information processing method and electronic equipment
CN107343100B (en) Information prompting method, device, storage medium and electronic device
TWI581991B (en) Method for displaying driving information
CN106125935A (en) Eye protection method, device and terminal equipment based on terminal equipment
CN113261273B (en) Parameter self-adaptation method, hand-held cloud platform, system and computer-readable storage medium
KR102567368B1 (en) An electronic device and a method for displaying history of use
CN112203131A (en) Prompting method and device based on display equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant