KR102316459B1 - Wireless augmented reality glasses device for providing subtitles in concert halls - Google Patents

Abstract

The present invention relates to a wireless augmented reality glass device for providing captions in a concert hall, and more particularly, to a wireless augmented reality glass device, comprising: an HMD frame that a user can wear; a communication unit for receiving performance caption information through wireless communication; a display in which the augmented reality image light is output so that the performance caption information can be provided to the user, the aspect ratio being 3:1 or more according to the performance caption shape; and image light output from the display, which is disposed in front of both eyes of the user wearing the HMD frame, transmits at least a portion of the real world light so that the performance of the real world through the user's field of view is transmitted. It is characterized in that it includes an optical unit that transmits in the direction of the user's eyes.
According to the wireless augmented reality glass device for providing subtitles for concert halls proposed in the present invention, a small display dedicated to transmitting subtitles with a horizontal length longer than vertical length is used according to the performance subtitle shape, and a miniaturized and lightweight wireless display with only minimal functions. By configuring the augmented reality glass device, there is no burden on the head or neck of the audience even if it is continuously worn during the performance time, it is convenient to use wirelessly, and the price is low to provide the audience with subtitles. .
In addition, according to the wireless augmented reality glass device for providing captions for the concert hall proposed in the present invention, since the performance captions are provided in augmented reality, there is no need to alternately view captions and performances, thereby increasing concentration on the performance, and the language selected by the audience By providing the performance subtitle information corresponding to

Description

A wireless augmented reality glass device for providing subtitles in a concert hall

The present invention relates to a wireless augmented reality glass device, and more particularly, to a wireless augmented reality glass device for providing subtitles in a concert hall.

When you go to a concert hall, an LED panel or screen for subtitles is installed, and subtitles for the performance are transmitted through the LED panel or screen. In this case, the subtitle may be a description of the performance, and in the case of a performance in a foreign language, it may be a subtitle in the language of the performance region.

Although the LED panel or screen for providing subtitles is helpful by providing information necessary for viewing the performance, there is a problem in that the light interferes with the viewing of the performance, and the concentration of the performance decreases because the subtitle and the performance must be viewed alternately. In addition, since it is difficult to express multiple languages at once, there is a limitation in not considering users of various languages watching the performance.

Therefore, there is a need to develop a technique for solving such a conventional problem.

Meanwhile, various wearable devices are being developed in accordance with the trend of weight reduction and miniaturization of digital devices. A head mounted display, which is a type of wearable device, refers to various devices that a user can wear on the head to receive multimedia contents. Here, the head mounted display (HMD) is worn on the user's body and provides images to the user in various environments as the user moves. Such a head mounted display (HMD) is divided into a see-through type and a see-closed type, and the transparent type is mainly used for Augmented Reality (AR), and the closed type is mainly used for virtual reality (Virtual Reality). Reality, VR).

1 is a diagram illustrating a schematic configuration of a general glasses-type head mounted display (HMD), and FIG. 2 is a diagram illustrating a schematic configuration of a general band-type head mounted display (HMD). As shown in FIGS. 1 and 2, a general head-mounted display in the form of glasses or a band is worn on the user's face or head and is transmitted through a lens that projects augmented reality (AR) image information to the real world. will be provided to the user.

However, such a conventional head mounted display is heavy, so it is inconvenient to use it for a long time, and since it is expensive, it is a burden to pay and use it for a large number of users in various situations.

On the other hand, as prior art related to the present invention, Patent Registration No. 10-2102309 (title of the invention: object recognition method for a three-dimensional virtual space of a head worn display device, registration date: April 13, 2020), etc. has been disclosed.

The present invention has been proposed to solve the above problems of the previously proposed methods, and uses a small display dedicated to transmitting subtitles with a horizontal length longer than a vertical length according to the form of a performance subtitle, and contains only a minimum of functions; By constructing a lightweight wireless augmented reality glass device, there is no burden on the head or neck of the audience even if it is worn continuously during the performance time, it is convenient to use wirelessly, and the price is low to provide subtitles to the audience. An object of the present invention is to provide a wireless augmented reality glass device for providing subtitles in a concert hall without burden.

In addition, the present invention provides performance subtitles in augmented reality, so there is no need to alternate between subtitles and performances, so it is possible to increase the concentration on the performance, and by providing performance subtitle information corresponding to the language selected by the audience, the same It is another object to provide a wireless augmented reality glass device for providing subtitles in a concert hall, which can provide performance subtitles in a language suitable for individual audiences rather than language, so that it is possible to relieve linguistic discomfort and comfortably watch the performance. .

A wireless augmented reality glass device for providing subtitles in a concert hall according to a feature of the present invention for achieving the above object,

As a wireless augmented reality glass device,

user wearable HMD frame;

a communication unit for receiving performance caption information through wireless communication;

a display that outputs augmented reality image light so that the performance caption information can be provided to the user, and has an aspect ratio of 3:1 or more according to the performance caption shape; and

It is disposed in front of both eyes of the user wearing the HMD frame, transmits at least a portion of the real world light so that the performance of the real world through the user's field of view is transmitted, and transmits the image light output from the display. It is characterized in that it includes an optical unit that transmits in the direction of the user's eyes.

Preferably,

It may be lightweight by not including accessory parts including a camera and a sensor.

More preferably, the communication unit,

The performance subtitle information transmitted by the management server managing the performance subtitle information of the performance hall may be received through wireless communication.

More preferably, the display comprises:

The horizontal to vertical ratio may be 30 to 45:9.

Even more preferably, the display comprises:

The aspect ratio may be 32:9 or 40:9.

More preferably, the optical unit,

In order to transmit the image light in the form of performance captions output from the display in the direction of the user's eyes, it may be miniaturized in the form of performance captions.

Preferably,

input for language selection; and

The control unit may further include a control unit for requesting and receiving performance subtitle information corresponding to the language selection information input from the input unit through the communication unit.

More preferably, the input unit,

An input signal may be received through gesture recognition or a touchpad.

According to the wireless augmented reality glass device for providing subtitles for concert halls proposed in the present invention, a small display dedicated to sending subtitles is used, which is longer than the vertical length, according to the form of the performance subtitles. By configuring the augmented reality glass device, there is no burden on the head or neck of the audience even if it is continuously worn during the performance time, it is convenient to use wirelessly, and the price is low to provide the audience with subtitles. .

In addition, according to the wireless augmented reality glass device for providing subtitles for concert halls proposed in the present invention, since the performance subtitles are provided in augmented reality, there is no need to alternately view subtitles and performances, so concentration on the performance can be increased, and the language selected by the audience By providing performance subtitle information corresponding to , performance subtitles can be provided in a language suitable for individual audiences rather than in the same language to all audiences, thereby relieving the linguistic inconvenience and comfortably viewing the performance.

1 is a view showing a schematic configuration of a general glasses-type head mounted display (HMD).
2 is a view showing a schematic configuration of a general band-type head mounted display (HMD).
3 is a view showing the configuration of a wireless augmented reality glass device for providing subtitles in a concert hall according to an embodiment of the present invention as a functional block.
4 is a diagram illustrating a state in which a wireless augmented reality glass device for providing captions to a concert hall according to an embodiment of the present invention receives performance caption information from a management server.
5 is a view showing, for example, a field of view of a user in which a performance subtitle image is displayed in the wireless augmented reality glass apparatus for providing subtitles to a concert hall according to an embodiment of the present invention.
6 is a view showing the state of the conventional display and the optical unit.
7 is a view showing, for example, a display and an optical unit of a wireless augmented reality glass device for providing captions to a concert hall according to an embodiment of the present invention.
8 is a view showing, for example, a field of view when selecting a language in a wireless augmented reality glass device for providing subtitles to a concert hall according to an embodiment of the present invention.

Hereinafter, preferred embodiments will be described in detail so that those of ordinary skill in the art can easily practice the present invention with reference to the accompanying drawings. However, in describing a preferred embodiment of the present invention in detail, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, the same reference numerals are used throughout the drawings for parts having similar functions and functions.

In addition, throughout the specification, when a part is 'connected' with another part, it is not only 'directly connected' but also 'indirectly connected' with another element interposed therebetween. include In addition, "including" a certain component means that other components may be further included, rather than excluding other components, unless otherwise stated.

3 is a view showing the configuration of the wireless augmented reality glass apparatus 100 for providing subtitles in a concert hall according to an embodiment of the present invention as a functional block. As shown in FIG. 3 , the wireless augmented reality glass device 100 for providing subtitles for a concert hall according to an embodiment of the present invention includes an HMD frame 110 , a communication unit 120 , a display 130 , and an optical unit 140 . ), and may further include an input unit 150 , a control unit 160 , and a power supply unit 170 .

The wireless augmented reality glass apparatus 100 for providing subtitles for a concert hall according to an embodiment of the present invention is a device for providing subtitles in augmented reality to the audience in a concert hall. Since there is no need to take turns watching, the concentration on the performance can be increased, and the performance subtitles in a language suitable for individual audiences can be provided to increase the satisfaction of the audience. In particular, by configuring the miniaturized and lightweight wireless augmented reality glass device 100 containing only minimal functions, there is no burden on the head or neck of the audience even if it is continuously worn during the performance time, and it can be conveniently used wirelessly.

Hereinafter, each configuration of the wireless augmented reality glass apparatus 100 for providing subtitles in a concert hall according to an embodiment of the present invention will be described in detail with reference to FIG. 3 .

The HMD frame 110 is a frame configuration that a user can wear. The HMD frame 110 may be configured in the form of glasses, a helmet, or goggles having a frame structure through which light can enter while being worn on the user's head. Here, when the HMD frame 110 is formed in the form of a helmet, it may be composed of a helmet (not shown) worn on the user's head and a display frame (not shown) disposed in front of the helmet. In addition, when the HMD frame 110 is configured in the form of goggles, it may be composed of a band frame (not shown) that can be worn on a user's head, and a goggles frame (not shown) that is fastened and fixed to the band frame.

The communication unit 120 may receive the performance caption information through wireless communication. More specifically, the communication unit 120 may receive the performance caption information transmitted by the management server for managing the performance caption information of the performance hall through wireless communication.

FIG. 4 is a diagram illustrating a state in which the wireless augmented reality glass apparatus 100 for providing subtitles to a concert hall receives performance subtitle information from the management server 200 according to an embodiment of the present invention. As shown in FIG. 4 , the wireless augmented reality glass apparatus 100 for providing subtitles to a concert hall according to an embodiment of the present invention may receive performance subtitle information transmitted by the management server 200 through a network. Here, the network is a wired network such as a local area network (LAN), a wide area network (WAN) or a value added network (VAN), or a mobile radio communication network, a satellite communication network, Bluetooth, Wibro (Wireless Broadband Internet), HSDPA (High Speed Downlink Packet Access), Wifi, LTE (Long Term Evolution), 4G/5G/6G (4/5/6th Generation Mobile Telecommunication), etc. It may be implemented as a wireless network. In particular, the management server 200 may transmit the performance subtitle information to a plurality of wireless augmented reality devices through the AP in the performance hall.

The display 130 outputs augmented reality image light so that performance caption information can be provided to the user, but may have an aspect ratio of 3:1 or more according to the performance caption shape. More specifically, the display 130 may have an aspect ratio of 30 to 45:9, particularly 32:9 or 40:9. That is, in the present invention, since only the performance subtitles for helping the viewing of performances in the real world need to be output as augmented reality image light, a vertically thin and horizontally long subtitle transmission display 130 can be used.

FIG. 5 is a view illustrating, for example, a user's field of view 10 on which a performance subtitle image is displayed in the wireless augmented reality glass apparatus 100 for providing subtitles to a concert hall according to an embodiment of the present invention. Since the existing augmented reality glass device (or head-mounted display device) is configured to provide the augmented reality image light to the entire field of view 10 that the user sees through the device, the display 130 is the view It should be sized to cover the entire field 10 . On the other hand, as shown in FIG. 5 , the wireless augmented reality glass apparatus 100 for providing subtitles for a concert hall according to an embodiment of the present invention displays performance subtitle information in a part of the field of view 10 in augmented reality. Therefore, it is possible to reduce the size and weight by using a small dedicated display 130 such as OLED, LCOS, etc. specially manufactured for transmitting subtitles so as to cover only the subtitle area 20 .

The optical unit 140 is disposed in front of both eyes of the user wearing the HMD frame 110, and transmits at least a portion of the real world light so that the performance of the real world through the user's field of view is transmitted. , the image light output from the display 130 may be transmitted in the direction of the user's eyes. The optical unit 140 may include a transparent lens, a beam splitter for reflecting image light, a reflective surface, a mirror, and the like so that an actual performance can be transmitted through the user's field of view.

More specifically, the optical unit 140 may be miniaturized in the form of open captions in order to transmit the image light in the form of open captions output from the display 130 toward the user's eyes. That is, since the image light to be transmitted in the direction of the user's eyes is limited to the caption area 20 rather than the entire field of view 10 , similarly to using the small dedicated display 130 , the optical unit 140 is also It is possible to use a miniaturized module in a horizontally long form.

6 is a view showing the state of the conventional display 130 and the optical unit 140, FIG. 7 is a display 130 of the wireless augmented reality glass device 100 for providing subtitles for a concert hall according to an embodiment of the present invention. ) and the optical unit 140 are diagrams for example. As shown in FIG. 6 , the optical unit 140 has to provide the image light output from the display 130 to the user's field of view in augmented reality, so there is a limit in reducing the thickness and weight. On the other hand, as shown in FIG. 7 , the wireless augmented reality glass apparatus 100 for providing subtitles for a concert hall according to an embodiment of the present invention transmits the augmented reality image light only to the subtitle region 20, which is a relatively narrow region. Therefore, the display 130 and the optical unit 140 can be miniaturized and implemented thinly and lightly. However, the specific configuration of the optical unit 140 is not limited to the form shown in FIG. 7 , and various optical elements such as a beam splitter, a mirror, and a hologram film may be used as needed.

On the other hand, the wireless augmented reality glass apparatus 100 for providing captions for a concert hall according to an embodiment of the present invention may be lightweight by not including accessory parts including a camera and a sensor. That is, the display 130 and optical unit 140, which are essential components for providing augmented reality, are miniaturized and lightweight, as well as accessory parts used in the existing augmented reality glass device such as a camera, a location information sensor, and an illuminance sensor. By implementing the wireless augmented reality glass device 100 with only the minimum configuration required to provide subtitles in the performance hall, the device can be simplified, miniaturized, and lightweight, and the production cost can also be reduced.

The input unit 150 may be configured for language selection. More specifically, the input unit 150 may receive an input signal through gesture recognition or a touch pad. In this case, the input unit 150 may be implemented as a camera for gesture recognition or a small touchpad provided on one side of the wireless augmented reality glass device 100 . According to an embodiment, the input unit 150 may be implemented as a switch device provided on one side of the wireless augmented reality glass device 100 or connected via wire or wireless.

8 is a view showing, for example, a field of view 10 when a language is selected in the wireless augmented reality glass apparatus 100 for providing captions to a concert hall according to an embodiment of the present invention. As shown in FIG. 8 , in the wireless augmented reality glass apparatus 100 for providing subtitles for a concert hall according to an embodiment of the present invention, the user moves left, right, By making a hand gesture corresponding to selection or the like, desired language selection information may be input.

The control unit 160 may request and receive performance subtitle information corresponding to the language selection information input from the input unit 150 through the communication unit 120 . That is, the controller 160 requests and receives the performance subtitle information of the language selected by the user wearing the wireless augmented reality glass device 100 from the management server 200, and the received performance subtitle information of the language is based on the augmented reality. It is possible to control transmission to the display 130 so as to be provided to the user.

The power supply unit 170 may supply power for driving the wireless augmented reality glass device 100 . On/off of the power supply unit 170 may be controlled by the input unit 150 , and a switch for on/off is installed on one side of the HMD frame 110 or connected to the HMD frame 110 by wire. It may be formed in a separate device that is

As described above, according to the wireless augmented reality glass device 100 for providing subtitles to the concert hall proposed in the present invention, a small display 130 dedicated to transmitting subtitles having a longer horizontal length than a vertical length is used according to the form of the performance subtitles. , by configuring the wireless augmented reality glass device 100 that is miniaturized and lightweight with only minimal functions, there is no burden on the head or neck of the audience even if it is continuously worn during the performance time, it is convenient to use wirelessly, and the price is low Therefore, there is no burden to provide subtitles to the audience.

In addition, according to the wireless augmented reality glass device 100 for providing subtitles for the concert hall proposed in the present invention, since the performance subtitles are provided in augmented reality, there is no need to alternately view the subtitles and the performance, so that the concentration on the performance can be increased, and the audience By providing performance subtitle information corresponding to the selected language, performance subtitles can be provided in a language suitable for individual audiences rather than in the same language to all audiences, thereby relieving linguistic inconvenience and allowing comfortable viewing of the performance.

Various modifications and applications of the present invention described above are possible by those skilled in the art to which the present invention pertains, and the scope of the technical idea according to the present invention should be defined by the following claims.

10: Field of View
20: Subtitle area
100: wireless augmented reality glass device according to the present invention
110: HMD frame
120: communication department
130: display
140: optical unit
150: input unit
160: control unit
170: power supply
200: management server

Claims (8)

As a wireless augmented reality glass device 100,
HMD frame 110 that the user can wear;
Communication unit 120 for receiving the performance caption information through wireless communication;
The augmented reality image light is output so that the performance subtitle information can be provided to the user, but the aspect ratio is 32:9 or 40:9 according to the performance subtitle form so that only the subtitle area 20 is covered. implemented as OLED or LCOS, a miniaturized and lightweight display 130;
It is disposed in front of both eyes of the user wearing the HMD frame 110, and transmits at least a portion of the real world light so that the performance of the real world through the user's field of view is transmitted, and the display 130 an optical unit 140 that transmits the image light output from the user's eyes in the direction of the user's eyes;
an input unit 150 for language selection;
a control unit 160 for requesting and receiving performance subtitle information corresponding to the language selection information input from the input unit 150 through the communication unit 120; and
Consists of a power supply unit 170 that supplies power for driving the wireless augmented reality glass device 100,
It is simplified, miniaturized and lightweight by implementing only the minimum configuration necessary to provide subtitles in the performance hall, not including accessory parts including cameras and sensors.
The communication unit 120,
The management server 200, which manages the performance subtitle information of the performance hall, receives the performance subtitle information transmitted to a plurality of wireless augmented reality devices in the performance hall through the AP in the performance hall through wireless communication,
The optical unit 140,
In order to deliver the image light in the form of performance captions output from the display 130 to the user's eye direction, it is miniaturized in the form of performance captions, which is thinner and lighter than the optical unit that transmits the image light to the entire field of view of the user. A wireless augmented reality glass device 100 for providing subtitles in a concert hall, characterized in that. delete delete delete delete delete delete delete

Images