KR101741227B1 - Auto stereoscopic image display device - Google Patents

Abstract

The present invention discloses a stereoscopic image display device. In a preferred embodiment of the present invention, a depth difference image is generated using an RGB image and a depth image for an object to be output to a stereoscopic image display device, and a depth difference image is projected on a lens array to generate a stereoscopic image signal The stereoscopic image signal is displayed on the transparent LCD panel and the displayed image is passed through the same lens array as the lens array used for generating the stereoscopic image, It is possible to output a stereoscopic image having a different focal distance so as to correspond to an actual depth value for each region included in the image.

Description

[0001] The present invention relates to a stereoscopic image display device,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a stereoscopic image display apparatus, and more particularly, to a non-spectacle stereoscopic image display apparatus.

In general, stereoscopic images representing three-dimensional images are made by the principle of stereoscopic vision through two eyes. Since the time difference of the two eyes, that is, the two eyes, is about 65 mm apart, The right eye sees a slightly different image. Thus, the difference in the image due to the positional difference between the two eyes is referred to as binocular disparity. The three-dimensional stereoscopic display apparatus uses the binocular parallax to allow the left eye to see only the left eye image, and the right eye to see only the right eye image.

In other words, the left and right eyes see different two-dimensional images, and when these two images are transmitted to the brain through the retina, the brain fuses them exactly to reproduce the depth sense and real feeling of the original three-dimensional image. This capability is generally referred to as stereography, and a device using the same as a display device is referred to as a stereoscopic display device.

A conventional three-dimensional image display device is a stereoscopic image display device in which a user wears polarized glasses or glasses of shutter glass type and displays a three-dimensional image by superimposing a left eye image and a right eye image at the same time, So that the user can feel the stereoscopic effect.

However, when stereoscopic images are viewed using the binocular parallax, dizziness and eye fatigue are caused by the parallax of the two images and the mismatch of the focus functions of the eyes. Therefore, in recent years, many researches have been conducted to apply an integral imaging method which can solve the problem of stereo image.

The integral imaging method was first proposed by Lippmann in 1908. The integrated image method is a method of collecting images by using an image such as a hologram and recognizing the three-dimensional image having a specific depth from a two-dimensional whole element image using a lens array composed of a plurality of single lenses without using glasses. . That is, a viewer can feel as if he or she is viewing a real three-dimensional object while viewing a three-dimensional image formed within a certain volume.

Such an integrated image method does not require glasses or other tools for viewing a stereoscopic image, and it is possible to reproduce a continuous image without causing eye fatigue when a viewer views the stereoscopic image.

However, in the case of such an integrated image stereoscopic image, an image picked up by a camera through a lens array is an image photographed at a specific depth, and thus there is a limit in that an object having different depths can not be accurately represented. That is, when objects photographed with different distances from the camera on the space are photographed and the photographed images are displayed as a stereoscopic image of the integrated image system, each object can be seen in three dimensions, but each three- There is a limitation in that it is impossible to three-dimensionally display the relationship between the positions of the objects, that is, depth values of different objects.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a stereoscopic image display method and a stereoscopic image display method in which, when objects to be displayed in a stereoscopic image have different depth values, a stereoscopic image signal is generated in which the focal distance of each object corresponds to a depth value, And displaying the objects on the display device so that the objects displayed in the stereoscopic image have a focal distance corresponding to an actual depth value.

According to an aspect of the present invention, there is provided a stereoscopic image display device including: a light source for generating light; A condensing lens for uniformly irradiating light generated from the light source on the entire area of the first conversion lens; A first conversion lens for converting light passing through the condenser lens into parallel light; A video signal output unit for outputting a stereoscopic image signal embodied as an integral imaging signal; A transparent LCD panel for displaying the stereoscopic image signal using light having passed through the first conversion lens as a light source; A second conversion lens for condensing the image displayed on the transparent LCD panel into a lens array; A lens array for displaying an image having passed through the second conversion lens as a stereoscopic image; And a projection lens for diffusing the stereoscopic image output from the lens array.

It is preferable that the lens array has the same or the same parameter as the lens array used when the stereoscopic image signal is generated.

Also, in the stereoscopic image passed through the lens array, there may exist regions having different focal distances depending on the shape of the object displayed as the stereoscopic image.

The stereoscopic image signal may be obtained by setting a plurality of virtual object planes at regular intervals from a virtual lens array and selecting one of a plurality of virtual object planes for each pixel of the depth image according to a pixel value , Generating a depth difference image by setting a pixel value at a corresponding position of the RGB image at a position corresponding to each pixel of the depth image of the selected object plane and projecting the depth difference image to the virtual lens array Can be generated using one image.

The stereoscopic image display apparatus may further include an image signal generation unit for generating the stereoscopic image signal and providing the stereoscopic image signal to the image signal output unit. The image signal generation unit may generate an RGB image of the object to be displayed as a stereoscopic image, The depth image including the depth image may be used to generate the stereoscopic image signal.

The image signal generation unit may set a plurality of virtual object planes at regular intervals from a virtual lens array and select any one of a plurality of virtual object planes for each pixel of the depth image according to a pixel value , Generating a depth difference image by setting a pixel value at a corresponding position of the RGB image at a position corresponding to each pixel of the depth image of the selected object plane and projecting the depth difference image to the virtual lens array The stereoscopic image signal can be generated using one image.

The stereoscopic image display apparatus may further include an image capturing unit that captures the RGB image and the depth image and outputs the image to the image signal generator.

In addition, the first conversion lens and the second conversion lens may be implemented with a fresnel lens.

According to another aspect of the present invention, there is provided a stereographic projection apparatus including: the stereoscopic image display apparatus; A three-dimensional modeling unit for modeling a model corresponding to the object in three dimensions according to the depth information; And a 3D printer for generating the sculpture in accordance with the 3D modeling information, wherein the stereoscopic image display device can irradiate the stereoscopic image through the projection lens so that the stereoscopic image and the sculpture correspond to each other have.

In addition, the image signal generator may generate the stereoscopic image signal by modifying the color value of each pixel of the RGB image.

In a preferred embodiment of the present invention, a depth difference image is generated using an RGB image and a depth image of an object to be output to a stereoscopic image display device, and a depth difference image is projected on a lens array to generate a stereoscopic image signal The stereoscopic image signal is displayed on the transparent LCD panel and the displayed image is passed through the same lens array as the lens array used for generating the stereoscopic image, It is possible to output a stereoscopic image having a different focal distance so as to correspond to an actual depth value for each region included in the image.

1 is a diagram illustrating a configuration of a stereoscopic image display apparatus according to a preferred embodiment of the present invention.
2 is a diagram for explaining a process of generating a stereoscopic image signal according to a preferred embodiment of the present invention.
3 is a diagram showing an example of an image projected on a virtual lens array according to a preferred embodiment of the present invention.
FIG. 4 is a diagram showing an example of outputting the image shown in FIG. 3 (b) on a single screen plane using the stereoscopic image display apparatus of the present invention.
Fig. 5 is a diagram showing an example in which the image shown in Fig. 3 (a) is displayed on a plurality of screens provided so as to be spaced apart from each other.
FIG. 6 is a view showing an example of application of a stereoscopic image display device according to a preferred embodiment of the present invention, and is a diagram illustrating the configuration of a stereographic projection device implemented using the stereoscopic image display device of the present invention.
7A to 7C are diagrams for explaining a method of dropping an image on a sculpture according to the prior art.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a diagram illustrating a configuration of a stereoscopic image display apparatus 100 according to a preferred embodiment of the present invention.

1, a stereoscopic image display apparatus 100 according to the present invention includes a light source 110, a condenser lens 120, a first conversion lens 130, a video signal output unit 190, a transparent LCD panel 140 A second conversion lens 150, a lens array 160 and a projection lens 170. The remaining structure except for the projection lens 170 is formed in the housing 180 of the stereoscopic image display apparatus 100, Respectively.

First, the light source 110 is implemented by a plurality of LED lamps to generate light. The light generated by the light source 110 provides total light that projects a stereoscopic image to the outside of the stereoscopic image display device 100 through the following components.

The condensing lens 120 is installed in front of the light source 110 so that the light generated from the light source 110 is uniformly irradiated onto the entire area of the first conversion lens 130. In the preferred embodiment of the present invention, the condenser lens 120 is implemented as a convex lens. However, if the condenser lens 120 is configured to uniformly irradiate the light generated by the light source 110 with the first conversion lens 130, Do not.

The first conversion lens 130 is spaced apart from the condensing lens 120 by a predetermined distance. The first conversion lens 130 converts the light incident through the condensing lens 120 into parallel light and irradiates the parallel light to the transparent LCD panel 140. In the preferred embodiment of the present invention, the first conversion lens 130 is implemented as a fresnel lens in order to reduce the volume of the stereoscopic image display device 100. However, if only the direction of light can be converted into parallel light It may be implemented as a convex lens. The distance between the first conversion lens 130 and the condenser lens 120 can be determined in accordance with the refractive index of the condenser lens 120. When the spacing distance is fixed according to the design specification, The lens 120 is selected.

The video signal output unit 190 interlocks with an external electronic device 900 such as a computer and outputs a stereoscopic image signal input from an external electronic device 900 to the transparent LCD panel 140 in real time. In a preferred embodiment of the present invention, a stereoscopic image signal output to the transparent LCD panel 140 is an integral imaging signal generated to display a stereoscopic image by reflecting depth information, Will be described later.

The transparent LCD panel 140 uses the light passing through the first conversion lens 130 as a light source 110 to generate a stereoscopic image signal embodied as an integral imaging signal input from the image signal output unit 190 Display. As shown in FIG. 3, an image displayed through the transparent LCD panel 140 is an image photographed through a lens array, and an image through each of the plurality of lenses displays images at various view points.

Since the transparent LCD panel 140 is already widely used as an advertising means, a detailed description thereof will be omitted, and a stereoscopic image signal input to the transparent LCD panel 140 will be described later with reference to FIG.

The second conversion lens 150 performs a function of condensing the image displayed on the transparent LCD panel 140 through the lens array 160 and condensing the image on the projection lens 170. The preferred embodiment of the present invention reduces the volume of the stereoscopic image display device 100 by implementing the second conversion lens 150 with a Fresnel lens.

The lens array 160 has a structure in which a plurality of convex lenses are arranged in a matrix form, and displays an image that passes through the second conversion lens 150 as a stereoscopic image. As described later, an image displayed on the transparent LCD panel 140 is an image viewed through a virtual lens array of an original image (more precisely, a depth difference image reflecting depth information) The original image can be restored by passing the image through the same lens array 160. [ Therefore, the lens array 160 uses the same lens array or the same parameters as the lens array 160 used for generating the stereoscopic image signal.

In this case, the stereoscopic image of the present invention is an image reflecting depth information, and the stereoscopic image displayed through the lens array 160 may have different focal distances from area to area depending on the shape of the object. Therefore, the present invention can generate and output an image having a different depth in a specific space like a hologram.

The stereoscopic image output from the lens array 160 is diffused through the projection lens 170 to the front of the stereoscopic image display apparatus 100 and output.

Meanwhile, the stereoscopic image display device 100 according to another preferred embodiment of the present invention not only receives and outputs an image from an external electronic device 900, but also generates a stereoscopic image signal by capturing an image by itself .

As shown in FIG. 1, another preferred embodiment of the present invention includes an image capturing unit 194 and a video signal generating unit 192.

The image capturing unit 194 captures an object, generates an RGB image and a depth image, and outputs the RGB image and the depth image to the image signal generating unit 192. The image capturing unit 194 includes a color camera 194a and a depth sensor composed of an IR transmitting unit 194b-1 and an IR receiving unit 194b-2, It may be implemented as a softkin's kinect, or it may be implemented as a separate camera that generates an RGB image and a depth image, respectively.

2, the image signal generator 192 generates a stereoscopic image signal using the RGB image and the depth image input from the image capturing unit 194, and outputs the stereoscopic image signal through the image signal output unit 190 And outputs it to the transparent LCD panel 140. At this time, the image signal generator 192 may change the pixel value included in the RGB image.

2 is a diagram for explaining a process of generating a stereoscopic image signal according to a preferred embodiment of the present invention.

Referring to FIG. 2, a method of generating a stereoscopic image signal using an RGB image and a depth image will be described. Basically, an RGB image is composed of an image having an RGB value corresponding to a color value for each pixel on a two-dimensional plane, a depth image has pixels corresponding to each pixel of the RGB image, and each pixel has a depth value And have corresponding pixel values. In general, the depth image is displayed more brightly (the depth value is smaller and the pixel value is larger) and the farther away the image is darker (the depth value is larger and the pixel value is smaller).

In order to generate a stereoscopic image signal using the RGB image and the depth image, a virtual lens array 210 is first set at a position (z = 0) having a depth value of 0, and the virtual lens array 210 is set at a predetermined interval from the lens array 210 A plurality of imaginary object planes 200-1 to 200-n are set.

Thereafter, one of a plurality of imaginary object planes 200-1 to 200-n is sequentially selected for each pixel of the depth image according to a pixel value (depth value). That is, the smaller the depth value, the closer the object plane is to the virtual lens array 210. As the depth value increases, the object plane farther away from the virtual lens array 210 is selected.

Then, a pixel value at a corresponding position of the RGB image is set at a position corresponding to the pixel of the depth image on the selected object plane, and the above-described process is performed on all the pixels to generate the depth difference image.

Thereafter, an image obtained by projecting the depth difference image onto the virtual lens array 210 is photographed by software, thereby generating a stereoscopic image signal reflecting the depth information.

As described above, according to the present invention, depth information is reflected in each pixel of an image to be displayed as a stereoscopic image signal, so that objects included in a stereoscopic image displayed by the stereoscopic image display device 100 of the present invention can have different depth values And accordingly, they can have different focal lengths.

3 is a diagram showing an example of an image projected on a virtual lens array according to a preferred embodiment of the present invention.

Referring to FIG. 3, (a) in FIG. 3 is a software generated image for the experiment, in which depth values are set so that "DIYPRO" written in white is farther than "DIYPRO" written in green, The depth values of the letters of the same color were set to be the same.

FIG. 3 (b) is a view showing a photographed image after projecting the depth difference image onto the virtual lens array 210, as shown in FIG. 2, and is included in the lens array 210 It can be seen that each lens reflects images at various view points, which is the same as a general integral imaging method.

FIG. 4 is a diagram showing an example of outputting the image shown in FIG. 3 (b) on a single screen plane using the stereoscopic image display device 100 of the present invention.

As described with reference to FIG. 3, since the depth values of "DIYPRO" written in white letters and "DIYPRO" written in green letters are set to be different from each other, a "DIYPRO" area written in white letters and a green letter Quot; DIYPRO "areas written in white letters have different focal distances. When the distance between the projection lens 170 and the screen is adjusted," DIYPRO "written in green is clearly printed, When "DIYPRO" is not focused and is blurred (see FIG. 4 (a)) and "DIYPRO" written in white letters is clearly printed, "DIYPRO" written in green is not focused (See Fig. 4 (b)).

Fig. 5 is a diagram showing an example in which the image shown in Fig. 3 (a) is displayed on a plurality of screens provided so as to be spaced apart from each other.

Referring to FIG. 5, unlike FIG. 4, a green color having a small depth value is clearly displayed on a screen 1 installed in front of FIG. 3 (a), and a white color having a large depth value is displayed clearly . From these results, it can be seen that the stereoscopic images output from the stereoscopic image display apparatus 100 according to the preferred embodiment of the present invention are output with different focal distances according to the depth value of the original image.

6 is a diagram illustrating an example of application of the stereoscopic image display apparatus 100 according to a preferred embodiment of the present invention, and shows a configuration of a stereoscopic image projection apparatus implemented using the stereoscopic image display apparatus 100 of the present invention FIG.

Referring to FIG. 6, the stereographic projection apparatus includes a stereoscopic image display apparatus 100 shown in FIG. 1, three-dimensional (3D) stereoscopic display apparatus 100 for modeling a sculpture corresponding to an object displayed on a stereoscopic image using depth information obtained from a depth image, And a 3D printer 620 for directly generating the sculpture according to the 3D modeling information generated by the 3D modeling unit 610.

The 3D image display device 100 and the stereoscopic image display device 100 are arranged such that the depth value of each pixel of the depth image corresponds to the distance of the surface of the sculpture 630 generated by the 3D printer 620 to correspond to each pixel of the depth image, , A clear stereoscopic image having an accurate focal distance can be mapped to the sculpture 630 when the focal distance of the depth image is appropriately adjusted.

Figs. 7A to 7C are diagrams for explaining a method of projecting an image onto a sculpture according to the prior art. Fig.

First, as shown in FIG. 7A, in the case where an image is to be projected on the background behind the sculpture and the sculpture, since the sculpture is located in front of the background, when one image is projected as in the prior art, There was a problem that the focus was not suitable due to the position difference. That is, if the image is adjusted to be focused on the sculpture, the image displayed on the background is not focused, and the image displayed on the background is lightly displayed. If the background is focused, the image displayed on the sculpture is not focused.

In order to solve this problem, in the related art, as shown in Fig. 7B, an image composed of letters is displayed on the background behind the molding using one projector, and an image composed of letters is displayed on the molding using another projector , And the face image of the sculpture was displayed using another projector as shown in FIG. 7C.

However, in the case of the face image of FIG. 7C, it can be seen that the actual face image and the curvature formed on the sculpture are not matched, that is, the depth values are different from each other and the face is expressed in an awkward manner.

However, since the stereoscopic image display apparatus 100 of the present invention outputs one image having a different focal distance according to the depth value, in the example shown in FIGS. 7A to 7C, one stereoscopic image display apparatus 100), it is possible to project an image to a sculpture.

The present invention has been described with reference to the preferred embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

100 stereoscopic image display device 110 light source
120 condenser lens 130 first conversion lens
140 Transparent LCD panel 150 Second conversion lens
160 Lens Array 170 Projection Lens
180 Housing 190 Video signal output unit
192 image signal generator 194 image capturing unit
194a color camera 194b-1 IR transmitter
194b-2 IR receiving unit 610 Three-dimensional modeling unit
620 3D Printer 630 Sculpture
900 External electronics

Claims (10)

A light source for generating light;
A condensing lens for uniformly irradiating light generated from the light source on the entire area of the first conversion lens;
A first conversion lens for converting light passing through the condenser lens into parallel light;
A video signal output unit for outputting a stereoscopic image signal embodied as an integral imaging signal;
A transparent LCD panel for displaying the stereoscopic image signal using light having passed through the first conversion lens as a light source;
A second conversion lens for condensing the image displayed on the transparent LCD panel into a lens array;
A lens array for displaying an image having passed through the second conversion lens as a stereoscopic image; And
And a projection lens for diffusing the stereoscopic image output from the lens array. The method according to claim 1,
Wherein the lens array has the same or the same parameters as the lens array used when the stereoscopic image signal is generated. The method according to claim 1,
Wherein the stereoscopic image passed through the lens array has areas of different focal distances depending on the shape of an object displayed as a stereoscopic image. The method of claim 1, wherein the stereoscopic image signal
A plurality of imaginary object planes are set at regular intervals from a virtual lens array and one of a plurality of imaginary object planes is selected for each pixel of the depth image in accordance with the pixel value, Generating a depth difference image by setting a pixel value at a corresponding position of the RGB image at a position corresponding to each pixel and projecting the depth difference image onto the virtual lens array, Dimensional image display device. The method according to claim 1,
Further comprising a video signal generator for generating the stereoscopic video signal and providing the stereoscopic video signal to the video signal output unit,
Wherein the image signal generation unit generates the stereoscopic image signal using an RGB image of an object to be displayed as a stereoscopic image and a depth image including depth information of the object. 6. The apparatus of claim 5, wherein the image signal generator
A plurality of imaginary object planes are set at regular intervals from a virtual lens array and one of a plurality of imaginary object planes is selected for each pixel of the depth image in accordance with a pixel value, And generating a depth difference image by setting a pixel value at a corresponding position of the RGB image at a position corresponding to each pixel of the depth image, Wherein the signal generator generates a signal. 6. The method of claim 5,
Further comprising an image capturing unit capturing the RGB image and the depth image and outputting the captured RGB image and the depth image to the image signal generating unit. 8. The method according to any one of claims 1 to 7,
Wherein the first conversion lens and the second conversion lens are implemented as a fresnel lens.
A stereoscopic image display device according to any one of claims 5 to 7;
A three-dimensional modeling unit for modeling a model corresponding to the object in three dimensions according to the depth information to generate three-dimensional modeling information; And
And a 3D printer for generating the sculpture according to the 3D modeling information,
Wherein the stereoscopic image display device illuminates the stereoscopic image through the projection lens so that the stereoscopic image and the stereoscopic image correspond to each other. 10. The method of claim 9,
Wherein the image signal generator generates the stereoscopic image signal by modifying a color value of each pixel of the RGB image.

Images