JP4427716B2 - screen - Google Patents

Description

The present invention relates to a screen, in particular, for a plurality of viewers, without reducing the resolution, related to a screen that can be displayed three-dimensional image.

  In recent years, techniques for stereoscopically displaying images in television display devices have been developed. In the display of a stereoscopic image, a plurality of images taken from different positions of the subject are simultaneously displayed on the television display device, and the viewer recognizes the parallax of these images, so that the subject is stereoscopically viewed from the viewer. Displayed. In such a case, there is a method in which the viewer wears special glasses to observe an image displayed on the television display device, but the viewer does not have to wear special glasses as shown in FIG. There is also a method of displaying an image three-dimensionally.

  In FIG. 1, a deflection screen 2 is installed in front of the television display device 1, and a viewer 3 observes an image displayed on the television display device 1 through the deflection screen 2. The deflection screen 2 includes a plurality of cylindrical lenses arranged in the horizontal direction and having a characteristic of transmitting only a light beam in a specific direction.

  As shown in FIG. 2, the television display device 1 displays a plurality of images obtained by photographing the subject from different positions. In the example of FIG. 2, images obtained by photographing the subject from five different positions are displayed divided in the horizontal direction. In the figure, line A-1 is a vertical scanning line located at the leftmost end of the image taken from the first position, and line B-1 was taken from the second position. The vertical scanning line is located at the leftmost end of the image, and the line C-1 is the vertical scanning line located at the leftmost end of the image taken from the third position, and the line D− Reference numeral 1 denotes a vertical scanning line located at the leftmost end of the image taken from the fourth position, and line E-1 is located at the leftmost end of the image taken from the fifth position. , Vertical scanning lines.

  These lines A-1 to E-1 are combined to form a block 21-1. Similarly, the block 21-2 is a combination of the lines A-2 to E-2, and the lines A-2 to E-2 are respectively on the right side of the lines A-1 to E-1. It is a scanning line. By observing the television apparatus 1 displaying such blocks 21-1, 21-2,... Via the deflection screen 2, the viewer 3 recognizes the parallax of the image, and the viewer 3, the subject is displayed three-dimensionally.

  In addition, a technique for displaying a stereoscopic image by separating a left-eye image and a right-eye image using a parallax barrier has been proposed (for example, see Patent Document 1).

JP 2002-300610 A

  However, in the example of FIG. 2, each of the blocks 21-1, 21-2,... Displays five different images. The resolution of the image is 1/5 as compared to the case of displaying the image automatically. That is, in the conventional technology, there is a problem that the resolution of the image is lowered because the display surface is divided and a plurality of images are displayed. Further, the technique disclosed in Patent Document 1 has a problem that a stereoscopic image cannot be simultaneously provided to a plurality of viewers who observe images from a plurality of positions.

  The present invention has been made in view of such a situation, and makes it possible to display a stereoscopic image to a plurality of viewers without reducing the resolution.

The first screen of the present invention is a screen that presents a stereoscopic image to a user by projecting images taken at a plurality of different positions from a plurality of different positions corresponding to the positions at which the images were taken. The display panel on which the image to be imaged is arranged, and a predetermined distance away from the surface of the display panel that the user observes, and the incident projected image light is formed on the display board. The first planar optical element and the second planar optical element that is arranged at a distance set in advance on the surface side of the display plate that the user observes and emits light of an image formed on the display plate. The image is projected from a plurality of different positions on the back of the screen, and when the center line of the projected image is superimposed on the display board, the image is symmetrical about the image displayed on the display board From multiple positions Wherein the image is projected.

  The first and second planar optical elements may be cylindrical lens arrays in which cylindrical lenses are arranged at equal intervals in the horizontal direction.

  The first and second planar optical elements may be a refractive index distribution lens array in which rectangular refractive index distribution lenses are arranged at equal intervals in the horizontal direction.

  The first and second planar optical elements may be spherical lens arrays in which spherical lenses are arranged at equal intervals in the horizontal direction and the vertical direction.

  The first and second planar optical elements may be refractive index distribution lens arrays in which circular refractive index distribution lenses are arranged at equal intervals in the horizontal direction and the vertical direction.

In the first screen of the present invention, the display plate on which the projected image is formed, and the light incident on the display plate at a distance set in advance on the opposite side of the surface that the user observes are displayed on the display plate. A first planar optical element that forms an image on the display plate and emits light of a projected image formed on the display plate at a predetermined distance away from the surface of the display plate that is viewed by the user. Two planar optical elements are arranged. The image is projected from a plurality of different positions on the back of the screen, and when the center line of the projected image is superimposed on the display board, the image has a line-symmetric relationship with respect to the image displayed on the display board. Images are projected from a plurality of positions.

The second screen of the present invention is a screen for projecting images taken at a plurality of different positions and presenting a stereoscopic image to the user, and a flat display board on which the projected image is formed, and a display Two light control films joined so as to sandwich the plate, and the display plate and the two light control films have a cylindrical portion protruding in the direction observed by the user or in the opposite direction, in the horizontal direction, etc. The light control films are arranged side by side, and the light control films are arranged so as to have an angle dependency in the circumferential direction of the cylindrical portion.

  A cylindrical lens may be arranged on the concave side of the cylindrical portion of the display plate and the two light control films.

  The display panel and the two light control films may further be formed so as to have a corrugated shape as a whole by further forming a cylindrical portion that protrudes on the opposite side to the direction observed by the user.

  Cylindrical portions whose concave surfaces are directed to the user are repeatedly formed at equal intervals in the vertical direction, and another light control film having an angle dependency in the circumferential direction of the cylindrical portion is observed by the user. Further disposed on the opposite side of the surface, the image may be projected from a direction opposite to the direction the user views the screen.

  Another light control film formed so that the cylindrical surfaces are repeatedly arranged at equal intervals in the horizontal direction and the protruding surface of the cylindrical portion is on the user's observation surface side is further arranged on the surface side observed by the user The display board and the two light control films are arranged so that the cylindrical portions whose concave surfaces are directed to the user are arranged repeatedly at equal intervals in the vertical direction, and the image is projected from the direction observed by the user. can do.

In the second screen of the present invention, a flat display plate on which a projected image is formed and two light control films joined so as to sandwich the display plate protrude in the direction observed by the user. The cylindrical surfaces formed are arranged at equal intervals in the horizontal direction, and the light control film is disposed so as to have an angle dependency in the circumferential direction of the cylindrical surface.

  ADVANTAGE OF THE INVENTION According to this invention, the three-dimensional image which a several viewer can observe simultaneously can be displayed, without reducing the resolution.

  Embodiments of the present invention will be described below. The correspondence relationship between the invention described in this specification and the embodiments of the invention is exemplified as follows. This description is intended to confirm that the embodiments supporting the invention described in this specification are described in the specification. Therefore, even if there is an embodiment which is described in the specification but is not described here, this means that the embodiment does not correspond to the invention. It is not a thing. Conversely, even if an embodiment is described herein as corresponding to an invention, that means that the embodiment does not correspond to an invention other than the invention. Absent.

  Further, this description does not mean that all the inventions described in the specification are claimed. In other words, this description is for the invention described in the specification and not claimed in this application, i.e., for the invention that will be filed in division or applied or added in the future. It does not deny existence.

The present invention provides a first screen. This screen is a screen that presents a stereoscopic image to a user by projecting images taken at a plurality of different positions from a plurality of different positions corresponding to the positions at which the images were taken. The display plate (for example, the diffuser 184 in FIG. 12) to be imaged is disposed at a predetermined distance from the surface of the display plate opposite to the surface observed by the user, and the incident projected image light is separated. The first planar optical element (for example, the cylindrical lens array 183 in FIG. 12) that forms an image on the display plate is arranged away from the surface of the display plate that the user observes by a predetermined distance. the second planar optical element for emitting light of the imaged image on the display panel (e.g., a cylindrical lens array 185 in FIG. 12) and provided with an image, a plurality of different positions on the back of the screen Are al projected, when superimposed on the panel center line of the projected the picture, Ru image is projected from a plurality of positions having such a relation of line symmetry around the image displayed on the display panel.

  In this screen, the first and second planar optical elements are a cylindrical lens array (for example, a cylindrical lens array 181 in FIG. 8) in which cylindrical lenses are arranged at equal intervals in the horizontal direction. Can be.

  This screen has a refractive index distribution lens array in which the first and second planar optical elements are arranged with rectangular refractive index distribution lenses arranged at equal intervals in the horizontal direction (for example, the refractive index distribution lens of FIG. 11). Array 191).

  In this screen, the first and second planar optical elements are spherical lens arrays in which spherical lenses are arranged at equal intervals in the horizontal and vertical directions (for example, the spherical lens array 401 or 402 in FIG. 21). Can be.

  This screen has a refractive index distribution lens array (for example, the refractive index shown in FIG. 22) in which the first and second planar optical elements are arranged with circular refractive index distribution lenses arranged at equal intervals in the horizontal and vertical directions. A rate distribution lens array 421 or 422) can be provided.

According to the present invention, a second screen is provided. This screen projects images taken at a plurality of different positions (for example, the positions of the cameras 61-1 to 61-5 in FIG. 5) and presents a stereoscopic image to the user (for example, the screen 101 in FIG. 23). ) And a flat display board (for example, the diffuser 463 in FIG. 23) on which the projected image is formed, and two light control films (for example, FIG. 23) joined so as to sandwich the display board. Light control film 461 or 462), and the display plate and the two light control films have cylindrical portions protruding in the direction observed by the user or in the opposite direction, arranged at equal intervals in the horizontal direction. The light control film is formed so as to have an angle dependency in the circumferential direction of the cylindrical portion.

  In this screen, a cylindrical lens (for example, a cylindrical lens 464 in FIG. 28) may be disposed on the concave side of the cylindrical portion of the display plate and the two light control films.

  In this screen, the display plate and the two light control films are further formed with a cylindrical portion that protrudes on the opposite side to the direction observed by the user, and is formed in a wave shape as a whole (for example, , Screen 101) of FIG.

  The screen has a cylindrical portion whose concave surface is directed to the user and is repeatedly formed at equal intervals in the vertical direction, and another light control film having an angular dependency in the circumferential direction of the cylindrical portion (for example, A light control film 471 in FIG. 30 is further disposed on the side opposite to the surface observed by the user, and the image is projected from a direction opposite to the direction in which the user observes the screen (for example, the back surface). Projection).

  This screen has another light control film (for example, the light shown in FIG. 31) formed such that the cylindrical surfaces are repeatedly arranged at equal intervals in the horizontal direction, and the protruding surface of the cylindrical portion is on the observation surface side of the user. A control film 471) is further arranged on the surface side observed by the user, and the display plate and the two light control films have a cylindrical portion whose concave surface is directed to the user at equal intervals in the vertical direction. And the image is projected from the direction observed by the user (for example, rear projection).

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 3 is a block diagram showing the principle of the display device 60 to which the present invention is applied. In this example, it is assumed that five different images are presented to the user (viewer) and the images are displayed three-dimensionally.

  In the figure, cameras 61-1 to 61-5 are constituted by video cameras or the like, installed at different positions, and simultaneously photograph the same subject. An image processing unit 64 having the geometric correction units 62-1 to 62-5 (details will be described later with reference to FIG. 32) is configured by a computer or the like, and performs predetermined calculations on image data. Then, geometric correction of the image data is performed. The projectors 63-1 to 63-5 project an image (light) corresponding to the input image data. If it is not necessary to individually distinguish the cameras 61-1 to 61-5, the geometric correction units 62-1 to 62-5, or the projectors 63-1 to 63-5, the camera 61, the geometric correction unit 62, Alternatively, it is referred to as a projector 63.

  Images captured by the cameras 61-1 to 61-5 are converted into digital data (image data) and supplied to the geometric correction units 62-1 to 62-5, respectively. The geometric correction units 62-1 to 62-5 perform geometric correction processing on the image data of the cameras 61-1 to 61-5, respectively, and output the result to the projectors 63-1 to 62-5. The image data geometric correction process will be described later.

  The projectors 63-1 to 63-5 project the image data output from the geometric correction units 62-1 to 62-5 on the screen 101 (see FIG. 6 described later), respectively. Here, as a projection method of the projector, a method of projecting light of an image from the direction in which the user observes the screen (the front side of the screen as viewed from the user) with respect to the screen, that is, projecting light (image) from the front of the screen. (Hereinafter referred to as front projection) and a method of projecting image light from the direction opposite to the direction in which the user observes the screen (the back side of the screen as viewed from the user), that is, the back of the screen To project light (hereinafter referred to as rear projection).

  First, front projection will be described. FIG. 4 is a diagram illustrating the positional relationship between the camera 61 and the projector 63 in the case of front projection. As shown in FIG. 4A, the cameras 61-1 to 61-5 photograph the subject 81 from the directions of arrows 82-1 to 82-5, respectively. The projectors 63-1 to 63-5 project images from the directions of arrows 102-1 to 102-5, respectively, and the projected images are observed by the user 120.

  Here, the arrows 82-1 to 82-5 and the arrows 102-1 to 102-5 are set so that the angles between the arrows are equal. For example, when the angle between the arrow 82-3 and the arrow 82-4 is the angle α and the angle between the arrow 82-3 and the arrow 82-5 is the angle β, the arrow 102-3 and the arrow 102 −4 is set to an angle α, and an angle between an arrow 102-3 and an arrow 102-5 is set to an angle β.

  In this example, the arrows 82-1 to 82-5 and the arrows 102-1 to 102-5 are shown on the same plane as the paper (lined up and down in the figure). In other words, the arrows 82-1 to 82-5 and the arrows 102-1 to 102-5 are set on a plane (arranged in the depth direction in the drawing) perpendicular to the paper surface.

  5 and 6 are diagrams showing specific arrangement examples of the camera 61 and the projector 63. FIG. In FIG. 5, the cameras 61-1 to 61-5 are arranged on a plane (horizontal plane) that intersects at right angles to the center line of the subject 81 in the vertical direction in the drawing. In FIG. 6, projectors 63-1 to 63-5 are arranged on the same plane (horizontal plane) that intersects the screen 101 at a right angle. For example, the cameras 61-1 to 61-5 and the projectors 63-1 to 63-5 may be fixed on an installation stand so as to have the same height from the floor (ground), or from the ceiling. It may be hung.

  The center lines 141-1 to 141-5 of the optical axis of the image (light) taken by the cameras 61-1 to 61-5 in FIG. 5 are all set to intersect at one point on the subject 81. The center lines 141-1 to 141-5 are set such that the angle between the center lines is 30 °, for example.

  Similarly, the center lines 161-1 to 161-5 of the optical axes of the images (light) projected by the projectors 63-1 to 63-5 in FIG. 6 are all set to intersect at one point on the screen 101. The center lines 161-1 to 161-5 are set so that the angle between the center lines is 30 °.

  Note that the positions of the cameras 61-1 to 61-5 in FIG. 5 and the projectors 63-1 to 63-5 in FIG. In the present invention, the positions of the cameras 61-1 to 61-5 and the projectors 63-1 to 63-5 are set to have a similar relationship. The same applies to rear projection described later.

  Note that the shape of the screen 101 is not limited to a plane as shown in FIG. 6. For example, as shown in FIG. 7, the plane is curved so that the screen 101 is concave with respect to the user 120. It may be configured. In this way, an image with a high S / N ratio can be provided regardless of the position where the user 120 observes the screen in a wider range.

  FIG. 8 is a diagram illustrating a configuration example of the screen 101. In this example, the screen 101 includes a display plate 182 that is a general diffusion plate (diffuser) and a cylindrical lens (lenticular lens) array 181 that refracts light. The cylindrical lens array 181 is formed by arranging cylindrical cylinders having a shape (so-called kamaboko type), which is a long cylinder in the vertical direction (the depth direction in the figure) and cut in the vertical direction at equal intervals in the horizontal direction in the figure. Is. The cylindrical lenses 181-i (i = 1, 2, 3,...) Are arranged so that their projecting surfaces are directed toward the display plate 182.

  The light of the projector 63 is projected on the screen 101 configured in this manner from the direction of the arrow 201 (the direction in which the user 120 is present), and the projected light is applied to the display plate 182 via the cylindrical lens array 181. Incident light forms an image. The light incident on the display board 182 is reflected in the direction of the arrow 202 and is observed by the user 120 through the cylindrical lens array 181.

  The distance between the cylindrical lens array 181 and the display plate 182 is set to be equal to the focal length of the cylindrical lens 181-i.

  FIG. 9 is a diagram showing in detail how light is incident on the screen 101 and reflected. Assume that light is projected from three different projectors toward the screen 101. The direction of the light projected from the first projector is represented by an arrow 201-1, the direction of the light projected from the second projector is represented by an arrow 201-2, and the light projected from the third projector. This direction is represented by an arrow 201-3.

  In the leftmost cylindrical lens 181-1 of the cylindrical lens array 181, the light incident from the direction of the arrow 201-1 is refracted by the cylindrical lens and forms an image at the focal point 221-1 on the display plate 182. The light imaged at the focal point 221-1 is reflected by the display plate 182 and is incident again on the leftmost cylindrical lens 181-1 in the figure of the cylindrical lens array 181. And the light which passed the cylindrical lens 181-1 advances to the direction of the arrow 202-1 (direction parallel to the arrow 202-1). The light incident from the direction of the arrow 201-2 is refracted by the cylindrical lens 181-1 and forms an image at the focal point 221-2 on the display plate 182. The light imaged at the focal point 221-2 is reflected by the display plate 182 and again enters the cylindrical lens 181-1. The light passing through the cylindrical lens 181-1 travels in the direction of the arrow 202-2. Light incident from the direction of the arrow 201-3 is refracted by the cylindrical lens 181-1 and forms an image at a focal point 221-3 on the display plate 182. The light imaged at the focal point 221-3 is reflected by the display plate 182, enters the cylindrical lens 181-1 again, and the light passing through the cylindrical lens 181-1 travels in the direction of the arrow 202-3.

  Similarly, the incidence and reflection of light projected from three different projectors are the second (center) cylindrical lens 181-2 from the left in the figure of the cylindrical lens array 181 and the rightmost in the figure of the cylindrical lens array 181. This is also performed in the cylindrical lens 181-3. Then, the user observes the light reflected by the reflecting plate 182 and traveling through the cylindrical lens 181-i.

  In the cylindrical lens array 181, the cylindrical lenses 181-i are arranged at an interval equivalent to the radius of the lens (at a pitch of about 1.5 times the radius). By doing in this way, when the light that has entered the cylindrical lens 181-i and formed an image is reflected by the display plate 182, the reflected light is the adjacent cylindrical lens 181-i-1 (or 181-i + 1). The occurrence of so-called crosstalk, in which the image becomes unclear as a result, can be prevented.

  In this way, as shown in FIG. 10, the user 121 that is in the left direction toward the screen 101 receives light 241-1 corresponding to the parallax caused by the right eye 121-1 and the left eye 121-2 of the user 121. And 241-2 enter. In addition, light 242-1 and 242-2 corresponding to parallax caused by the right eye 122-1 and the left eye 122-2 of the user 122 are incident on the user 122 in the right direction toward the screen 101, respectively. Therefore, by increasing the number of projectors sufficiently, a stereoscopic image can be presented wherever the user is.

  Furthermore, since images are simultaneously projected on the screen 101 from a plurality of projectors installed at different positions, the image is compared with the projection or display of a normal image (two-dimensional image (non-stereoscopic image)). It is possible to suppress degradation of the resolution.

  In FIG. 8, the screen 101 is configured by the cylindrical lens array 181 and the display plate 182, but instead of the cylindrical lens array 181, a gradient index lens array 191 as shown in FIG. The screen 101 may be configured. The gradient index lens array 191 includes so-called strip-shaped gradient index lenses 191-1, 191-2, 191-3,... That are long in the vertical direction (the depth direction in the drawing) in the horizontal direction in the drawing. The refractive index distribution lenses 191-i are arranged at equal intervals, and the refractive index of light incident on the lens is different in each part of the lens. As a result, the same optical characteristics as the cylindrical lens can be obtained.

  In the figure, the density near the center of the gradient index lens 191-i is displayed with a lighter density, and the density is displayed closer to the left and right ends (outside). The refractive index distribution lens 191-i is configured such that the light refractive index is smaller in the portion displayed lighter in the drawing and the light refractive index is higher in the portion displayed darker in the drawing.

  In addition, instead of the gradient index lens array 191, strip-shaped Fresnel lenses having the same characteristics as the gradient index lens are arranged at equal intervals in the horizontal direction in the figure to constitute a Fresnel lens array. The screen 101 may be configured by the array and the display plate 182.

  Next, as a projection method of the projector, a rear projection, which is a projection method different from the above-described front projection, will be described.

  First, the configuration of the screen 101 used for rear projection will be described. In the case of rear projection, the screen 101 is configured as shown in FIG. In the figure, a diffuser 184 made of a material such as translucent ground glass is disposed between two cylindrical lens arrays 183 and 185 having the same configuration as the cylindrical lens array 181 described above with reference to FIG. As a result, the screen 101 is configured. The cylindrical lens arrays 183 and 185 are arranged so that the projecting surfaces of the cylindrical lenses 183-1 to 183-3 and 185-1 to 185-3 included therein face the diffuser 184.

  Note that the distance between the cylindrical lens array 183 and the diffuser 184 and the distance between the cylindrical lens array 185 and the diffuser 184 are set to be equal to the focal lengths of the respective cylindrical lenses 183-i and 185-i. .

  In the figure, the image (light) projected from the projector enters the screen 101 from the direction indicated by the arrow 241, and the light transmitted through the screen 101 proceeds in the direction indicated by the arrow 242 and is observed by the user 120. The

  FIG. 13 is a diagram showing in detail how the light incident on the screen 101 travels through the screen 101. Now, assume that images are projected from three different projectors toward the screen 101. The direction of the light projected from the first projector is represented by arrow 261-1, the direction of the light projected from the second projector is represented by arrow 261-2, and the light projected from the third projector This direction is represented by an arrow 261-3.

  In the leftmost cylindrical lens 183-1 in the figure of the cylindrical lens array 183, the light incident from the direction of the arrow 261-1 is refracted by the cylindrical lens 183-1 and is once imaged at the focal point 281-1 on the diffuser 184. To do. The light imaged at the focal point 281-1 passes through the translucent diffuser 184 and enters the leftmost cylindrical lens 185-1 of the cylindrical lens array 185 in the drawing. Then, the light passing through the cylindrical lens 185-1 travels in the direction of the arrow 262-1. The light incident from the direction of the arrow 261-2 is refracted by the cylindrical lens 183-1 and once forms an image at the focal point 281-2 on the diffuser 184. The light imaged at the focal point 281-2 passes through the diffuser 184, enters the leftmost cylindrical lens 185-1 of the cylindrical lens array 185, passes through the cylindrical lens 185-1, and passes through the arrow 262-2. Proceed in the direction of The light incident from the direction of the arrow 261-3 is refracted by the cylindrical lens 183-1, temporarily forms an image at the focal point 281-3 on the diffuser 184, passes through the diffuser 184, and the cylindrical lens 185-of the cylindrical lens array 185. 1 and travels in the direction of the arrow 262-3 through the cylindrical lens 185-1.

  The relationship between the arrows 261-i and 262-i is described later with reference to FIG. 15.

  Similarly, the cylindrical lens array 183 and the cylindrical lens array 185 are the second (center) cylindrical lenses 183-2 and 185-2 from the left in the figure, and the cylindrical lens array 181 and the cylindrical lens array 185 in the rightmost figure in the figure. Also in the cylindrical lenses 183-3 and 185-3, light projected from three different projectors is refracted by the cylindrical lens 183-i of the cylindrical lens array 183, and once formed at the focal point on the diffuser 184, the cylindrical lens array It passes through 185 cylindrical lens 185-i. Then, the user observes the light traveling through the screen 101 (the cylindrical lens array 183, the diffuser 184, and the cylindrical lens array 185) in this way.

  In this way, as in the case described above with reference to FIG. 10, the user who monitors (views) the screen 101 is irradiated with light corresponding to the parallax between the right eye and the left eye, and as a result, the user Provides a stereoscopic image. Further, as in the case of FIG. 10, by increasing the number of projectors sufficiently, a stereoscopic image can be observed wherever the user is. Furthermore, since images are simultaneously projected on the screen 101 from a plurality of projectors installed at different positions, the resolution of the image is degraded as compared with the projection or display of a normal image (two-dimensional image). It is suppressed.

  In FIG. 12, the screen 101 is configured by the cylindrical lens array 183, the diffuser 184, and the cylindrical lens array 185. However, as in the case described above with reference to FIG. Instead of 185, the screen 101 may be configured by using gradient index lens arrays 193 and 194 as shown in FIG. The gradient index lens arrays 193 and 194 are the same as the gradient index lens array 191 described above with reference to FIG.

  In addition, in place of the gradient index lens arrays 193 and 194, two strips of Fresnel lenses having the same characteristics as the gradient index lens are arranged in the horizontal direction at equal intervals. The screen 101 may be configured by disposing a diffuser 184 between two Fresnel lens arrays.

  Next, the arrangement of the projector 63 when performing rear projection on the screen 101 configured as shown in FIG. 12 or FIG. 14 will be described. The relationship between the positions of the camera 61 and the projector 63 in the case of front projection is as described above with reference to FIG. 4, but the relationship between the positions of the camera 61 and the projector 63 is different in the case of rear projection. It will be.

  FIG. 15 is a diagram illustrating a direction (optical axis) in which light projected from two different projectors travels on the screen 101 in FIG. 12 (or in FIG. 14). Now, when one projector projects light from the direction of the arrow 301-1 onto the back surface of the screen 101 (upward direction in the drawing, that is, the projector side), the light passes through the screen 101 and the front surface of the screen 101 (see FIG. The process proceeds in the direction of the arrow 301-2 from the middle down direction (ie, the user side). On the other hand, when another projector projects light on the back surface of the screen 101 from a direction 302-1 that is separated by an angle θ on the right side in the drawing in the direction of the arrow 301-1, the light passes through the screen 101 and passes through the screen 101. Proceed in the direction of arrow 302-2.

  Since the light projected rearward with respect to the screen 101 of FIG. 12 (or FIG. 14) travels as shown in FIG. 15, the relationship between the positions of the camera 61 and the projector 63 in the case of rear projection is shown in FIG. It comes to be.

  That is, as shown in FIG. 16A, the cameras 61-1 to 61-5 photograph the subject 81 from the directions of arrows 82-1 to 82-5, respectively. As shown in FIG. 16B, the images thus captured are rear-projected onto the screen 101 by the projectors 63-1 to 63-5 from the directions of arrows 102-1 to 102-5, respectively. The user 120 observes the projected image. Here, arrows 82-1 to 82-5 in FIG. 16A and arrows 102-1 to 102-5 in FIG. 16B overlap the subject 81 (its center line) in FIG. 16A on the screen 101 shown in FIG. 16B. When combined, the screen 101 (subject 81) is in a line-symmetric relationship with the center.

  Also, the arrows 82-1 to 82-5 in FIG. 16A and the arrows 102-1 to 102-5 in FIG. 16B are set so that the angles between the arrows are equal. For example, when the angle between the arrow 82-3 and the arrow 82-4 is the angle α and the angle between the arrow 82-3 and the arrow 82-5 is the angle β, the arrow 102-3 and the arrow 102 −4 is set to an angle α, and an angle between an arrow 102-3 and an arrow 102-5 is set to an angle β.

  In this example, the arrows 82-1 to 82-5 and the arrows 102-1 to 102-5 are shown on the same plane as the paper (lined up and down in the figure). The arrows 82-1 to 82-5 and the arrows 102-1 to 102-5 are set on a horizontal plane (arranged in the depth direction in the drawing) perpendicular to the paper surface.

  By arranging the cameras 61-1 to 61-5 and the projectors 63-1 to 63-5 in such a positional relationship, the user 120 observes light (stereoscopic image) similar to the front projection even in the rear projection. Is done.

  Next, a specific arrangement of the projector 63 in the case of rear projection will be described. FIG. 17 is a diagram showing one example of a specific arrangement of the projector 63 in the case of rear projection. In this example, the projectors 63-1 to 63-5 are arranged to directly project light from the directions of arrows 102-1 to 102-5 shown in FIG. 16B. When the projectors 63-1 to 63-5 are located at a distance sufficiently away from the screen 101, an image is provided by directly projecting light from the projectors 63-1 to 63-5 onto the screen 101 in this way. However, if the projectors 63-1 to 63-5 are not located at a distance sufficiently away from the screen 101, the method shown in FIG. The direction of the observed light may be slightly shifted. This phenomenon will be described with reference to FIG.

  FIG. 18 is a diagram illustrating the difference between the front projection and the rear projection regarding the relationship between the viewpoint of the user observing the screen 101 and the light incident on the viewpoint of the user. FIG. 18A is a diagram illustrating the direction of light when an image projected by front projection is observed from the user's viewpoint (eye) 120-1. In FIG. 18A, the light of the image (pixel) displayed at the point 101-1 on the screen 101 proceeds in the direction of the arrow 321-1 and enters the viewpoint 120-1. Similarly, the light of the image (pixel) displayed at points 101-2 and 101-3 on the screen 101 travels in the directions of arrows 321-2 and 321-3, respectively, and enters the viewpoint 120-1.

  In the case of front projection, as described above with reference to FIG. 4, the light of the projector 63 is projected from the same direction as the direction in which the subject 81 is captured by the camera 61. Therefore, light of an image taken from almost the same direction as the viewpoint 120-1 is incident on the user's viewpoint 120-1.

  In contrast, FIG. 18B is a diagram illustrating the direction of light when an image projected by rear projection is observed from the user's viewpoint (eye) 120-1. In the case of rear projection, as described above with reference to FIG. 16, the light of the projector 63 is projected from the direction in which the subject 81 is photographed by the camera 61 and the direction that is line-symmetric with respect to the screen. Therefore, when light is directly projected from the projector 63 onto the screen 101, the position of the projector 63 is line-symmetric with respect to the screen 101.

  At this time, light projected from the projector 63 (light in three directions in this example) is incident on the screen 101 from the directions of arrows 331 to 333, respectively. Light incident from the directions of arrows 331 to 333 becomes images (pixels) of points 101-1 to 101-3 on the screen 101, respectively. The light of the images (pixels) of the points 101-1 to 101-3 on the screen 101 originally proceeds in the directions of arrows 321 to 323 and enters the viewpoint 120-1 as in the case of front projection, Although it should be observed, in the case of rear projection, since the light projected from the projector 63 travels through the screen 101, the light of the images (pixels) at the points 101-1 and 101-3 is They will proceed in the directions of arrows 341 and 343, respectively. However, since the user is observing light from the directions of the arrows 321 and 323, the direction of light observed by the user is shifted in the rear projection as compared with the front projection.

  Therefore, in the present invention, in the case of rear projection, the light emitted from the projector is reflected once by the elliptical mirror, and the light reflected by the elliptical mirror is projected on the screen 101. The ellipsoidal mirror is obtained by cutting a predetermined part of a spheroid obtained by rotating an ellipse around its long axis (or short axis) and using the inside as a mirror.

  FIG. 19 shows a configuration example of an elliptical mirror. In this example, an ellipse 341 indicated by a dotted line rotates around its major axis 341 to obtain a spheroid, and a part of the ellipse is cut out to form an elliptical mirror 342. The elliptical mirror 342 has two focal points f1 and f2 on the long axis of the ellipse 341 due to the nature of the ellipse. The light emitted from one focal point is directed to a point on the inner side (mirror surface) of the elliptical mirror 342 disposed at an arbitrary position, reflected by the mirror surface of the elliptical mirror 342, and incident on the other focal point.

  Here, as shown in FIG. 19, the elliptical mirror 342 and the screen 101 are placed so that the irradiation port of the projector 63 is disposed at the position of one focus f1, and the position of the other focus f2 is the user's viewpoint. If arranged, the image (light) observed by the user is an image equivalent to the image projected from the focal point f2, that is, the light projected from the focal point f2 on the front surface is reflected by the screen 101 and observed by the user. Thus, an image obtained by light in substantially the same direction as that in the case of rear projection can be obtained as in the case of front projection.

  FIG. 20 is a diagram illustrating a specific arrangement example of the projector in the case where the light emitted from the projector is once reflected by the elliptical mirror and the light reflected by the elliptical mirror is projected onto the screen 101. As shown in the figure, the projectors 63-1 to 63-5 are arranged to reflect the light projected by the projectors 63-1 to 63-5 to the elliptical mirrors 342-1 to 341-5. Then, the light reflected by the elliptical mirrors 342-1 to 342-5 passes through the screen 101 and is observed by the user 120.

  As described above with reference to FIG. 19, the projectors 63-1 to 63-5, the elliptical mirrors 342-1 to 342-5, and the screen 101 are configured so that the irradiation port of each projector and the viewpoint of the user are elliptical mirrors. It arrange | positions so that it may become a position corresponding to two focus.

  In this example, the shape of the screen 101 is a flat surface. However, similarly to FIG. 7, the flat surface may be curved so that the screen 101 is concave with respect to the user 120.

  In the above, an example in which a plurality of cameras 61 or projectors 63 are arranged horizontally on a horizontal plane (parallel to the floor) and at the same height from the floor to provide a three-dimensional image has been described. Alternatively, a plurality of projectors 63 may be further arranged on a vertical plane perpendicular to the floor. By doing so, it is possible to provide the user with an image having parallax not only in the horizontal direction but also in the vertical direction, and as a result, a stereoscopic image can be provided.

  FIGS. 21 and 22 show configuration examples of the screen 101 in the case of providing an image having parallax in the horizontal direction and the vertical direction.

  FIG. 21 is an example corresponding to FIG. 12, and in FIG. 12, the screen 101 is configured by disposing a diffuser 184 between the cylindrical lens arrays 181 and 183. In FIG. The screen 101 is configured by arranging the diffuser 184 between the arrays 401 and 402. The spherical lens array 401 is configured by arranging spherical lenses obtained by dividing a spherical lens by a plane and arranged at equal intervals in the vertical direction and the horizontal direction.

  The distance between the spherical lens array 401 and the diffuser 184 and the distance between the spherical lens array 402 and the diffuser 184 are set to be equal to the focal length of the spherical lens.

  FIG. 22 is an example corresponding to FIG. 13, and in FIG. 13, a diffuser 184 is disposed between refractive index distribution lens arrays 183 and 185 constituted by a plurality of strip-shaped refractive index distribution lenses, and the screen 101. In FIG. 22, the screen 101 is configured by arranging the diffuser 184 between the gradient index lens arrays 421 and 422 constituted by a plurality of circular gradient index lenses. Yes. In the figure, the circular gradient index distribution lens is configured such that the portion where the density is displayed is higher, the light refractive index is higher, and the portion where the light is displayed is lower, the light refractive index is lower. As a result, optical characteristics similar to those of the spherical lens can be obtained.

  Note that the screen 101 may be configured by disposing a diffuser 184 between two Fresnel lens arrays each having a characteristic similar to that of a gradient index lens and configured by a plurality of circular Fresnel lenses. Good.

  Up to this point, an example in which the screen 101 is configured using a cylindrical lens array, a gradient index lens array, or a Fresnel lens array has been described. Next, an example in which the screen 101 is configured using a light control film. explain.

  The light control film is a sheet-like optical filter having a so-called louver structure, and a large number of rectangular microscopic films having light shielding properties are arranged at microscopic intervals so that the surfaces face each other. A slit is formed between microfilms. For example, optical light that transmits (passes) only the light in the front direction as it is, and reduces the amount of light transmitted through the light beam that deviates from the front direction (light beam that intersects the surface of the microfill). Has characteristics. Since the light control film is light and easy to process, the shape of the screen 101 can be set more freely than in the case of using a cylindrical lens array or a gradient index lens array.

  FIG. 23 is a first configuration example of the screen 101 using a light control film. As shown in the figure, the screen 101 has a plurality of cylindrical portions 460-i (i = 1, 2, 3,...) Formed by repeatedly bending an originally flat member. Yes. The screen 101 is formed so that the cylindrical portions 460-i are arranged in the horizontal direction and the protruding surface faces the user 120. A portion surrounded by a square frame on the right side of the figure is an enlarged view of the cylindrical portion 460-4 at the right end portion of the screen 101, and represents an internal configuration thereof. In this example, a diffuser 463 is sandwiched between the light control 461 and the light control film 462.

  The screen 101 configured as described above can be used for either front projection or rear projection, but in the case of front projection, the light control film 462 may be omitted. In the case of front projection, light (image) is projected by the projector 63 from the direction of the arrow 481 (from the projecting surface side of the cylindrical portion 460-i), and the user 120 observes the light reflected by the screen 101. In the case of rear projection, light (image) is projected by the projector 63 from the direction of the arrow 482 (from the concave surface side of the cylindrical portion 460-i), and the user 120 is caused to observe the light that has passed through the screen 101.

  As described above, the light control films 461 and 462 have an angle dependency that changes the transmittance of the light according to the incident direction of the light, and the incident angle at which the transmittance of the light is the highest is obtained. This is called the louver angle. In this example, light control films having a louver angle of 0 ° are used for the light control films 461 and 462, respectively. Therefore, the light control films 461 and 462 transmit the light in the front direction almost as it is, and the light having a larger angle from the front direction in the horizontal plane reduces the amount of light transmitted (the light transmittance). Due to this optical characteristic, the light control films 461 and 462 have a light transmittance of zero when the light incident angle differs by ± 30 ° or more from the louver angle, and the light incident angle is louvered. When the angle is different by about ± 15 ° from the angle, the light transmittance is set to a value about half of the maximum transmittance (light transmittance at the louver angle).

  Next, the relationship between the positions of the camera 61 and the projector 63 when an image is projected using the screen 101 shown in FIG. 23 will be described.

  Similarly, FIG. 24 is a diagram illustrating a positional relationship between the camera cameras 61-1 to 61-5 and the projectors 63-1 to 63-5 in the case of front projection. This figure corresponds to FIG. 4, and the same reference numerals are given to the corresponding parts in each figure. In FIG. 24A, the cameras 61-1 to 61-5 photograph the subject 81 from the directions of arrows 82-1 to 82-5. The images shot in this way are projected onto the screen 101 from the directions of arrows 102-1 to 102-5 by the projectors 63-1 to 63-5, as shown in FIG. 24B.

  At this time, the arrangement of the cameras 61-1 to 61-5 is set corresponding to the optical characteristics of the light control films 461 and 462 described above. For example, since the light control films 461 and 462 do not transmit light incident from an angle different by ± 30 ° or more from the louver angle, the image corresponding to the light incident within the range of ± 30 ° is the light control film 461. (Or 462). Therefore, the cameras 61-1 to 61-5 are arranged so that the angle between the optical axes (arrows 82-1 to 82-5) of the cameras 61-1 to 61-5 is 30 °.

  In FIG. 24B, the projectors 63-1 to 63-5 are arranged so that the angle between the optical axes (arrows 102-1 to 102-5) of the light projected by the projectors 63-1 to 63-5 is 30 °. Be placed.

  In this example, the arrows 82-1 to 82-5 and the arrows 102-1 to 102-5 are shown on the same plane as the paper (lined up and down in the figure). The arrows 82-1 to 82-5 and the arrows 102-1 to 102-5 are set on a horizontal plane (arranged in the depth direction in the drawing) perpendicular to the paper surface.

  In this way, as in the case described above with reference to FIG. 10, the user 121 located in the left direction toward the screen 101 can deal with the parallax caused by the right eye 121-1 and the left eye 121-2 of the user 121. Light 241-1 and 241-2 to be incident. In addition, light 242-1 and 242-2 corresponding to the parallax by the right eye 122-1 and the left eye 122-2 of the user 122 are incident on the user 122 in the right direction toward the screen 101. Therefore, if the number of projectors (cameras) is sufficiently large, a three-dimensional image can be presented wherever the user is. Furthermore, since images are simultaneously projected on the screen 101 from a plurality of projectors installed at different positions, the resolution of the image is degraded as compared with the projection or display of a normal image (two-dimensional image). This can be suppressed.

  Next, the relationship between the positions of the camera 61 and the projector 63 when performing rear projection on the screen 101 shown in FIG. 23 will be described. The relationship between the positions of the camera 61 and the projector 63 in the case of front projection is as described above with reference to FIG. 24. However, in the case of rear projection, the relationship between the positions of the camera 61 and the projector 63 is different from this. It will be.

  FIG. 25 is a diagram illustrating a direction in which light (optical axis) projected from two different projectors travels on the screen 101 in FIG. Now, when one projector projects light from the direction of the arrow 501-1 onto the back surface of the screen 101 (upward in the drawing, ie, the projector side), the light passes through the screen 101 and the front surface of the screen 101 (FIG. The process proceeds in the direction of the arrow 501-2 from the middle down direction (that is, the user side). On the other hand, when another projector projects light onto the back surface of the screen 101 from a direction shifted by an angle θ (the direction of the arrow 502-1) to the left side in the drawing in the direction of the arrow 501-1, the light is transmitted through the screen 101. Pass through and proceed in the direction of arrow 502-2 from the front of screen 101.

  Since the light projected rearward with respect to the screen 101 in FIG. 23 travels as shown in FIG. 25, the relationship between the positions of the camera 61 and the projector 63 in the case of front projection is as shown in FIG.

  That is, as shown in FIG. 26A, the cameras 61-1 to 61-5 photograph the subject 81 from the directions of arrows 82-1 to 82-5, respectively. As shown in FIG. 26B, the images thus captured are projected back onto the screen 101 by the projectors 63-1 to 63-5 from the directions of arrows 102-1 to 102-5, respectively. The user 120 observes the projected image. Here, the arrows 82-1 to 82-5 in FIG. 26A and the arrows 102-1 to 102-5 in FIG. 26B are the center point indicated by a black dot on the subject 81 in FIG. When a center point indicated by a black dot is superimposed on the screen 101, a point-symmetrical relationship is established with the center point of the screen 101 (subject 181) as the center.

  In addition, the arrows 82-1 to 82-5 in FIG. 26A and the arrows 102-1 to 102-5 in FIG. 26B are set so that the angles between the arrows are equal. In this example, the angles between the arrows 82-1 to 82-5 are 30 °, so the angles of the arrows 102-1 to 102-5 are also set to 30 °.

  In this example, the arrows 82-1 to 82-5 and the arrows 102-1 to 102-5 are shown on the same plane as the paper (lined up and down in the figure). The arrows 82-1 to 82-5 and the arrows 102-1 to 102-5 are set on a horizontal plane (arranged in the depth direction in the drawing) perpendicular to the paper surface.

  By arranging the cameras 61-1 to 61-5 and the projectors 63-1 to 63-5 in such a positional relationship, in the case of rear projection, light (image) similar to that of front projection is observed by the user 120. The

  Next, a specific arrangement example of the projector 63 when performing rear projection on the screen 101 shown in FIG. 23 will be described. When performing rear projection, light may be projected directly from the projector 63 onto the screen 101. However, for the reason described above with reference to FIG. It is desirable to project the light reflected from the mirror onto the screen 101.

  FIG. 27 is a diagram showing a specific arrangement example of the projectors 63-1 to 63-5 when rear projection is performed on the screen 101 shown in FIG. This figure corresponds to FIG. 20, and the same reference numerals are given to the corresponding parts in each figure. In FIG. 27, as compared with the case of FIG. 20, the projectors 63-1 to 63-5 and the elliptical mirrors 342-1 to 342-5 are arranged to be reversed. That is, in FIG. 20, projectors 63-1 to 63-5 and elliptical mirrors 342-1 to 342-5 are arranged in order from the right side in the figure, whereas in FIG. 27, from the left side in the figure. In order, projectors 63-1 to 63-5 and elliptical mirrors 342-1 to 342-5 are arranged.

  As shown in FIGS. 15 and 25, when the rear projection is performed on the screen 101 of FIG. 12 (or FIG. 14) and when the rear projection is performed on the screen 101 of FIG. This is because the traveling direction of light differs in each case, and as a result, when rear projection is performed on the screen 101 of FIG. 12 (or FIG. 14), the positions are symmetrical with the cameras 61-1 to 61-5. The projectors 63-1 to 63-5 are arranged on the screen 101 (FIG. 16), but when the rear projection is performed on the screen 101 of FIG. 23, the projectors are located at positions symmetrical to the cameras 61-1 to 61-5. This is for arranging 63-1 to 63-5 (FIG. 26).

  In this way, the same image as in the front projection can be obtained even in the rear projection.

  In the case of rear projection, the screen 101 may be configured as shown in FIG. A portion surrounded by a square frame on the right side of the figure is an enlarged view of the cylindrical portion 460-4 at the right end portion of the screen 101, and represents an internal configuration thereof. In this example, the diffuser 463 is sandwiched between the light control 461 and the light control film 462 as in FIG. 23, but unlike the case of FIG. 23, the cylindrical portions of the light controls 461 and 462 and the diffuser 463 are used. A cylindrical lens 464-i (i = 1, 2, 3,...) Is arranged in parallel with the cylindrical portion 460-i on the concave surface side of 460-i (backward when viewed from the user 120). The cylindrical lens 464-i has a function of condensing a light beam parallel to a plane from which a circular cut surface can be obtained at one focal point, and the user 120 observes light (image) through the screen 101 using the cylindrical lens 464. By doing so, an image with higher luminance can be obtained.

  In the screen 101 shown in FIG. 28, the light controls 461 and 462, the diffuser 463, and the distance between the cylindrical lens 464-i and the diffuser 463 are the same as the focal length of the cylindrical lens 464-i. A cylindrical lens 464-i is disposed.

  FIG. 29 is a diagram showing still another configuration example of the screen 101 shown in FIG. In this example, the diffuser 463 is also sandwiched between the light control 461 and the light control film 462. In the case of FIG. 23, in the screen 101, the light controls 461 and 462 and the diffuser 463 are repeatedly curved in the horizontal direction so that the user 120 side is a projecting surface, and the cylindrical portions 460-i having the same shape are arranged in the horizontal direction. In this example, the screen 101 has the light controls 461 and 462 and the diffuser 463 in the horizontal direction in the forward direction (user 120 side) and rearward (opposite the user 120). Alternately, a cylindrical portion is formed, and as a whole, it has a wave shape. By adopting such a shape, the screen 101 can be processed more easily than in the case of FIG.

  The shape of the screen 101 shown in FIG. 23, FIG. 28 or FIG. 29 may be configured such that the plane is curved and the screen 101 is concave with respect to the user 120, as in FIG. Good.

  Further, as described above with reference to FIG. 21 or FIG. 22, when providing an image having parallax in the horizontal direction and the vertical direction, the screen 101 using the light control film is as shown in FIG. 30 or FIG. Configured. FIG. 30 is a diagram showing a configuration example of the screen 101 in the case of performing rear projection. In FIG. 30, light control films 461 and 462 and a diffuser 463 are arranged as in FIG. A light control film 471 having a shape obtained by rotating the light control 461 by 90 ° is disposed on the opposite side. That is, the light control film 471 is formed so that the concave side of the cylindrical portion is directed toward the user 120 and the cylindrical portion is aligned in the vertical direction.

  FIG. 31 is a diagram showing a configuration example of the screen 101 in the case of performing front projection, in which the light control films 461 and 462 and the diffuser 463 shown in FIG. Arranged so that the concave surface of the cylindrical portion is directed toward the user 120 side (rotating the screen 101 of FIG. 23 by 90 ° and reversing the front and back) Is done. Then, on the front surface (user 120 side), the light control film 471 is arranged so that the projecting surface of the cylindrical portion is on the user 120 side, and the cylindrical portion is aligned in the horizontal direction, as in FIG. ing.

  Next, a configuration example of the image processing unit 64 in FIG. 3 will be described. FIG. 32 is a block diagram illustrating a configuration example of the image processing unit 64. In the figure, a display unit 521 is a block for outputting image signals to be supplied to projectors 63-1 to 63-5, and the display unit 521 has a plurality of terminals (for supplying image signals to a plurality of projectors ( For example, five projectors) are provided, and projectors 63-1 to 63-5 are connected to the respective terminals.

  The imaging unit 522 is a block that acquires image signals supplied from the cameras 61-1 to 61-5, and is provided with a plurality of terminals (for example, five) for acquiring image signals of a plurality of cameras. The cameras 61-1 to 61-5 are connected to the respective terminals.

  In this example, the cameras 61-1 to 61-5 and the projectors 63-1 to 63-5 are arranged as described above in consideration of screen characteristics and front projection or rear projection. That is, when the front projection is performed on the screen as shown in FIG. 8 or FIG. 11, the cameras 61-1 through 61-5 and the projectors 63-1 through 63-5 are arranged in a positional relationship as shown in FIG. When rear projection is performed, the cameras 61-1 to 61-5 and the projectors 63-1 to 63-5 are arranged in a positional relationship as shown in FIG. 16 (in the case of using an elliptical mirror, the projector 63 The specific arrangement is as shown in FIG.

  When the front projection is performed on the screen as shown in FIG. 23, FIG. 28 or FIG. 29, the cameras 61-1 to 61-5 and the projectors 63-1 to 63-5 are in the positional relationship as shown in FIG. When arranged and rear-projected, the cameras 61-1 to 61-5 and the projectors 63-1 to 63-5 are arranged in a positional relationship as shown in FIG. 26 (when an elliptical mirror is used, the projector The specific arrangement of 63 is as shown in FIG.

  In addition, as an example of a screen for displaying a stereoscopic image, it has been described above with reference to FIG. 8, FIG. 11, FIG. 23, FIG. 28, or FIG. The screen is not limited, and when the user observes the light (image) projected from the projector, any screen that reflects the projected light so as to correspond to the horizontal parallax of the user can be used. It does not matter.

  The geometric correction database 523 is a database configured with, for example, a hard disk (HDD) and the like and stores data necessary for performing geometric correction described later.

  The storage 525 is a memory that temporarily stores image data supplied from the imaging unit 522, and the input / output unit 526 accepts input of data supplied from the outside or data generated by the image processing unit 64. Is output to an external recording medium or transmission medium (network, etc.). The control unit 524 controls each unit of the image processing unit 64 based on a preset program or a command input via the input / output unit 526 and executes various processes.

  The imaging unit 522 acquires a plurality of image signals supplied from the plurality of cameras 61-1 to 61-5, A / D converts each image signal, and performs geometric correction processing (see FIG. 3) as a plurality of image data. The geometric correction units 62-1 to 62-5 are processed and output to the storage 525. The control unit 524 compresses and encodes each image data stored in the storage 525 by a predetermined method, multiplexes a plurality of the compressed and encoded image data, and outputs the data to the input / output unit 526 as one data stream. Output. In addition, the control unit 524 separates the data stream input to the input / output unit 526 into a plurality of compressed and encoded image data, decodes the image data, and outputs the decoded image data to the display unit 521. The display unit 521 D / A changes each image data supplied from the control unit 524 and outputs each image signal to a terminal to which the projectors 63-1 to 63-5 corresponding to the image signal are connected.

  Next, with reference to FIG. 33, the imaging process by the image processing unit 64 will be described. This process is executed, for example, when a user inputs a command for imaging via the input / output unit 526.

  In step S1, the imaging unit 522 captures (captures) a subject. At this time, the image signals acquired from the cameras 61-1 to 61-5 are A / D converted and output to the storage 525 as five image data. Note that the images captured by the cameras 61-1 to 61-5 may be moving images or still images.

  In step S2, the storage 525 stores the five image data generated in step S1 in association with the cameras 61-1 to 61-5. In step S3, the control unit 524 compresses and encodes each image data stored in the storage 525 by using a method such as MPEG (Moving Picture Expert Group). As a result, five pieces of compressed encoded data associated with the cameras 61-1 to 61-5 are generated.

  In step S4, the control unit 524 multiplexes the five compressed encoded data generated in the process of step S3, generates one data stream, and outputs the data stream to the input / output unit 526. In step S5, the input / output unit 526 records the data stream generated in step S4 on a recording medium such as a DVD (Digital Versatile Disc). In step S5, the data stream may be transmitted to another device via a network or the like.

  In this way, images taken by a plurality of cameras are output as image data.

  Next, the geometric correction database construction process will be described with reference to FIG. This process is executed, for example, when a user inputs a command for instructing a database construction process via the input / output unit 526.

  Although the relationship between the positions of the camera 61 and the projector 63 has been described above, when an image is actually projected, the angle of view with respect to the subject when the camera 61 captures a three-dimensional subject, and the projector 63 displays the image on a two-dimensional screen. It is difficult to match the projection angle with respect to the screen when projecting the image, and when the image actually projected on the screen is observed, the image may appear distorted.

  Therefore, in the present invention, when projecting an image, geometric correction is performed so that the image projected from the projector 63 onto the screen can be observed without distortion corresponding to the angle of view when the camera 61 captures the subject. Process. In order to perform this geometric correction process, the geometric correction database 523 is required. The geometric correction database 523 is configured by storing the position of the pixel in the image signal input to the projector 63 and the position of the pixel of the image projected on the screen in association with each other.

  In step S21, the display unit 521 projects an image. At this time, an image is projected from the projector 63 onto a screen on which a large number of image sensors are regularly arranged. Each image sensor arranged on the screen is connected to the control unit 524, detects light at each point (pixel) in the image projected on the screen, and outputs a signal corresponding to the light. Thereby, the control unit 524 can detect the position on the screen where the pixel in the image signal input to the projector 63 is projected.

  In step S22, the control unit 524 detects the position of the pixel in the image projected on the screen corresponding to the pixel in the image signal input to the projector 63. For example, as shown in FIG. 35A, three pixels 541, 542, or 543 indicated by black dots, crosses, or squares in the image signal input to the projector 63 are projected on the screen. In this case, it is assumed that the projection is performed at a position as shown in FIG. 35B. At this time, the position of the pixel 541, 542, or 543 on the screen is detected.

  In step S <b> 23, the control unit 524 stores the pixel position on the screen detected in step S <b> 22 in the geometric correction database 523 in association with the pixel position in the image signal input to the projector 63. Thus, for example, as shown in FIG. 36, the pixel position (projector pixel position 551) in the image signal input to the projector 63 and the pixel position on the screen (screen pixel position 552) are stored. . In this example, the projector pixel position 551 is associated with three points ((0, 0), (0, 1), (0, 2)) expressed in a two-dimensional coordinate system, and is associated with the screen pixel position 552. In addition, three points ((600, 300), (600, 299), (600, 298)) expressed in a two-dimensional coordinate system are stored.

  Similarly, the projector pixel position 551 is associated with three points ((100, 20), (100, 21), (100, 22)), and the screen pixel position 552 has three points ((501, 291), (500, 290), (499, 289)) and stored as projector pixel positions 551 in correspondence with three points ((799, 597), (799, 598), (799, 599)). Thus, three points ((20, 4), (20, 3), (20, 2)) are stored at the screen pixel position 552.

  As described above, the projector pixel position 551 and the screen pixel position 552 are stored for all the pixels, and the same processing is performed for all of the plurality of projectors (for example, the projectors 63-1 to 63-5). Thus, the geometric correction database 523 is constructed. In this way, the image projected on the screen can be predicted based on the geometric correction database 523 before the image is actually projected, and a desired geometric correction (for example, Correction of image distortion, etc.).

  In this example, the projector pixel position 551 of the geometric correction database 523 has been described as storing a point represented in a two-dimensional coordinate system. However, the position of the camera that acquired the image projected on the projector is described. For example, a point represented by a three-dimensional coordinate system and information of the position of the camera may be added, and a point represented by a five-dimensional (2D + 3D) coordinate system may be stored in the projector pixel position 551. .

  Next, display processing by the image processing unit 64 will be described with reference to FIG. This process is executed, for example, when a user inputs a command to display via the input / output unit 526.

  In step S41, the control unit 524 reads the data stream of the image data input to the input / output unit 526. At this time, for example, five image data photographed by the cameras 61-1 to 61-5 are compression-encoded, and the data stream is read from a DVD on which the multiplexed data stream is recorded.

  In step S42, the control unit 524 separates the data stream read out in the process of step S41 into five compressed encoded data, and in step S43, the five compressed encoded data separated in the process of step S42. Decode and generate five image data.

  In step S44, the control unit 524 performs geometric correction on each image data. At this time, based on the geometric correction database 523 constructed by the process described above with reference to FIG. 34, for example, for each of the five pieces of image data, field angle correction, an elliptical mirror, a spherical mirror, Processing such as correction of distortion by position is performed, and image data is corrected.

  In step S45, the display unit 521 outputs the geometrically corrected image data 5 in step S44 to terminals to which projectors (projectors 63-1 to 63-5) corresponding to the respective image data are connected.

  In this way, a stereoscopic image is displayed.

  In this example, the image data captured in the imaging process of FIG. 23 is recorded on a DVD, and the image data to be displayed is read from the DVD in the display process of FIG. 37, but the image data captured in the imaging process of FIG. The image data may be read as it is as image data to be displayed in the display process of FIG. That is, the captured image may be displayed in real time.

  Further, in this example, the example in which both the imaging and the display are performed by one apparatus has been described, but the image display apparatus 60 in FIG. 32 (FIG. 3) may be configured separately for the imaging apparatus and the display apparatus. Good.

  It does not matter whether the above-described series of processing is realized by hardware or software. When the above-described series of processing is executed by software, a program constituting the software executes various functions by installing a computer incorporated in dedicated hardware or various programs. For example, a general-purpose personal computer as shown in FIG. 38 is installed from a network or a recording medium.

  In FIG. 38, a CPU (Central Processing Unit) 901 executes various processes according to a program stored in a ROM (Read Only Memory) 902 or a program loaded from a storage unit 908 to a RAM (Random Access Memory) 903. To do. The RAM 903 also appropriately stores data necessary for the CPU 901 to execute various processes.

  The CPU 901, ROM 902, and RAM 903 are connected to each other via a bus 904. An input / output interface 905 is also connected to the bus 904.

  The input / output interface 905 includes an input unit 906 including a keyboard and a mouse, a display (display unit) including a CRT (Cathode Ray Tube) and an LCD (Liquid Crystal display), an output unit 907 including a speaker, a hard disk, and the like A storage unit 908 composed of a communication unit 909 composed of a modem and a terminal adapter is connected. The communication unit 909 performs communication processing via a network such as the Internet.

  A drive 910 is also connected to the input / output interface 905 as required. For example, a removable medium 911 is mounted on the drive 910 as a recording medium on which the program of the present invention is recorded, and read from them. A computer program is installed in the storage unit 908 as necessary.

  Note that the steps of executing the series of processes described above in this specification are performed in parallel or individually even if they are not necessarily processed in time series, as well as processes performed in time series in the order described. The processing to be performed is also included.

It is a figure which shows the structural example of the television apparatus which displays the conventional three-dimensional image. It is a figure which shows the structural example of the image displayed on the television apparatus of FIG. It is a figure which shows the structural example of the imaging display apparatus to which this invention is applied. It is a figure showing the relationship between the position of a camera and a projector in the case of front projection. It is a figure which shows the specific example of arrangement | positioning of a camera. It is a figure which shows the specific example of arrangement | positioning of the projector in the case of front projection. It is a figure which shows one example of the shape of a screen. It is a figure which shows the structural example of the screen in the case of front projection. It is a figure which shows a mode that light injects into the screen of FIG. 8, and reflects. It is a figure which shows the relationship between a user's viewpoint and parallax. It is a figure which shows another structural example of a screen. It is a figure which shows the structural example of the screen in the case of rear projection. It is a figure which shows a mode that light injects into the screen of FIG. 12, and passes a screen. It is a figure which shows another structural example of the screen in the case of rear projection. FIG. 15 is a diagram illustrating a direction in which light projected on the screen of FIG. 12 or FIG. 14 travels. It is a figure which shows the relationship between the position of a camera and a projector in the case of rear-projecting on the screen of FIG. It is a figure which shows the example of the specific arrangement | positioning of the projector in the case of rear projection. It is a figure which shows the relationship between the user's viewpoint in the case of front projection, and the direction of a light ray, and the relationship between the user's viewpoint in the case of rear projection, and the direction of a light beam. It is a figure which shows the structural example of an elliptical mirror. It is a figure which shows the example of the specific arrangement | positioning of a projector in the case of performing back projection using an elliptical mirror. It is a figure which shows the structural example of the screen in the case of projecting an image with parallax in a horizontal direction and a vertical direction. It is a figure which shows another example of a structure of a screen in the case of projecting an image with parallax in a horizontal direction and a vertical direction. It is a figure which shows the structural example of the screen using a light control film. It is a figure which shows the relationship between the camera in the case of carrying out front projection on the screen of FIG. It is a figure which shows the direction which the light by which the rear projection was carried out on the screen of FIG. It is a figure which shows the relationship between the position of a camera and a projector in the case of rear-projecting on the screen of FIG. It is a figure which shows the example of the specific arrangement | positioning of a projector in the case of performing back projection using an elliptical mirror. It is a figure which shows another structural example of the screen using a light control film. It is a figure which shows another example of a structure of the screen using a light control film. It is a figure which shows the structural example of the screen using a light control film in the case of rear-projecting the image with a parallax in a horizontal direction and a vertical direction. It is a figure which shows the structural example of the screen using a light control film in the case of carrying out the front projection of the image which has parallax in a horizontal direction and a perpendicular direction. It is a figure which shows the structural example of an image process part. It is a flowchart explaining an imaging process. It is a flowchart explaining a geometric correction database construction process. It is a figure which shows the pixel position in the image signal input into a projector, and the position of the pixel in the image projected on the screen. It is a figure which shows the structural example of the data memorize | stored in a geometric correction database. It is a flowchart explaining an image display process. And FIG. 16 is a block diagram illustrating a configuration example of a personal computer.

Explanation of symbols

  60 image display device, 61-1 to 61-5 camera, 62-1 to 62-5 geometric correction unit, 63-1 to 63-5 projector, 64 image processing unit, 101 screen, 181 cylindrical lens array, 182 display board , 183 cylindrical lens array, 184 diffuser, 185 cylindrical lens array, 191 gradient index lens array, 193, 194 gradient index lens array, 342 elliptical mirror, 401, 402 spherical lens array, 421, 422 gradient index lens array, 461, 462 Light control film, 463 diffuser, 464 cylindrical lens, 521 display unit, 522 imaging unit, 523 geometric correction database, 524 control unit

Claims (10)

Images taken at a plurality of different positions are projected from a plurality of different positions corresponding to the positions at which the images were taken, and presents a stereoscopic image to the user,
A display board on which a projected image is formed;
A first planar optical element that is arranged at a predetermined distance away from the surface of the display plate that is viewed by the user and that forms an incident projected image light on the display plate. When,
A second planar optical element that is arranged at a predetermined distance away from the surface of the display plate that the user observes and emits light of an image formed on the display plate;
The image is projected from a plurality of different positions on the back of the screen;
When the center line of the projected image is superimposed on the display board, the image is projected from a plurality of positions having a line-symmetric relationship with respect to the image displayed on the display board. And the screen. The screen according to claim 1, wherein each of the first and second planar optical elements is a cylindrical lens array in which cylindrical lenses are arranged at equal intervals in the horizontal direction. 2. The screen according to claim 1, wherein the first and second planar optical elements are refractive index distribution lens arrays in which rectangular refractive index distribution lenses are arranged at equal intervals in the horizontal direction. . 2. The screen according to claim 1, wherein the first and second planar optical elements are spherical lens arrays in which spherical lenses are arranged at equal intervals in a horizontal direction and a vertical direction. The first and second planar optical elements are refractive index distribution lens arrays in which circular refractive index distribution lenses are arranged at equal intervals in the horizontal direction and the vertical direction. Listed screen A screen that projects images taken at a plurality of different positions and presents a stereoscopic image to the user,
A flat display board on which the projected image is formed;
Two light control films joined so as to sandwich the display board,
The display panel and the two light control films are formed by arranging cylindrical portions protruding in the direction observed by the user or in the opposite direction at equal intervals in the horizontal direction. A screen characterized in that it is arranged so as to have an angle dependency in the circumferential direction of the part. The screen according to claim 6, wherein a cylindrical lens is disposed on a concave surface side of the cylindrical portion of the display plate and the two light control films. The display panel and the two light control films are further formed with a cylindrical portion protruding in a direction opposite to a direction observed by the user so as to be a wave shape as a whole. Item 7. The screen according to Item 6. Cylindrical portions whose concave surfaces are directed to the user are repeatedly formed at equal intervals in the vertical direction, and another light control film having an angle dependency in the circumferential direction of the cylindrical portion is observed by the user. Is further arranged on the opposite side of the surface
The screen according to claim 6, wherein the image is projected from a direction opposite to a direction in which the user observes the screen. Another light control film formed such that the cylindrical surfaces are repeatedly arranged at equal intervals in the horizontal direction and the protruding surface of the cylindrical portion is on the observation surface side of the user is on the surface side observed by the user. Further arranged,
The display plate and the two light control films are arranged such that the cylindrical portions having concave surfaces directed to the user are repeatedly arranged at equal intervals in the vertical direction,
The screen according to claim 6, wherein the image is projected from a direction observed by the user.

Images