Kuo et al., 2023 - Google Patents

Perspective-correct vr passthrough without reprojection

Kuo et al., 2023

View PDF @Full View
Document ID
16484998092016758497
Author
Kuo G
Penner E
Moczydlowski S
Ching A
Lanman D
Matsuda N
Publication year
Publication venue
ACM SIGGRAPH 2023 Conference Proceedings

External Links

Snippet

Virtual reality (VR) passthrough uses external cameras on the front of a headset to allow the user to see their environment. However, passthrough cameras cannot physically be co- located with the user's eyes, so the passthrough images have a different perspective than …
Continue reading at dl.acm.org (PDF) (other versions)

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/02—Picture signal generators
    • H04N13/0203—Picture signal generators using a stereoscopic image camera
    • H04N13/0207—Picture signal generators using a stereoscopic image camera involving a single 2D image pickup sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/02—Picture signal generators
    • H04N13/0203—Picture signal generators using a stereoscopic image camera
    • H04N13/0239—Picture signal generators using a stereoscopic image camera having two 2D image pickup sensors representing the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225—Television cameras; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232—Devices for controlling television cameras, e.g. remote control; Control of cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in, e.g. mobile phones, computers or vehicles
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00—Other optical systems; Other optical apparatus
    • G02B27/22—Other optical systems; Other optical apparatus for producing stereoscopic or other three dimensional effects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image, e.g. from bit-mapped to bit-mapped creating a different image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration, e.g. from bit-mapped to bit-mapped creating a similar image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/04—Picture reproducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/0003—Stereoscopic image signal coding, multiplexing, processing, recording or transmission
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/30—Transforming light or analogous information into electric information

Similar Documents

Publication Publication Date Title
Kuo et al. Perspective-correct vr passthrough without reprojection
Naemura et al. Real-time video-based modeling and rendering of 3D scenes
Jones et al. Achieving eye contact in a one-to-many 3D video teleconferencing system
Georgiev et al. Focused plenoptic camera and rendering
Song et al. Light f ield head-mounted display with correct focus cue using micro structure array
CN104463949B (en) A kind of quick three-dimensional reconstructing method and its system based on light field numeral refocusing
US8290358B1 (en) Methods and apparatus for light-field imaging
CN102959945B (en) The method and system of virtual output image is produced according to the data obtained by the array of image-capturing apparatus
US10397545B2 (en) 3-D light field camera and photography method
Jones et al. Interpolating vertical parallax for an autostereoscopic three-dimensional projector array
US10255664B2 (en) Image processing device and method
JP5522794B2 (en) Stereoscopic image generating apparatus and program thereof
Kagawa et al. A three‐dimensional multifunctional compound‐eye endoscopic system with extended depth of field
Thatte et al. Depth augmented stereo panorama for cinematic virtual reality with focus cues
Mukati et al. Light field super resolution through controlled micro-shifts of light field sensor
US20240251176A1 (en) Perspective-correct passthrough architectures for head-mounted displays
Do et al. Immersive visual communication
Kuo et al. Reprojection-free vr passthrough
TWI572899B (en) Augmented reality imaging method and system
Katayama et al. A method for converting three-dimensional models into auto-stereoscopic images based on integral photography
Hirsch et al. 8d: interacting with a relightable glasses-free 3d display
Wu et al. Epipolar geometry of catadioptric stereo systems with planar mirrors
Zhang et al. Integration of real-time 3D capture, reconstruction, and light-field display
KR20090012982A (en) Recording medium recording method for generating depth information, apparatus therefor and a program for executing the method
Kim et al. Dual-dimensional microscopy: real-time in vivo three-dimensional observation method using high-resolution light-field microscopy and light-field display