Pagés et al., 2020 - Google Patents

Forge: A volumetric video processing platform for everyone

Pagés et al., 2020

View PDF
Document ID
17916696566782323749
Author
Pagés R
Ondfej J
Amplianitis K
Publication year
Publication venue
NEM SUMMIT. Dublin

External Links

Snippet

We present Forge, a volumetric video processing platform running on the cloud that works with different camera configurations and adapts to the user needs. From high-end studios with dozens of synchronised cameras to scenes casually captured with smartphones, Forge …
Continue reading at nem-initiative.org (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/02—Picture signal generators
    • H04N13/0203—Picture signal generators using a stereoscopic image camera
    • H04N13/0207—Picture signal generators using a stereoscopic image camera involving a single 2D image pickup sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/02—Picture signal generators
    • H04N13/0203—Picture signal generators using a stereoscopic image camera
    • H04N13/0239—Picture signal generators using a stereoscopic image camera having two 2D image pickup sensors representing the interocular distance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/02—Picture signal generators
    • H04N13/026—Picture signal generators with monoscopic to stereoscopic image conversion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225—Television cameras; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effect; Cameras specially adapted for the electronic generation of special effects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of content streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of content streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/0003—Stereoscopic image signal coding, multiplexing, processing, recording or transmission
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals

Similar Documents

Publication Publication Date Title
US10621777B2 (en) Synthesis of composite images having virtual backgrounds
US10650590B1 (en) Method and system for fully immersive virtual reality
Matsuyama et al. 3D video and its applications
CN213461894U (en) XR-augmented reality system
CN114998514B (en) Method and device for generating virtual characters
KR20230071588A (en) Multi person augmented reality content providing device and method for diorama application
CN213126145U (en) AR-virtual interactive system
CN107240147A (en) Image rendering method and system
CN107862718A (en) 4D holographic video method for catching
Schreer et al. Advanced volumetric capture and processing
Bleyer et al. Temporally consistent disparity maps from uncalibrated stereo videos
Wang et al. Interactive free-viewpoint video generation
CN103020849A (en) Method and system of moving scene display network sale
Kurillo et al. A framework for collaborative real-time 3D teleimmersion in a geographically distributed environment
Zhu et al. Dynamic 6-dof volumetric video generation: Software toolkit and dataset
Pagés et al. Forge: A volumetric video processing platform for everyone
Zhu et al. A shared augmented virtual environment for real‐time mixed reality applications
Zhou et al. Rgbd-based real-time volumetric reconstruction system: Architecture design and implementation
Liu et al. Place anything into any video
WO2023157005A1 (en) An augmented reality interface for watching live sport games
Lee et al. Real-time 3D video avatar in mixed reality: An implementation for immersive telecommunication
Scheer et al. A client-server architecture for real-time view-dependent streaming of free-viewpoint video
CN113079340A (en) Three-dimensional holographic video conference system based on Hololens2
Eisert et al. Introduction to the special section on augmented video
Wang et al. Binocular photometric stereo acquisition and reconstruction for 3d talking head applications.