Gao et al., 2018 - Google Patents

Real-time visual representations for mobile mixed reality remote collaboration

Gao et al., 2018

View PDF
Document ID
18368390915883545904
Author
Gao L
Bai H
He W
Billinghurst M
Lindeman R
Publication year
Publication venue
SIGGRAPH Asia 2018 Virtual & Augmented Reality

External Links

Snippet

In this study we present a Mixed-Reality based mobile remote collaboration system that enables an expert providing real-time assistance over a physical distance. By using the Google ARCore position tracking, we can integrate the keyframes captured with one …
Continue reading at dl.acm.org (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with three-dimensional environments, e.g. control of viewpoint to navigate in the environment
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225—Television cameras; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232—Devices for controlling television cameras, e.g. remote control; Control of cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in, e.g. mobile phones, computers or vehicles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/02—Picture signal generators
    • H04N13/0203—Picture signal generators using a stereoscopic image camera
    • H04N13/0239—Picture signal generators using a stereoscopic image camera having two 2D image pickup sensors representing the interocular distance

Similar Documents

Publication Publication Date Title
Gao et al. Real-time visual representations for mobile mixed reality remote collaboration
Piumsomboon et al. CoVAR: a collaborative virtual and augmented reality system for remote collaboration
Piumsomboon et al. Exploring enhancements for remote mixed reality collaboration
JP6515813B2 (en) INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM
Gao et al. An oriented point-cloud view for MR remote collaboration
Lee et al. Mixed reality collaboration through sharing a live panorama
KR101171660B1 (en) Pointing device of augmented reality
Gao et al. Static local environment capturing and sharing for MR remote collaboration
Mohr et al. Mixed reality light fields for interactive remote assistance
Wei et al. Multi-view merging for robot teleoperation with virtual reality
Piumsomboon et al. [poster] covar: Mixed-platform remote collaborative augmented and virtual realities system with shared collaboration cues
US20130063560A1 (en) Combined stereo camera and stereo display interaction
CN103440677A (en) Multi-view free stereoscopic interactive system based on Kinect somatosensory device
Huang et al. Virtualnexus: Enhancing 360-degree video ar/vr collaboration with environment cutouts and virtual replicas
CN105867626A (en) Head-mounted virtual reality equipment, control method thereof and virtual reality system
CN103257707B (en) Utilize the three-dimensional range method of Visual Trace Technology and conventional mice opertaing device
Lee et al. Sharedsphere: MR collaboration through shared live panorama
Cao et al. Mobiletutar: A lightweight augmented reality tutorial system using spatially situated human segmentation videos
Venerella et al. Integrating AR and VR for mobile remote collaboration
CN204406327U (en) Based on the limb rehabilitating analog simulation training system of said three-dimensional body sense video camera
Yee et al. Augmented reality in-situ 3D sketching of physical objects
Bellarbi et al. A 3d interaction technique for selection and manipulation distant objects in augmented reality
Cai et al. Gesture-based mobile communication system providing side-by-side shopping feeling
Duan et al. Remote environment exploration with drone agent and haptic force feedback
CN117435055A (en) Gesture-enhanced eye tracking human-computer interaction method based on spatial stereoscopic display