Capturing Imagery, Video, 3D Objects and 3D Scenes

[AdamSobieski]

Introduction

I would like to propose for WebXR means for users to capture and to upload captured imagery, video, 3D objects, and 3D scenes.

Imagery

With XR devices, users could photograph content from their real or XR environments. Users could also select 2D/3D regions of interest with their hands or input devices.

It is possible for users to take pictures which contain only foregrounded content by utilizing multiple sensors, hand or device tracking, and, potentially, eye tracking.

Video

With XR devices, users could record content from their real or XR environments. Users could also select 2D/3D regions of interest using their hands or input devices.

It is possible to record videos which contain only foregrounded content by utilizing multiple sensors, hand or device tracking, and, potentially, eye tracking.

3D Objects

This scenario involves uses of computer vision algorithms to capture 3D objects from users’ real environments using XR device sensors and, potentially, third-party services. This challenge is known as “3D reconstruction” or “3D object reconstruction”.

3D Scenes

This scenario involves uses of computer vision algorithms to capture 3D scenes from users’ real environments using sensors and, potentially, third-party services. This challenge is known as “3D reconstruction” or “3D scene reconstruction”.

Interactivity

Multimodal dialogue systems could interact with users to ensure that imagery, video, 3D objects, or 3D scenes are thoroughly, properly, and accurately captured or scanned.