SmoothMV: Seamless Content Adaptation through Head Tracking Analysis and View Prediction

• Type: Article in International Conference Proceedings Book
• Date: 2021-07-16

Authors

Maria Teresa Andrade (Author) FEUP; Tiago Soares da Costa (Author) Other; Paula Viana (Author) Other

Conference proceedings International

Title: PROCEEDINGS OF THE 2021 INTERNATIONAL WORKSHOP ON IMMERSIVE MIXED AND VIRTUAL ENVIRONMENT SYSTEMS (MMVE '21)

Pages: 8-13

13th ACM International Workshop on Immersive Mixed and Virtual Environment Systems (MMVE) Part of ACM Multimedia Systems Conference (MMSys)

Istanbul, TURKEY, SEP 28-OCT 01, 2021

Indexing

ISI Web of Knowledge - 0 Citations

Other information

Authenticus ID: P-00V-3T4

DOI: 10.1145/3458307.3463814

Abstract (EN): Multi-view has the potential to offer immersive viewing experiences to users, as an alternative to 360 degrees and Virtual Reality (VR) applications. In multi-view, a limited number of camera views are sent to the client and missing views are synthesised locally. Given the substantial complexity associated to view synthesis, considerable attention has been given to optimise the trade-off between bandwidth gains and computing resources, targeting smooth navigation and viewing quality. A still relatively unexplored field is the optimisation of the way navigation interactivity is achieved, i.e. how the user indicates to the system the selection of new viewpoints. In this article, we introduce SmoothMV, a multi-view system that uses a non-intrusive head tracking approach to enhance navigation and Quality of Experience (QoE) of the viewer. It relies on a novel Hot&Cold matrix concept to translate head positioning data into viewing angle selections. Streaming of selected views is done using MPEG-DASH, where a proposed extension to the standard descriptors enables to achieve consistent and flexible view identification.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 6