综述扩展现实流媒体技术,涵盖传输、体验优化与未来挑战
Immersive Multimedia Communication: State-of-the-Art on eXtended Reality Streaming
- 梳理XR流媒体多模态交互与传输特性
- 提出基于视觉注意力的流媒体优化方法
- 适合研究沉浸式通信与多媒体系统者阅读
扩展现实(XR)正迅速发展,有望彻底改变内容创作与消费方式。在XR中,用户通过整合多种感官输入来形成对虚拟环境的统一感知。本文综述了XR流媒体领域的最新进展,涵盖多种范式。首先定义了XR并介绍各类XR头显及其多模态交互方式,提供基础理解。随后分析了XR流量特征,凸显其独特的数据传输需求。探讨影响XR系统用户体验的关键因素,旨在识别提升用户满意度的核心要素。接着,介绍基于视觉注意力的XR流媒体优化方法,以提高效率与性能。最后,审视当前应用场景,指出现存挑战,为XR的未来发展提供洞见。
原文摘要 · Abstract (English)
Extended reality (XR) is rapidly advancing, and poised to revolutionize content creation and consumption. In XR, users integrate various sensory inputs to form a cohesive perception of the virtual environment. This survey reviews the state-of-the-art in XR streaming, focusing on multiple paradigms. To begin, we define XR and introduce various XR headsets along with their multimodal interaction methods to provide a foundational understanding. We then analyze XR traffic characteristics to highlight the unique data transmission requirements. We also explore factors that influence the quality of experience in XR systems, aiming to identify key elements for enhancing user satisfaction. Following this, we present visual attention-based optimization methods for XR streaming to improve efficiency and performance. Finally, we examine current applications and highlight challenges to provide insights into ongoing and future developments of XR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。