预测用户头部动作提前调整机器视角,降低远程协作延迟与带宽消耗。
User Head Movement-Predictive XR in Immersive H2M Collaborations over Future Enterprise Networks
- 用双向LSTM预测用户头部运动,提前调整机器摄像头方向。
- 动态分配带宽,使延迟和抖动达标的同时降低30%以上带宽使用。
- 适合工业4.0/5.0、远程协作等高实时性XR场景的部署应用。
未来移动系统与固定无线网络的发展,主要源于对跨垂直领域高带宽、低延迟服务的迫切需求。智能手机、工业物联网、扩展现实(XR)及人机(H2M)协同技术推动了工业4.0/5.0与社会5.0的变革。为在远程协作中实现理想沉浸体验并避免虚拟现实晕眩,需在大范围地理跨度下实时同步远程机器的XR内容与用户头部运动。为此,本文提出一种新型H2M协作方案:利用双向长短期记忆网络(Bi-LSTM)高精度预测用户头部运动,提前调整机器摄像头朝向。实验表明,XR帧大小随头部运动变化,据此可预测对应的带宽需求,进而提出人机协同动态带宽分配(HMC-DBA)方案。大量仿真显示,在如“光纤到房间企业网”(Fiber-To-The-Room-Business)等企业网络上,该方案以更低带宽消耗满足了端到端延迟与抖动要求,且相比现有方案提升了网络资源利用效率。
原文摘要 · Abstract (English)
The evolution towards future generation of mobile systems and fixed wireless networks is primarily driven by the urgency to support high-bandwidth and low-latency services across various vertical sectors. This endeavor is fueled by smartphones as well as technologies like industrial internet of things, extended reality (XR), and human-to-machine (H2M) collaborations for fostering industrial and social revolutions like Industry 4.0/5.0 and Society 5.0. To ensure an ideal immersive experience and avoid cyber-sickness for users in all the aforementioned usage scenarios, it is typically challenging to synchronize XR content from a remote machine to a human collaborator according to their head movements across a large geographic span in real-time over communication networks. Thus, we propose a novel H2M collaboration scheme where the human's head movements are predicted ahead with highly accurate models like bidirectional long short-term memory networks to orient the machine's camera in advance. We validate that XR frame size varies in accordance with the human's head movements and predict the corresponding bandwidth requirements from the machine's camera to propose a human-machine coordinated dynamic bandwidth allocation (HMC-DBA) scheme. Through extensive simulations, we show that end-to-end latency and jitter requirements of XR frames are satisfied with much lower bandwidth consumption over enterprise networks like Fiber-To-The-Room-Business. Furthermore, we show that better efficiency in network resource utilization is achieved by employing our proposed HMC-DBA over state-of-the-art schemes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。