提出新型延迟指标与框架,同时优化头身运动延迟,缓解虚拟现实晕动症。
BOXR: Body and head motion Optimization framework for eXtended Reality
- 引入C2D延迟指标,协同优化头身运动延迟。
- 在多场景下降低头身延迟最高达63%和27%,帧率提升43%。
- 适合开发高性能XR系统,尤其关注沉浸感与舒适度的团队。
独立式扩展现实(XR)系统提升了用户移动性,能处理频繁的头部动作和较少但剧烈的身体动作。然而,普遍采用的M2D延迟指标仅衡量头部动作延迟,忽略了身体运动带来的影响,可能导致用户晕动。现有方法虽通过异步调度和重投影优化M2D,但引发任务资源争用和姿态数据过时问题,且受用户运动动态与场景变化干扰。为此,我们首次提出C2D延迟指标,以捕捉身体动作引起的延迟,并设计BOXR框架,协同优化头身运动延迟。BOXR通过高效任务调度避免资源冲突,保持输出帧姿态实时更新;引入基于运动的视觉惯性里程计适应用户动态,采用依赖场景的中心聚焦渲染应对场景变化。评估显示,在11个EuRoC MAV数据集上,4种XR应用、3种硬件平台中,BOXR显著优于现有方案。在控制环境下,M2D与C2D延迟分别降低最多63%和27%,帧率提升43%;实际部署中,M2D与C2D延迟减少最高达42%和31%,且满足要求的丢失率极低,分别为1.6%和1.0%。
原文摘要 · Abstract (English)
The emergence of standalone XR systems has enhanced user mobility, accommodating both subtle, frequent head motions and substantial, less frequent body motions. However, the pervasively used M2D latency metric, which measures the delay between the most recent motion and its corresponding display update, only accounts for head motions. This oversight can leave users prone to motion sickness if significant body motion is involved. Although existing methods optimize M2D latency through asynchronous task scheduling and reprojection methods, they introduce challenges like resource contention between tasks and outdated pose data. These challenges are further complicated by user motion dynamics and scene changes during runtime. To address these issues, we for the first time introduce the C2D latency metric, which captures the delay caused by body motions, and present BOXR, a framework designed to co-optimize both body and head motion delays within an XR system. BOXR enhances the coordination between M2D and C2D latencies by efficiently scheduling tasks to avoid contentions while maintaining an up-to-date pose in the output frame. Moreover, BOXR incorporates a motion-driven visual inertial odometer to adjust to user motion dynamics and employs scene-dependent foveated rendering to manage changes in the scene effectively. Our evaluations show that BOXR significantly outperforms state-of-the-art solutions in 11 EuRoC MAV datasets across 4 XR applications across 3 hardware platforms. In controlled motion and scene settings, BOXR reduces M2D and C2D latencies by up to 63% and 27%, respectively and increases frame rate by up to 43%. In practical deployments, BOXR achieves substantial reductions in real-world scenarios up to 42% in M2D latency and 31% in C2D latency while maintaining remarkably low miss rates of only 1.6% for M2D requirements and 1.0% for C2D requirements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。