融合动作捕捉与SLAM,实现多人虚拟空间低延迟同步。
Co-Located VR with Hybrid SLAM-based HMD Tracking and Motion Capture Synchronization
- 结合外部动作捕捉与头显SLAM,动态校准跟踪精度。
- 实测达到自然交互所需空间精度,支持多用户实时姿态同步。
- 适合需要高沉浸感的多人协作或训练场景。
我们提出一种多人共址虚拟现实框架,将用户同步至与物理空间对齐的共享虚拟环境。该方法融合动作捕捉系统与基于SLAM的头显内建追踪,实现高帧率、低延迟的流畅性能。以往方案或依赖持续外部追踪(引入延迟和抖动),或仅依赖一次性校准(无法修正随时间累积的漂移)。相比之下,本方案结合本地HMD SLAM的响应速度与外部源的可重对齐性,支持设备间实时姿态共享,确保用户间空间一致性与参与感。评估表明,该框架在满足自然多用户交互所需的空间精度的同时,较现有共址VR方案提升了舒适性、可扩展性与鲁棒性。
原文摘要 · Abstract (English)
We introduce a multi-user VR co-location framework that synchronizes users within a shared virtual environment aligned to physical space. Our approach combines a motion capture system with SLAM-based inside-out tracking to deliver smooth, high-framerate, low-latency performance. Previous methods either rely on continuous external tracking, which introduces latency and jitter, or on one-time calibration, which cannot correct drift over time. In contrast, our approach combines the responsiveness of local HMD SLAM tracking with the flexibility to realign to an external source when needed. It also supports real-time pose sharing across devices, ensuring consistent spatial alignment and engagement between users. Our evaluation demonstrates that our framework achieves the spatial accuracy required for natural multi-user interaction while offering improved comfort, scalability, and robustness over existing co-located VR solutions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。