提出快速高精度的视觉惯性定位方法,适合虚拟现实应用。
XR-VIO: High-precision Visual Inertial Odometry with Fast Initialization for XR Applications
- 通过紧耦合陀螺仪数据提升视觉初始化稳定性。
- 仅需4帧图像即可稳定运行,精度达当前最优水平。
- 适合移动端AR/VR场景,实时性与鲁棒性兼备。
本文提出一种新型视觉惯性里程计(VIO)方法,聚焦于初始化与特征匹配模块。现有初始化方法常因视觉运动恢复结构(SfM)不稳定或同时求解大量参数而脆弱。为此,我们设计了一种新初始化流程,通过紧耦合陀螺仪测量增强视觉SfM的鲁棒性与精度,在仅四帧图像下仍表现稳定,结果具有竞争力。在特征匹配方面,引入光学流与基于描述符匹配的混合方法,结合连续光流跟踪的鲁棒性与描述符匹配的高精度,实现高效、准确且鲁棒的追踪。在多个基准测试中,本方法在精度与成功率上达到业界领先水平。此外,移动端视频演示验证了其在增强现实/虚拟现实(AR/VR)领域的实际应用价值。
原文摘要 · Abstract (English)
This paper presents a novel approach to Visual Inertial Odometry (VIO), focusing on the initialization and feature matching modules. Existing methods for initialization often suffer from either poor stability in visual Structure from Motion (SfM) or fragility in solving a huge number of parameters simultaneously. To address these challenges, we propose a new pipeline for visual inertial initialization that robustly handles various complex scenarios. By tightly coupling gyroscope measurements, we enhance the robustness and accuracy of visual SfM. Our method demonstrates stable performance even with only four image frames, yielding competitive results. In terms of feature matching, we introduce a hybrid method that combines optical flow and descriptor-based matching. By leveraging the robustness of continuous optical flow tracking and the accuracy of descriptor matching, our approach achieves efficient, accurate, and robust tracking results. Through evaluation on multiple benchmarks, our method demonstrates state-of-the-art performance in terms of accuracy and success rate. Additionally, a video demonstration on mobile devices showcases the practical applicability of our approach in the field of Augmented Reality/Virtual Reality (AR/VR).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。