融合传统方法与前沿模型,实现高效实时的稠密位姿估计与重建。
HyVGGT-VO: Tightly Coupled Hybrid Dense Visual Odometry with Feed-Forward Models
- 动态切换光流与VGGT追踪头,兼顾鲁棒性与精度。
- 提升5倍处理速度,室内误差降低85%,室外误差降低12%。
- 适合需要实时稠密建图的机器人与AR应用。
稠密视觉里程计(VO)在机器人、增强现实等应用中至关重要,可提供位姿估计与稠密三维重建。近期前馈模型在稠密映射方面表现卓越,但其计算开销大,常仅能生成关键帧的稀疏位姿输出,难以实现实时估计。相比之下,传统稀疏方法虽计算高效、频率高,却无法实现稠密重建。为此,我们提出HyVGGT-VO,首次将经典VO框架与先进前馈模型VGGT紧密耦合。设计自适应混合追踪前端,动态切换传统光流与VGGT追踪头以保证鲁棒性;引入分层优化框架,联合优化VO位姿与VGGT预测尺度,确保全局尺度一致性。相比现有基于VGGT的方法,处理速度提升约5倍,在室内EuRoC数据集上平均轨迹误差减少85%,室外KITTI基准上减少12%。代码将在论文接受后公开。
原文摘要 · Abstract (English)
Dense visual odometry (VO), which provides pose estimation and dense 3D reconstruction, serves as the cornerstone for applications ranging from robotics to augmented reality. Recently, feed-forward models have demonstrated remarkable capabilities in dense mapping. However, when these models are used in dense visual SLAM systems, their heavy computational burden restricts them to yielding sparse pose outputs at keyframes while still failing to achieve real-time pose estimation. In contrast, traditional sparse methods provide high computational efficiency and high-frequency pose outputs, but lack the capability for dense reconstruction. To address these limitations, we propose HyVGGT-VO, a novel framework that combines the computational efficiency of sparse VO with the dense reconstruction capabilities of feed-forward models. To the best of our knowledge, this is the first work to tightly couple a traditional VO framework with VGGT, a state-of-the-art feed-forward model. Specifically, we design an adaptive hybrid tracking frontend that dynamically switches between traditional optical flow and the VGGT tracking head to ensure robustness. Furthermore, we introduce a hierarchical optimization framework that jointly refines VO poses and the scale of VGGT predictions to ensure global scale consistency. Our approach achieves an approximately 5x processing speedup compared to existing VGGT-based methods, while reducing the average trajectory error by 85% on the indoor EuRoC dataset and 12% on the outdoor KITTI benchmark. Our code will be publicly available upon acceptance. Project page: https://geneta2580.github.io/HyVGGT-VO.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。