提出首个可处理形变场景的视觉惯性里程计,解决传统方法在非刚性环境中的漂移问题。
DefVINS: Visual-Inertial Odometry for Deformable Scenes
- 将状态分解为刚性部分与嵌入形变图的非刚性场景变形
- 在合成与真实数据集上均显著降低相机位姿漂移
- 适用于机器人、AR/VR等存在形变环境的定位任务
形变场景违背了经典视觉-惯性里程计(VIO)的刚性假设,常导致对局部非刚性运动过拟合,或在形变主导时出现严重相机位姿漂移。本文提出DefVINS,首个专为形变环境设计的视觉-惯性里程计系统。其通过将状态分解为基于惯性测量单元(IMU)锚定的刚性部分和由嵌入形变图表示的非刚性场景形变来建模。作为第二项贡献,我们构建了首个包含真实图像与真值相机位姿的形变场景视觉-惯性里程计基准VIMandala。同时,我们在合成的Drunkard's基准上添加模拟惯性数据以在受控条件下评估系统。此外,我们提供了形变视觉-惯性里程计问题的可观测性分析,揭示惯性测量如何约束相机运动并使原本不可观测的模式在形变下变得可识别。该分析推动了基于条件的激活策略设计,避免在激励不足时产生病态更新。在合成Drunkard's和真实VIMandala基准上的实验表明,DefVINS优于刚性视觉-惯性与非刚性视觉里程计基线。源代码与数据将在论文接收后发布。
原文摘要 · Abstract (English)
Deformable scenes violate the rigidity assumptions underpinning classical visual--inertial odometry (VIO), often leading to over-fitting to local non-rigid motion or to severe camera pose drift when deformation dominates visual parallax. In this paper, we introduce DefVINS, the first visual-inertial odometry pipeline designed to operate in deformable environments. Our approach models the odometry state by decomposing it into a rigid, IMU-anchored component and a non-rigid scene warp represented by an embedded deformation graph. As a second contribution, we present VIMandala, the first benchmark containing real images and ground-truth camera poses for visual-inertial odometry in deformable scenes. In addition, we augment the synthetic Drunkard's benchmark with simulated inertial measurements to further evaluate our pipeline under controlled conditions. We also provide an observability analysis of the visual-inertial deformable odometry problem, characterizing how inertial measurements constrain camera motion and render otherwise unobservable modes identifiable in the presence of deformation. This analysis motivates the use of IMU anchoring and leads to a conditioning-based activation strategy that avoids ill-posed updates under poor excitation. Experimental results on both the synthetic Drunkard's and our real VIMandala benchmarks show that DefVINS outperforms rigid visual--inertial and non-rigid visual odometry baselines. Our source code and data will be released upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。