arXiv:2411.03928cs.RO2024-11ICCV被引 16

用深度学习融合事件相机与惯性数据,提升复杂场景下的定位精度。

DEIO: Deep Event Inertial Odometry

  • 设计递归网络提取事件块的时间关联,解决稀疏事件数据匹配难题。
  • 在10个公开基准上超越20种先进方法,实现更优的位姿估计性能。
  • 适合需要高动态范围和快速运动下稳定定位的机器人应用。

事件相机在处理快速运动和高动态范围等挑战性场景方面具有巨大潜力。然而,事件数据的稀疏性和运动依赖性仍限制了基于特征或直接的数据关联方法的实际表现。为此,本文提出首个单目学习型事件-惯性里程计框架DEIO,将学习方法与传统非线性图优化相结合。具体而言,采用基于事件的循环网络提供事件块在时间上的精确且稀疏的关联;DEIO进一步融合惯性测量单元(IMU)数据,恢复尺度化位姿并实现鲁棒的状态估计。利用学习得到的可微分束调整(DBA)的海森矩阵,优化关键帧滑动窗口内的共可见因子图,紧密集成事件块对应关系与IMU预积分。全面验证表明,DEIO在10个具有挑战性的公开基准上优于超过20种先进方法。

原文摘要 · Abstract (English)

Event cameras show great potential for visual odometry (VO) in handling challenging situations, such as fast motion and high dynamic range. Despite this promise, the sparse and motion-dependent characteristics of event data continue to limit the performance of feature-based or direct-based data association methods in practical applications. To address these limitations, we propose Deep Event Inertial Odometry (DEIO), the first monocular learning-based event-inertial framework, which combines a learning-based method with traditional nonlinear graph-based optimization. Specifically, an event-based recurrent network is adopted to provide accurate and sparse associations of event patches over time. DEIO further integrates it with the IMU to recover up-to-scale pose and provide robust state estimation. The Hessian information derived from the learned differentiable bundle adjustment (DBA) is utilized to optimize the co-visibility factor graph, which tightly incorporates event patch correspondences and IMU pre-integration within a keyframe-based sliding window. Comprehensive validations demonstrate that DEIO achieves superior performance on \textit{10} challenging public benchmarks compared with more than 20 state-of-the-art methods.

事件相机惯性里程计深度学习位姿估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。