用事件相机同时估计绝对位姿和速度,突破现有方法局限
A Geometric Framework for Absolute Pose and Velocity Estimation with Event Cameras

- 基于3D线与事件平面的正交性及投影共线性构建几何约束
- 仅需3组事件-线对应即可解出6自由度位姿与速度,精度领先
- 适用于机器人导航、增强现实等需要精确运动感知的场景
尽管事件相机在运动估计方面进展迅速,但现有几何方法主要集中于速度估计。然而,绝对位姿估计对机器人导航、增强现实等关键应用同样重要,却仍鲜有研究。因此,从事件流中联合恢复绝对位姿与速度仍是开放且具有挑战性的问题。为此,本文提出一种基于场景中3D线及其触发事件的几何框架。核心包含两个几何约束:3D线与其对应事件平面的法向量正交,以及事件点与该线2D投影共线。基于此,我们设计了线性与多项式求解器用于绝对位姿估计,前者高效,后者提供全局最优旋转解;针对速度估计,开发了高效线性求解器与更精确的优化求解器,可同时恢复角速度与线速度。值得注意的是,本方法仅需最少三组事件-线对应即可独立求解6自由度绝对位姿或速度。大量仿真与真实数据集实验表明,所提方法在准确性和计算效率上均达到当前最优水平。演示代码已公开于 https://github.com/Zibin6/EventPoseVelocity。
原文摘要 · Abstract (English)
Despite the rapid advancements in event-based motion estimation, current geometric methods primarily focus on velocity estimation. However, absolute pose estimation, which is equally crucial for key applications such as robotic navigation and augmented reality, remains relatively underexplored. Consequently, the simultaneous recovery of absolute pose and velocity from event streams remains an open and challenging problem. To address this gap, we propose a geometric framework for absolute pose and velocity estimation by leveraging 3D lines in the scene and the events they trigger. At the core of the framework lie two key geometric constraints: the orthogonality between a 3D line and the normal vector of its corresponding event plane, and the collinearity of an event with the 2D projection of its associated line. Based on these constraints, we present both linear and polynomial solvers for absolute pose estimation. The former enables efficient computation, while the latter provides a globally optimal solution for rotation. For velocity estimation, we develop an efficient linear solver and a more accurate optimization-based solver to recover both angular and linear velocities. Notably, our methods require a minimum of three event-line correspondences to determine the 6-DoF absolute pose or velocities independently. Extensive experiments in simulation and on real-world datasets demonstrate that our methods achieve state-of-the-art performance, with significant improvements in accuracy and computational efficiency compared to existing methods. The demo code is publicly available at https://github.com/Zibin6/EventPoseVelocity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。