融合事件相机与帧图像,实现高速运动物体的6自由度实时追踪。
6-DoF Object Tracking with Event-based Optical Flow and Frames
- 用事件相机计算光流,捕捉高速运动中的物体速度
- 结合低频帧图像全局姿态估计,提升高动态场景追踪精度
- 适合高速机器人操作、自动驾驶等需要精准运动感知的场景
在机器人环境交互中,实时追踪物体在空间中的位置与姿态(即6-DoF)是一个基础问题。当物体高速运动时,传统摄像头受限于帧率和运动模糊,追踪难度加大。事件相机具有高时间分辨率、低延迟和高动态范围,能有效缓解运动模糊。而传统RGB摄像头则提供丰富的视觉信息,更适用于单次姿态估计。本文提出将事件相机生成的光流与基于RGB的全局姿态估计算法结合,实现对高速运动物体的6-DoF姿态追踪。具体而言,设计了一种基于事件的光流算法用于测量物体运动速度,构建6-DoF速度追踪器,并将该速度与来自低频全局姿态估计器的位姿信息融合,从而在高速运动下实现稳定追踪。所提方法在合成数据与真实世界数据上均进行了测试与验证,结果表明其在高速运动场景下具有显著有效性。
原文摘要 · Abstract (English)
Tracking the position and orientation of objects in space (i.e., in 6-DoF) in real time is a fundamental problem in robotics for environment interaction. It becomes more challenging when objects move at high-speed due to frame rate limitations in conventional cameras and motion blur. Event cameras are characterized by high temporal resolution, low latency and high dynamic range, that can potentially overcome the impacts of motion blur. Traditional RGB cameras provide rich visual information that is more suitable for the challenging task of single-shot object pose estimation. In this work, we propose using event-based optical flow combined with an RGB based global object pose estimator for 6-DoF pose tracking of objects at high-speed, exploiting the core advantages of both types of vision sensors. Specifically, we propose an event-based optical flow algorithm for object motion measurement to implement an object 6-DoF velocity tracker. By integrating the tracked object 6-DoF velocity with low frequency estimated pose from the global pose estimator, the method can track pose when objects move at high-speed. The proposed algorithm is tested and validated on both synthetic and real world data, demonstrating its effectiveness, especially in high-speed motion scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。