arXiv:2512.21053cs.CV2025-12被引 17

用事件相机+光流引导,实现高精度6自由度物体姿态追踪

Optical Flow-Guided 6DoF Object Pose Tracking with an Event Camera

  • 结合事件数据与3D模型,分步提取角点和边缘特征
  • 通过最大化事件概率寻找光流,建立角点与边缘关联
  • 迭代优化姿态,实测在模拟与真实场景中均更精准鲁棒

物体姿态追踪是多媒体领域关键技术,近年来备受关注。传统相机方法面临运动模糊、传感器噪声、部分遮挡及光照变化等挑战。新兴的仿生事件相机具备高动态范围和低延迟优势,有望解决上述问题。本文提出一种基于光流引导的事件相机6自由度物体姿态追踪方法。首先采用2D-3D混合特征提取策略,从事件数据和物体模型中检测角点与边缘,精确刻画物体运动。随后,在时空窗口内通过最大化事件相关概率搜索角点光流,并利用光流引导角点与边缘的关联。最后,通过最小化角点与边缘间距离,迭代优化6DoF物体姿态,实现连续追踪。仿真与真实事件数据实验结果表明,本方法在精度与鲁棒性上均优于现有事件相机状态领先方法。

原文摘要 · Abstract (English)

Object pose tracking is one of the pivotal technologies in multimedia, attracting ever-growing attention in recent years. Existing methods employing traditional cameras encounter numerous challenges such as motion blur, sensor noise, partial occlusion, and changing lighting conditions. The emerging bio-inspired sensors, particularly event cameras, possess advantages such as high dynamic range and low latency, which hold the potential to address the aforementioned challenges. In this work, we present an optical flow-guided 6DoF object pose tracking method with an event camera. A 2D-3D hybrid feature extraction strategy is firstly utilized to detect corners and edges from events and object models, which characterizes object motion precisely. Then, we search for the optical flow of corners by maximizing the event-associated probability within a spatio-temporal window, and establish the correlation between corners and edges guided by optical flow. Furthermore, by minimizing the distances between corners and edges, the 6DoF object pose is iteratively optimized to achieve continuous pose tracking. Experimental results of both simulated and real events demonstrate that our methods outperform event-based state-of-the-art methods in terms of both accuracy and robustness.

姿态追踪事件相机光流6DoF

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。