arXiv:2510.20794cs.CVeess.SP2025-10中稿 · IEEE Transactions …被引 7

融合雷达与相机数据,实现自动标定的多目标跟踪。

Radar-Camera Fused Multi-Object Tracking: Online Calibration and Common Feature

  • 利用雷达与相机的共同特征实现在线标定。
  • 在真实交通场景中提升目标定位精度,误差显著降低。
  • 适合自动驾驶、智能交通等需多传感器协同的场景。

本文提出一种融合雷达与相机数据的多目标跟踪(MOT)框架,以提升跟踪效率并减少人工干预。不同于多数研究将雷达仅作为补充传感器(尽管其能提供世界坐标系下的精确距离/深度信息),本方法赋予雷达核心地位。通过挖掘雷达与相机数据间的共同特征,实现检测结果的在线自动标定,从而简化双传感器融合流程。主要贡献包括:(1)构建基于在线标定的雷达-相机融合MOT框架,简化检测结果集成;(2)利用共同特征精准推导目标在真实世界中的位置;(3)采用特征匹配与类别一致性验证,突破仅依赖位置匹配的局限,提升传感器关联准确率。据我们所知,这是首个系统研究雷达-相机共同特征及其在在线标定中用于MOT的工作。真实环境实验表明,该框架有效简化了雷达-相机映射过程,并显著提升跟踪精度。代码已公开于https://github.com/radar-lab/Radar_Camera_MOT。

原文摘要 · Abstract (English)

This paper presents a Multi-Object Tracking (MOT) framework that fuses radar and camera data to enhance tracking efficiency while minimizing manual interventions. Contrary to many studies that underutilize radar and assign it a supplementary role--despite its capability to provide accurate range/depth information of targets in a world 3D coordinate system--our approach positions radar in a crucial role. Meanwhile, this paper utilizes common features to enable online calibration to autonomously associate detections from radar and camera. The main contributions of this work include: (1) the development of a radar-camera fusion MOT framework that exploits online radar-camera calibration to simplify the integration of detection results from these two sensors, (2) the utilization of common features between radar and camera data to accurately derive real-world positions of detected objects, and (3) the adoption of feature matching and category-consistency checking to surpass the limitations of mere position matching in enhancing sensor association accuracy. To the best of our knowledge, we are the first to investigate the integration of radar-camera common features and their use in online calibration for achieving MOT. The efficacy of our framework is demonstrated by its ability to streamline the radar-camera mapping process and improve tracking precision, as evidenced by real-world experiments conducted in both controlled environments and actual traffic scenarios. Code is available at https://github.com/radar-lab/Radar_Camera_MOT

多传感器融合目标跟踪自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。