arXiv:2510.19981cs.CV2025-10ICCV被引 3

融合相机与激光雷达的3D多目标跟踪框架,提升复杂场景下识别稳定性。

FutrTrack: A Camera-LiDAR Fusion Transformer for 3D Multiple Object Tracking

  • 用双阶段变换器精修检测框并融合多模态特征实现跟踪
  • nuScenes上aMOTA达74.7,身份切换少且空间一致性高
  • 无需显式运动模型,适合数据有限场景下的实时应用

我们提出FutrTrack,一种基于现有3D检测器的模块化相机-LiDAR多目标跟踪框架,引入基于Transformer的时序平滑器和融合驱动追踪器。受查询式追踪框架启发,FutrTrack采用多模态两阶段变换器精修与追踪流程。其融合追踪器将边界框与来自多摄像头和激光雷达的多模态鸟瞰图(BEV)特征结合,无需显式运动模型。通过几何与语义线索联合实现跨帧身份分配与传播,在遮挡与视角变化下保持鲁棒性。追踪前,利用滑动窗口对检测框序列进行时序平滑,以优化轨迹、降低抖动并增强空间一致性。在nuScenes与KITTI数据集上评估表明,相较于单传感器方法,基于查询的变换器追踪方法显著受益于多模态传感器特征。FutrTrack在nuScenes测试集上取得74.7的aMOTA,大幅减少身份切换同时保持高精度。该方法为提升基于变压器的追踪器性能提供了高效框架,即使在数据有限且无预训练的情况下仍具竞争力。

原文摘要 · Abstract (English)

We propose FutrTrack, a modular camera-LiDAR multi-object tracking framework that builds on existing 3D detectors by introducing a transformer-based smoother and a fusion-driven tracker. Inspired by query-based tracking frameworks, FutrTrack employs a multimodal two-stage transformer refinement and tracking pipeline. Our fusion tracker integrates bounding boxes with multimodal bird's-eye-view (BEV) fusion features from multiple cameras and LiDAR without the need for an explicit motion model. The tracker assigns and propagates identities across frames, leveraging both geometric and semantic cues for robust re-identification under occlusion and viewpoint changes. Prior to tracking, we refine sequences of bounding boxes with a temporal smoother over a moving window to refine trajectories, reduce jitter, and improve spatial consistency. Evaluated on nuScenes and KITTI, FutrTrack demonstrates that query-based transformer tracking methods benefit significantly from multimodal sensor features compared with previous single-sensor approaches. With an aMOTA of 74.7 on the nuScenes test set, FutrTrack achieves strong performance on 3D MOT benchmarks, reducing identity switches while maintaining competitive accuracy. Our approach provides an efficient framework for improving transformer-based trackers to compete with other neural-network-based methods even with limited data and without pretraining.

3D跟踪多模态融合Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。