arXiv:2502.20111cs.CVcs.AI2025-02CVPR被引 9

MITracker通过3D特征融合与注意力机制,实现多视角稳定追踪

MITracker: Multi-View Integration for Visual Object Tracking

  • 将2D特征转为3D体积分量并压缩至俯视图,实现跨视角信息融合
  • 在MVTrack和GMTD数据集上超越现有方法,实现顶尖追踪性能
  • 适合需要多视角鲁棒追踪的自动驾驶与监控场景

多视角目标追踪(MVOT)能有效应对遮挡和目标丢失等单视角追踪难题。然而,受限于缺乏全面的多视角数据集和有效的跨视角融合方法,进展缓慢。为此,我们构建了包含234,000帧高质量标注图像、27个不同物体、多种场景的多视角目标追踪数据集MVTrack。基于此,我们提出新型MVOT方法MITracker,可对任意视角、任意长度视频中的目标进行稳定追踪。其核心创新在于:(1) 将2D图像特征转换为3D特征体,并压缩至鸟瞰图(BEV)平面,促进跨视角信息融合;(2) 提出一种注意力机制,利用融合后的3D特征体中的几何信息,优化各视角的追踪结果。MITracker在MVTrack和GMTD数据集上均取得当前最优表现。代码与数据集将公开于https://mii-laboratory.github.io/MITracker/。

原文摘要 · Abstract (English)

Multi-view object tracking (MVOT) offers promising solutions to challenges such as occlusion and target loss, which are common in traditional single-view tracking. However, progress has been limited by the lack of comprehensive multi-view datasets and effective cross-view integration methods. To overcome these limitations, we compiled a Multi-View object Tracking (MVTrack) dataset of 234K high-quality annotated frames featuring 27 distinct objects across various scenes. In conjunction with this dataset, we introduce a novel MVOT method, Multi-View Integration Tracker (MITracker), to efficiently integrate multi-view object features and provide stable tracking outcomes. MITracker can track any object in video frames of arbitrary length from arbitrary viewpoints. The key advancements of our method over traditional single-view approaches come from two aspects: (1) MITracker transforms 2D image features into a 3D feature volume and compresses it into a bird's eye view (BEV) plane, facilitating inter-view information fusion; (2) we propose an attention mechanism that leverages geometric information from fused 3D feature volume to refine the tracking results at each view. MITracker outperforms existing methods on the MVTrack and GMTD datasets, achieving state-of-the-art performance. The code and the new dataset will be available at https://mii-laboratory.github.io/MITracker/.

多视角追踪3D特征融合目标追踪鸟瞰图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。