arXiv:2605.09417cs.CV2026-05

用像素级运动信息提升复杂场景下的多目标追踪鲁棒性

SAMOFT: Robust Multi-Object Tracking via Region and Flow

论文配图:SAMOFT: Robust Multi-Object Tracking via Region and Flow
图 1 · 摘自论文原文
  • 结合SAM与光流,用像素运动修正预测轨迹
  • 在遮挡和低置信度检测下仍保持稳定匹配
  • 无需训练即可动态校正长期运动模式

多目标追踪是计算机视觉的基础任务,需在帧间持续跟踪多个目标并保持身份一致。现有方法主要依赖实例级特征进行轨迹关联,在目标形变、非线性运动和遮挡等挑战下性能下降。本文提出SAMOFT,利用像素级线索增强复杂运动场景下的鲁棒性。设计了像素运动匹配(PMM)模块,将分割任意模型(SAM)与稠密光流结合,基于前景像素的瞬时运动优化卡尔曼滤波的运动预测。为提升低置信度或部分遮挡情况下的鲁棒性,引入质心距离匹配(CDM)模块,实现灵活的掩码级质心匹配。进一步提出基于分布的校正(DBC)模块,通过历史光流统计在无训练情况下建模长尾运动模式,并在线动态修正轨迹状态。同时采用聚类感知的ReID(CA-ReID)策略,提升轨迹外观特征的稳定性与区分能力。在DanceTrack和MOTChallenge基准上的大量实验表明,SAMOFT持续优于基线追踪器,性能达到近期最先进水平,验证了利用像素级线索提升多目标追踪鲁棒性的有效性。

原文摘要 · Abstract (English)

Multi-object tracking (MOT) is a fundamental task in computer vision that requires continuously tracking multiple targets while maintaining consistent identities across frames. However, most existing approaches primarily rely on instance-level object features for trajectory association, which often leads to degraded performance under challenging conditions such as object deformation, nonlinear motion, and occlusion. In this work, we propose SAMOFT, a robust tracker that leverages pixel-level cues to improve robustness under complex motion scenarios. Specifically, we introduce a Pixel Motion Matching (PMM) module that integrates the Segment Anything Model (SAM) with dense optical flow to refine Kalman filter-based motion prediction using instantaneous foreground pixel motion. To further enhance robustness under unreliable detections, we design a Centroid Distance Matching (CDM) module that performs flexible mask-based centroid matching for low-confidence or partially occluded observations. Moreover, a Distribution-Based Correction (DBC) module models long-tailed motion patterns in a training-free manner using historical optical flow statistics and dynamically corrects trajectory states online. We also incorporate a Cluster-Aware ReID (CA-ReID) strategy to improve the stability and discriminative power of trajectory appearance features. Extensive experiments on the DanceTrack and MOTChallenge benchmarks demonstrate that SAMOFT consistently improves baseline trackers and achieves competitive performance compared with recent state-of-the-art methods, validating the effectiveness of leveraging pixel-level cues for robust multi-object tracking.

多目标追踪光流SAM鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。