arXiv:2507.09338cs.CV2025-07ICCV被引 5

用简单视频模型+自监督预训练,实现高效精准的交通异常检测。

Simplifying Traffic Anomaly Detection with Video Foundation Models

  • 采用纯编码器结构的视频ViT,不依赖复杂多阶段设计。
  • 自监督掩码视频建模使性能超越主流方法,效率提升显著。
  • 无需异常样本,通过驾驶视频域适应可进一步提升效果。

针对视角中心的交通异常检测(TAD),现有方法多采用复杂的多阶段或多表示融合架构,但其必要性尚不明确。受视觉感知领域基础模型启发,本文探索仅使用普通视频视觉变换器(Video ViT)的简单编码器架构,研究预训练对TAD性能的影响。结果表明:(i) 高级预训练使简单编码器模型达到甚至超越当前先进TAD方法的性能,同时显著提升效率;(ii) 弱监督与全监督预训练在标准基准上表现良好,但在TAD任务中效果有限,而自监督掩码视频建模(MVM)提供最强信号;(iii) 在未标注驾驶视频上进行域适应预训练(DAPT),可在无需异常样本的情况下进一步提升下游性能。研究揭示了预训练的关键作用,证明只需极简架构即可构建高效、可扩展的TAD模型。代码、域适应编码器及微调模型已开源:https://github.com/tue-mps/simple-tad。

原文摘要 · Abstract (English)

Recent methods for ego-centric Traffic Anomaly Detection (TAD) often rely on complex multi-stage or multi-representation fusion architectures, yet it remains unclear whether such complexity is necessary. Recent findings in visual perception suggest that foundation models, enabled by advanced pre-training, allow simple yet flexible architectures to outperform specialized designs. Therefore, in this work, we investigate an architecturally simple encoder-only approach using plain Video Vision Transformers (Video ViTs) and study how pre-training enables strong TAD performance. We find that: (i) advanced pre-training enables simple encoder-only models to match or even surpass the performance of specialized state-of-the-art TAD methods, while also being significantly more efficient; (ii) although weakly- and fully-supervised pre-training are advantageous on standard benchmarks, we find them less effective for TAD. Instead, self-supervised Masked Video Modeling (MVM) provides the strongest signal; and (iii) Domain-Adaptive Pre-Training (DAPT) on unlabeled driving videos further improves downstream performance, without requiring anomalous examples. Our findings highlight the importance of pre-training and show that effective, efficient, and scalable TAD models can be built with minimal architectural complexity. We release our code, domain-adapted encoders, and fine-tuned models to support future work: https://github.com/tue-mps/simple-tad.

交通检测视频模型自监督学习高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。