arXiv:2502.20361cs.CV2025-02CVPR被引 15

统一视频动作检测框架,让不同方法公平对比并发现最优设计。

OpenTAD: A Unified Framework and Comprehensive Study of Temporal Action Detection

  • 构建模块化框架,可灵活替换网络组件
  • 在9个数据集上测试16种方法,验证组件有效性
  • 推动公平评测,助力新基准方法诞生

时间动作检测(TAD)是视频理解的核心任务,旨在识别视频中人类动作并定位其时间边界。尽管近年来取得显著进展,但缺乏统一的评估框架阻碍了进一步发展与实际应用。当前各方法在不同实现设置和评估协议下比较,难以真实衡量技术效果。为此,我们提出OpenTAD,一个整合16种不同TAD方法和9个标准数据集的统一框架。OpenTAD采用模块化代码库,支持快速替换组件、端到端训练特征模型,以及跨数据集便捷比较。基于该框架,我们系统研究了不同网络组件对检测性能的影响,通过大量实验识别出最有效的设计选择,并在此基础上构建出新的领先方法。代码与模型已开源于https://github.com/sming256/OpenTAD。

原文摘要 · Abstract (English)

Temporal action detection (TAD) is a fundamental video understanding task that aims to identify human actions and localize their temporal boundaries in videos. Although this field has achieved remarkable progress in recent years, further progress and real-world applications are impeded by the absence of a standardized framework. Currently, different methods are compared under different implementation settings, evaluation protocols, etc., making it difficult to assess the real effectiveness of a specific technique. To address this issue, we propose \textbf{OpenTAD}, a unified TAD framework consolidating 16 different TAD methods and 9 standard datasets into a modular codebase. In OpenTAD, minimal effort is required to replace one module with a different design, train a feature-based TAD model in end-to-end mode, or switch between the two. OpenTAD also facilitates straightforward benchmarking across various datasets and enables fair and in-depth comparisons among different methods. With OpenTAD, we comprehensively study how innovations in different network components affect detection performance and identify the most effective design choices through extensive experiments. This study has led to a new state-of-the-art TAD method built upon existing techniques for each component. We have made our code and models available at https://github.com/sming256/OpenTAD.

动作检测视频理解统一框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。