首个面向航拍视角的交通原子行为识别与时间分割数据集
ATARS: An Aerial Traffic Atomic Activity Recognition and Temporal Segmentation Dataset
- 航拍视角下每帧标注原子行为,实现精准时间定位
- 提出多标签时间原子行为识别新任务,免去手动剪辑视频
- 专为小目标行为识别设计,适合智能驾驶研究者使用
交通原子行为描述拓扑交叉口的动态交通模式,对智能驾驶系统发展至关重要。现有数据集多基于第一人称视角,无法支持对整个交叉口交通活动的分析;且仅提供视频级标注,需大量人工剪辑才能用于识别,限制了在未剪辑视频上的应用。为此,我们提出首个面向航拍视角的多标签原子行为分析数据集ATARS,提供每帧的原子行为标签,精确记录行为持续区间。我们还提出新型任务——多标签时间原子行为识别,实现原子行为的精确时间定位,减轻人工剪辑负担。通过大量实验评估现有主流模型在原子行为识别与时间分割上的表现,结果凸显了该数据集的独特挑战,如极小目标行为的识别难题。我们进一步深入讨论这些挑战,并为未来提升航拍视角下原子行为识别能力提供关键洞察。代码与数据集开源:https://github.com/magecliff96/ATARS/
原文摘要 · Abstract (English)
Traffic Atomic Activity which describes traffic patterns for topological intersection dynamics is a crucial topic for the advancement of intelligent driving systems. However, existing atomic activity datasets are collected from an egocentric view, which cannot support the scenarios where traffic activities in an entire intersection are required. Moreover, existing datasets only provide video-level atomic activity annotations, which require exhausting efforts to manually trim the videos for recognition and limit their applications to untrimmed videos. To bridge this gap, we introduce the Aerial Traffic Atomic Activity Recognition and Segmentation (ATARS) dataset, the first aerial dataset designed for multi-label atomic activity analysis. We offer atomic activity labels for each frame, which accurately record the intervals for traffic activities. Moreover, we propose a novel task, Multi-label Temporal Atomic Activity Recognition, enabling the study of accurate temporal localization for atomic activity and easing the burden of manual video trimming for recognition. We conduct extensive experiments to evaluate existing state-of-the-art models on both atomic activity recognition and temporal atomic activity segmentation. The results highlight the unique challenges of our ATARS dataset, such as recognizing extremely small objects' activities. We further provide comprehensive discussion analyzing these challenges and offer valuable insights for future direction to improve recognizing atomic activity in aerial view. Our source code and dataset are available at https://github.com/magecliff96/ATARS/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。