为无人机异常检测打造首个聚焦推理的大型基准数据集
A2Seek: Towards Reasoning-Centric Benchmark for Aerial Anomaly Understanding
- 构建图思维引导的推理框架,激活模型深层逻辑能力
- 在异常定位与预测上分别提升22.04%和13.9%
- 适合研究无人机视觉理解与因果推理的开发者
尽管无人机可提供大范围高空覆盖用于异常检测,但仍面临动态视角、尺度变化和复杂场景等挑战。现有数据集与方法多针对固定地面视角设计,在无人机视图下性能显著下降。为此,我们提出A2Seek(Aerial Anomaly Seek)——一个大规模、以推理为核心的航空异常理解基准数据集。该数据集涵盖多种场景与环境条件,包含高分辨率真实航拍视频及详细标注:异常类别、帧级时间戳、区域级边界框以及自然语言解释以支持因果推理。基于此,我们提出A2Seek-R1,一种将R1风格策略拓展至航空异常理解的新框架,实现对“何地”异常发生、“为何”发生的深层理解。A2Seek-R1首先采用图思维(GoT)引导的监督微调激活模型隐式推理能力;随后引入面向航空场景设计的规则奖励函数,通过航拍群体相对策略优化(A-GRPO)进行训练;并提出新型“搜寻”机制,模拟无人机飞行行为引导模型关注关键区域。大量实验表明,A2Seek-R1在预测准确率上达到22.04%的AP提升,在异常定位上获得13.9%的mIoU增益,展现出强泛化能力,适用于复杂环境与分布外场景。数据集与代码已公开于https://2-mo.github.io/A2Seek/
原文摘要 · Abstract (English)
While unmanned aerial vehicles (UAVs) offer wide-area, high-altitude coverage for anomaly detection, they face challenges such as dynamic viewpoints, scale variations, and complex scenes. Existing datasets and methods, mainly designed for fixed ground-level views, struggle to adapt to these conditions, leading to significant performance drops in drone-view scenarios. To bridge this gap, we introduce A2Seek (Aerial Anomaly Seek), a large-scale, reasoning-centric benchmark dataset for aerial anomaly understanding. This dataset covers various scenarios and environmental conditions, providing high-resolution real-world aerial videos with detailed annotations, including anomaly categories, frame-level timestamps, region-level bounding boxes, and natural language explanations for causal reasoning. Building on this dataset, we propose A2Seek-R1, a novel reasoning framework that generalizes R1-style strategies to aerial anomaly understanding, enabling a deeper understanding of "Where" anomalies occur and "Why" they happen in aerial frames. To this end, A2Seek-R1 first employs a graph-of-thought (GoT)-guided supervised fine-tuning approach to activate the model's latent reasoning capabilities on A2Seek. Then, we introduce Aerial Group Relative Policy Optimization (A-GRPO) to design rule-based reward functions tailored to aerial scenarios. Furthermore, we propose a novel "seeking" mechanism that simulates UAV flight behavior by directing the model's attention to informative regions. Extensive experiments demonstrate that A2Seek-R1 achieves up to a 22.04% improvement in AP for prediction accuracy and a 13.9% gain in mIoU for anomaly localization, exhibiting strong generalization across complex environments and out-of-distribution scenarios. Our dataset and code are released at https://2-mo.github.io/A2Seek/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。