用弱监督方法提升无人机野生动物计数,省时省钱还更准。
Overhead Wildlife Locator (OWL): Benchmarking Weakly Supervised Learning for Aerial Wildlife Surveys

- 用点标注代替框标注,开发三类弱监督密度估计模型。
- 在五大数据集上表现超越现有方法,部分达新纪录(0.934 AP)。
- 适配不同场景:密集区用混合模型,稀疏区用全卷积模型。
自动化空中野生动物调查日益依赖深度学习,但标准目标检测器需边界框标注,其制作速度慢至点级标签的七倍,成本高三倍。为解决这一瓶颈,我们提出面向高空野生动物定位的弱监督框架 OWL,包含三种变体:OWL-C(全卷积模型,适合高速筛查)、OWL-T(Swin增强混合模型,适用于异质复杂场景)和 OWL-D(基于冻结的 DINOv3 ViT-H+/16 编码器与 DPT 风格融合解码器)。我们在五个公开航空数据集上对三者进行基准测试,涵盖从稀疏固定翼草原调查到密集无人机牧场影像,并在 Delplanque 数据集上对比已有 HerdNet 基线。结果显示,OWL-D 在 Delplanque 上达到 0.934 AP,优于 HerdNet 的 0.840;在四组数据中取得最高平均精度。性能因场景而异:在极端密集的 SheepCounter UAV 数据集上,混合模型 OWL-T 表现最佳(0.978 AP),而卷积模型误差最低;基础模型 OWL-D 在该场景下性能下降,表明不同模型适配不同调查类型。进一步在阿拉斯加鱼类与游戏部 2022 年北极中部驯鹿普查中验证了实际可用性:在跨族群与跨时间迁移条件下,经 2017 年 Porcupine 驯鹿群数据微调的 OWL-C 在保留测试集上取得 F1 = 0.965,整体计数误差为 +3.1%。代码、模型权重及标注的 PCH(2017)和 CAH(2022)测试片段已开源,为大规模驯鹿空中调查提供首个开放的片级别数据集。
原文摘要 · Abstract (English)
Automated aerial wildlife surveys increasingly rely on deep learning, yet standard object detectors require bounding-box annotations, reported to be up to seven times slower and three times more expensive to produce than point-level labels. To address this bottleneck, we introduce the Overhead Wildlife Locator (OWL), a weakly supervised density-estimation framework with three variants: OWL-C, a fully convolutional model for high-throughput screening; OWL-T, a Swin-augmented hybrid for heterogeneous, cluttered scenes; and OWL-D, built on a frozen DINOv3 ViT-H+/16 encoder with a DPT-style fusion decoder. We benchmark all three against POLO, YOLOv11n, and YOLOv11l across five public aerial datasets, from sparse fixed-wing savanna surveys to dense UAV paddock imagery, and against the published HerdNet baseline on its native Delplanque split. OWL-D sets a new state of the art on Delplanque (0.934 AP vs. HerdNet's 0.840) and records the highest AP on four of the five datasets. Performance is regime-dependent: on the extreme-density SheepCounter UAV dataset the hybrid OWL-T leads (0.978 AP) and the convolutional variants attain the lowest counting error, whereas the foundation-based OWL-D degrades, indicating which variant suits which survey type. We further validate operational readiness on the Alaska Department of Fish and Game's 2022 Central Arctic Caribou census: under cross-herd and cross-temporal transfer, OWL-C fine-tuned on the 2017 Porcupine Caribou Herd split attains F1 = 0.965 on a held-out patch test set, with a signed count error of +3.1% aggregated across the released test patches. We release the OWL code, model weights, and the annotated Porcupine Caribou Herd 2017 (PCH) and Central Arctic Herd 2022 (CAH) patches, the first open patch-level datasets for large-scale caribou aerial surveys, at https://github.com/microsoft/MegaDetector-Overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。