构建首个覆盖99种动物的大型野外多动物追踪数据集
The SA-FARI Dataset: Segment Anything in Footage of Animals for Recognition and Identification
- 收集10年跨4大洲741个地点的1.16万段相机陷阱视频
- 标注超46小时视频,含16224个个体掩码和94万+边界框
- 支持通用动物识别与追踪,适合野生动物保护研究者
自动化视频分析对野生动物保护至关重要。核心任务是多动物追踪(MAT),支撑个体重识别与行为分析。但现有数据集规模有限、物种少、时空多样性不足,缺乏可训练通用MAT模型的基准。为此,我们推出SA-FARI,目前最大的开源野生动物MAT数据集。包含约10年(2014–2024)间从全球741个地点采集的11,609段相机陷阱视频,涵盖99个物种类别。每段视频均被详尽标注,总计约46小时密集标注视频,含16,224个掩码身份、942,702个个体边界框、分割掩码及物种标签。同时公开每个视频的匿名化地理位置信息。我们使用前沿视觉-语言模型(如SAM 3)在SA-FARI上建立全面基准,采用特定物种与通用动物提示进行评估,并对比专为野生动物设计的纯视觉方法。SA-FARI是首个融合高物种多样性、多区域覆盖与高质量时空标注的大规模数据集,为推动可泛化的野外多动物追踪提供新基础。数据集已开放下载:https://www.conservationxlabs.com/sa-fari。
原文摘要 · Abstract (English)
Automated video analysis is critical for wildlife conservation. A foundational task in this domain is multi-animal tracking (MAT), which underpins applications such as individual re-identification and behavior recognition. However, existing datasets are limited in scale, constrained to a few species, or lack sufficient temporal and geographical diversity - leaving no suitable benchmark for training general-purpose MAT models applicable across wild animal populations. To address this, we introduce SA-FARI, the largest open-source MAT dataset for wild animals. It comprises 11,609 camera trap videos collected over approximately 10 years (2014-2024) from 741 locations across 4 continents, spanning 99 species categories. Each video is exhaustively annotated culminating in ~46 hours of densely annotated footage containing 16,224 masklet identities and 942,702 individual bounding boxes, segmentation masks, and species labels. Alongside the task-specific annotations, we publish anonymized camera trap locations for each video. Finally, we present comprehensive benchmarks on SA-FARI using state-of-the-art vision-language models for detection and tracking, including SAM 3, evaluated with both species-specific and generic animal prompts. We also compare against vision-only methods developed specifically for wildlife analysis. SA-FARI is the first large-scale dataset to combine high species diversity, multi-region coverage, and high-quality spatio-temporal annotations, offering a new foundation for advancing generalizable multianimal tracking in the wild. The dataset is available at https://www.conservationxlabs.com/sa-fari.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。