用智能采样提升动物重识别,仅需极少标注就超越现有方法。
Active Learning for Animal Re-Identification with Ambiguity-Aware Sampling
- 通过聚类发现嵌入空间中模糊区域,主动选择有代表性的难样本对。
- 仅用0.033%标注量,准确率比基线高10.49%~11.19%。
- 适合需要少标注、跨物种和开放世界场景的野生动物监测项目。
动物重识别因对生物多样性监测具有重要影响而受到广泛关注,但其面临细微特征区分、新物种引入及开放集性质等挑战。尽管已有基于大规模多物种数据集训练的基础模型实现零样本重识别,但我们的测试显示其在已知与未知物种上的表现仍有显著差距。现有无监督(USL)和主动学习(AL)方法在动物重识别任务中也表现不佳。为此,我们提出一种新型主动学习框架,利用互补聚类方法挖掘嵌入空间中的结构模糊区域,定位信息丰富且具代表性的样本对。通过必须匹配/不能匹配的约束反馈,构建简洁标注接口,并结合所提出的约束聚类精炼算法无缝集成现有无监督方法。大量实验证明,仅使用全部标注的0.033%,该方法在13个野生动物数据集上持续优于基础模型、无监督和主动学习基线,平均提升10.49%、11.19%和3.99%(mAP)。在开放世界设置下,对未知个体的识别性能亦分别提升11.09%、8.2%和2.06%。
原文摘要 · Abstract (English)
Animal Re-ID has recently gained substantial attention in the AI research community due to its high impact on biodiversity monitoring and unique research challenges arising from environmental factors. The subtle distinguishing patterns, handling new species and the inherent open-set nature make the problem even harder. To address these complexities, foundation models trained on labeled, large-scale and multi-species animal Re-ID datasets have recently been introduced to enable zero-shot Re-ID. However, our benchmarking reveals significant gaps in their zero-shot Re-ID performance for both known and unknown species. While this highlights the need for collecting labeled data in new domains, exhaustive annotation for Re-ID is laborious and requires domain expertise. Our analyses show that existing unsupervised (USL) and AL Re-ID methods underperform for animal Re-ID. To address these limitations, we introduce a novel AL Re-ID framework that leverages complementary clustering methods to uncover and target structurally ambiguous regions in the embedding space for mining pairs of samples that are both informative and broadly representative. Oracle feedback on these pairs, in the form of must-link and cannot-link constraints, facilitates a simple annotation interface, which naturally integrates with existing USL methods through our proposed constrained clustering refinement algorithm. Through extensive experiments, we demonstrate that, by utilizing only 0.033% of all annotations, our approach consistently outperforms existing foundational, USL and AL baselines. Specifically, we report an average improvement of 10.49%, 11.19% and 3.99% (mAP) on 13 wildlife datasets over foundational, USL and AL methods, respectively, while attaining state-of-the-art performance on each dataset. Furthermore, we also show an improvement of 11.09%, 8.2% and 2.06% for unknown individuals in an open-world setting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。