arXiv:2501.13368cs.CVcs.LG2025-01被引 12

构建首个融合环境信息的动物重识别数据集,提升野生动物监测精度。

MetaWild: A Multimodal Dataset for Animal Re-Identification with Environmental Metadata

  • 引入温湿度、昼夜节律等环境元数据,结合视觉信息进行动物识别
  • 加入元数据后模型准确率显著提升,验证多模态有效性
  • 适合关注生态监测与多模态学习的研究者

在大规模野生动物种群中识别个体对有效监测和保护至关重要。现有动物重识别(Animal ReID)数据集仅依赖视觉数据,忽视了生态学家发现与动物行为和身份高度相关的环境元数据,如温度和昼夜节律。随着能够联合处理视觉与文本数据的多模态模型兴起,现有数据集未能充分利用其文本处理能力,限制了模型潜力。为此,我们提出元特征适配器(MFA),一个轻量级模块,可嵌入现有视觉-语言模型(VLM)-based Animal ReID方法中,使模型同时利用环境元数据与视觉信息。在MetaWild数据集上的实验表明,结合基准重识别模型与MFA使用元数据,性能持续优于仅用视觉信息的方法,验证了元数据在重识别中的有效性。我们希望该数据集能推动多模态动物重识别研究。

原文摘要 · Abstract (English)

Identifying individual animals within large wildlife populations is essential for effective wildlife monitoring and conservation efforts. Recent advancements in computer vision have shown promise in animal re-identification (Animal ReID) by leveraging data from camera traps. However, existing Animal ReID datasets rely exclusively on visual data, overlooking environmental metadata that ecologists have identified as highly correlated with animal behavior and identity, such as temperature and circadian rhythms. Moreover, the emergence of multimodal models capable of jointly processing visual and textual data presents new opportunities for Animal ReID, but existing datasets fail to leverage these models' text-processing capabilities, limiting their full potential. Additionally, to facilitate the use of metadata in existing ReID methods, we propose the Meta-Feature Adapter (MFA), a lightweight module that can be incorporated into existing vision-language model (VLM)-based Animal ReID methods, allowing ReID models to leverage both environmental metadata and visual information to improve ReID performance. Experiments on MetaWild show that combining baseline ReID models with MFA to incorporate metadata consistently improves performance compared to using visual information alone, validating the effectiveness of incorporating metadata in re-identification. We hope that our proposed dataset can inspire further exploration of multimodal approaches for Animal ReID.

动物识别多模态生态监测元数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。