arXiv:2606.21613cs.CVcs.AI2026-06

利用物种活动规律自验证,实现无标注野生动物监测。

Cross-Modal Corroboration for Annotation-Free Wildlife Monitoring

论文配图:Cross-Modal Corroboration for Annotation-Free Wildlife Monitoring
图 1 · 摘自论文原文
  • 用视觉与声音模态独立生成活动曲线,三重一致性验证。
  • 在麋鹿种群上成功复现已知生态行为模式,无需人工标注。
  • 适合有文献行为先验的可视声学共检测物种使用。

真实世界保护部署中的野生动物监测规模化依赖于智能传感器的自动化分析,但面临严重标注稀缺问题。本文提出利用专家对物种活动规律的知识作为无标注验证信号,通过多模态监测流程中独立推导的每小时活动曲线之间的一致性,以及与已有行为先验的吻合度,实现三重收敛——排除了数据共混和内部相关性的干扰。视觉管道采用BioCLIP 2进行零样本物种检测,结合分段推理以适应部署受限的相机位置,并基于几何信息从相机陷阱图像中实现地理定位;声学管道则通过微调分类器检测物种鸣叫。在麋鹿繁殖群体上的验证表明,两种模态均能独立恢复出与已知生态行为一致的活动模式,且几乎无需人工标注。该框架适用于文献中有行为先验、且可同时通过视觉和声音识别的物种,为大规模自然保护中的自验证监测提供了可行路径。

原文摘要 · Abstract (English)

Scaling wildlife monitoring for real-world conservation deployments requires automated analysis of smart sensors that operate under severe annotation scarcity. We propose leveraging expert knowledge of species activity patterns as an annotation-free validation signal for multimodal monitoring pipelines. We operationalize agreement as the alignment of independently derived hourly activity curves both with each other and with published behavioral priors-a three-way convergence that rules out shared-data confounds and dataset-internal correlation as alternative explanations. Our vision pipeline combines zero-shot species detection via BioCLIP 2, sliced inference to handle deployment-constrained camera positioning, and geometry-based geographic localization from camera trap imagery. Our acoustic pipeline detects species vocalizations via a fine-tuned classifier. We validate the pipeline on a breeding herd of Milu deer and demonstrate that both modalities independently recover activity patterns consistent with known deer behavioral ecology with minimal manual annotation. The framework applies to species detectable in both visual and acoustic modalities for which behavioral priors are documented in the literature, suggesting a practical path toward self-validating wildlife-monitoring pipelines at conservation scale.

野生动物监测多模态融合零样本检测自验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。