arXiv:2410.06977cs.CVcs.AI2024-10ECCV被引 22

提出自适应高频变换器,提升多物种野生动物重识别精度。

Adaptive High-Frequency Transformer for Diverse Wildlife Re-Identification

  • 通过自适应高频选择策略增强关键纹理细节学习。
  • 在多个野生动物数据集上超越现有方法,跨物种泛化能力强。
  • 适合需要多物种、野外环境下的动物个体识别研究者。

野生动物重识别(Wildlife ReID)利用视觉技术在不同场景中识别特定野生动物个体,对生态保护、生态研究和环境监测具有重要意义。现有方法多针对特定物种,适用性有限;尽管部分工作借鉴了人重识别技术,但难以应对野生动物的独特挑战。为此,本文提出统一的多物种通用框架。由于高频信息在各类物种中均体现为独特特征,显著帮助识别轮廓与毛发纹理等细节,我们设计了自适应高频变换器模型以强化高频信息学习。为缓解野外环境中不可避免的高频干扰,引入对象感知的高频选择策略,自适应捕获更具价值的高频成分。值得注意的是,我们统一了多个野生动物数据集的实验设置,在性能上优于当前最优方法。在领域泛化场景下,该方法对未知物种表现出强鲁棒性。

原文摘要 · Abstract (English)

Wildlife ReID involves utilizing visual technology to identify specific individuals of wild animals in different scenarios, holding significant importance for wildlife conservation, ecological research, and environmental monitoring. Existing wildlife ReID methods are predominantly tailored to specific species, exhibiting limited applicability. Although some approaches leverage extensively studied person ReID techniques, they struggle to address the unique challenges posed by wildlife. Therefore, in this paper, we present a unified, multi-species general framework for wildlife ReID. Given that high-frequency information is a consistent representation of unique features in various species, significantly aiding in identifying contours and details such as fur textures, we propose the Adaptive High-Frequency Transformer model with the goal of enhancing high-frequency information learning. To mitigate the inevitable high-frequency interference in the wilderness environment, we introduce an object-aware high-frequency selection strategy to adaptively capture more valuable high-frequency components. Notably, we unify the experimental settings of multiple wildlife datasets for ReID, achieving superior performance over state-of-the-art ReID methods. In domain generalization scenarios, our approach demonstrates robust generalization to unknown species.

野生动物识别高频特征多物种泛化自适应模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。