arXiv:2503.10931cs.CV2025-03被引 1

用身体嵌入提升红外域跨谱识别,效果优于人脸嵌入。

Multi-Domain Biometric Recognition using Body Embeddings

  • 采用视觉变压器架构学习身体嵌入,适应多红外波段跨谱匹配。
  • 在IJB-MDF数据集上实现最新mAP,验证身体特征更稳定。
  • 适合做跨谱生物识别、安防监控等需要多域识别的研究者。

随着从可见光向红外成像的过渡,生物识别面临挑战,因域间差异显著影响识别性能。本文表明,在中波红外(MWIR)和长波红外(LWIR)域中,身体嵌入比人脸嵌入更适合跨谱身份识别。由于缺乏多域数据集,以往研究多仅针对单一红外波段(如NIR或LWIR)。本文基于IARPA Janus基准多域人脸数据集(IJB-MDF),实现短波红外(SWIR)、MWIR、LWIR与可见光(VIS)图像间的匹配。通过视觉变压器架构,在IJB-MDF上建立基准结果,并通过大量实验揭示红外域间关系、可见光预训练模型的适应性、身体嵌入中局部语义特征的作用及小样本有效训练策略。此外,仅用交叉熵与三元组损失微调纯可见光预训练的身体模型,即在LLCM数据集上达到当前最优mAP。

原文摘要 · Abstract (English)

Biometric recognition becomes increasingly challenging as we move away from the visible spectrum to infrared imagery, where domain discrepancies significantly impact identification performance. In this paper, we show that body embeddings perform better than face embeddings for cross-spectral person identification in medium-wave infrared (MWIR) and long-wave infrared (LWIR) domains. Due to the lack of multi-domain datasets, previous research on cross-spectral body identification - also known as Visible-Infrared Person Re-Identification (VI-ReID) - has primarily focused on individual infrared bands, such as near-infrared (NIR) or LWIR, separately. We address the multi-domain body recognition problem using the IARPA Janus Benchmark Multi-Domain Face (IJB-MDF) dataset, which enables matching of short-wave infrared (SWIR), MWIR, and LWIR images against RGB (VIS) images. We leverage a vision transformer architecture to establish benchmark results on the IJB-MDF dataset and, through extensive experiments, provide valuable insights into the interrelation of infrared domains, the adaptability of VIS-pretrained models, the role of local semantic features in body-embeddings, and effective training strategies for small datasets. Additionally, we show that finetuning a body model, pretrained exclusively on VIS data, with a simple combination of cross-entropy and triplet losses achieves state-of-the-art mAP scores on the LLCM dataset.

跨谱识别身体嵌入红外成像视觉变压器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。