arXiv:2411.19215cs.CV2024-11被引 1

无监督学习跨光谱人脸与行人识别,突破标注数据瓶颈。

Cross-Spectral Attention for Unsupervised RGB-IR Face Verification and Person Re-identification

论文配图:Cross-Spectral Attention for Unsupervised RGB-IR Face Verification and Person Re-identification
图 1 · 摘自论文原文
  • 设计伪三元组损失与跨谱投票机制,实现无监督特征对齐。
  • 提出多子空间交叉注意力网络,在两个数据集上超越有监督方法。
  • 适合低标注成本的安防监控场景,尤其关注红外成像应用。

跨光谱生物识别(如可见光RGB与红外IR图像匹配)近年来因红外焦平面阵列灵敏度提升、体积缩小、质量增强及更广泛的光谱分析应用而快速发展。现有方法常依赖多谱数据构建判别性公共子空间,但受限于鲁棒架构设计与标注数据获取困难。为此,本文提出一种新型无监督跨光谱框架,结合:(1) 新型伪三元组损失与跨光谱投票;(2) 多子空间交叉注意力网络;(3) 结构化稀疏性以实现更具判别力的跨光谱聚类。在两个挑战性基准数据集——美军陆军研究实验室可见-热面数据集(ARL-VTF)和RegDB行人重识别数据集——上,与近期及先前最优模型对比,部分情况下性能优于完全监督方法。

原文摘要 · Abstract (English)

Cross-spectral biometrics, such as matching imagery of faces or persons from visible (RGB) and infrared (IR) bands, have rapidly advanced over the last decade due to increasing sensitivity, size, quality, and ubiquity of IR focal plane arrays and enhanced analytics beyond the visible spectrum. Current techniques for mitigating large spectral disparities between RGB and IR imagery often include learning a discriminative common subspace by exploiting precisely curated data acquired from multiple spectra. Although there are challenges with determining robust architectures for extracting common information, a critical limitation for supervised methods is poor scalability in terms of acquiring labeled data. Therefore, we propose a novel unsupervised cross-spectral framework that combines (1) a new pseudo triplet loss with cross-spectral voting, (2) a new cross-spectral attention network leveraging multiple subspaces, and (3) structured sparsity to perform more discriminative cross-spectral clustering. We extensively compare our proposed RGB-IR biometric learning framework (and its individual components) with recent and previous state-of-the-art models on two challenging benchmark datasets: DEVCOM Army Research Laboratory Visible-Thermal Face Dataset (ARL-VTF) and RegDB person re-identification dataset, and, in some cases, achieve performance superior to completely supervised methods.

跨光谱识别无监督学习行人重识别红外视觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。