arXiv:2512.21032cs.CV2025-12中稿 · 2025 IEEE Internat…

用扩散模型将热成像人脸转为可见光图像,保留身份特征提升识别率。

Multi-Attribute guided Thermal Face Image Translation based on Latent Diffusion Model

  • 基于潜在扩散模型,结合多属性分类器生成可见光人脸。
  • 在两个数据集上达到当前最佳图像质量和身份保留效果。
  • 自研Mamba模块加速推理,适合实时安防场景应用。

现代监控系统越来越多依赖多波段传感器和深度神经网络,在夜间红外图像中识别人脸。然而,大多数面部识别模型在可见光数据集上训练,导致因域偏移在红外输入上性能显著下降。早期基于特征的方法效果不佳,研究者转向生成式方法,将红外图像转换为可见光图像以提升识别效果。这一范式称为异质人脸识别(HFR),但面临模型与模态差异问题,导致生成图像失真和特征丢失。为此,本文提出一种新的基于潜在扩散模型的方法,从热成像输入生成高质量可见光人脸图像,同时保留关键身份特征。引入多属性分类器提取可见光图像中的关键面部属性,缓解红外到可见光转换过程中的特征损失。此外,提出Self-attn Mamba模块,增强跨模态特征的全局建模能力,显著提升推理速度。在两个基准数据集上的实验表明,该方法在图像质量和身份保留方面均达到当前最优水平。

原文摘要 · Abstract (English)

Modern surveillance systems increasingly rely on multi-wavelength sensors and deep neural networks to recognize faces in infrared images captured at night. However, most facial recognition models are trained on visible light datasets, leading to substantial performance degradation on infrared inputs due to significant domain shifts. Early feature-based methods for infrared face recognition proved ineffective, prompting researchers to adopt generative approaches that convert infrared images into visible light images for improved recognition. This paradigm, known as Heterogeneous Face Recognition (HFR), faces challenges such as model and modality discrepancies, leading to distortion and feature loss in generated images. To address these limitations, this paper introduces a novel latent diffusion-based model designed to generate high-quality visible face images from thermal inputs while preserving critical identity features. A multi-attribute classifier is incorporated to extract key facial attributes from visible images, mitigating feature loss during infrared-to-visible image restoration. Additionally, we propose the Self-attn Mamba module, which enhances global modeling of cross-modal features and significantly improves inference speed. Experimental results on two benchmark datasets demonstrate the superiority of our approach, achieving state-of-the-art performance in both image quality and identity preservation.

热成像人脸生成扩散模型跨模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。