arXiv:2510.11128cs.LGcs.CV2025-10被引 1

用双向知识蒸馏提升热成像人脸关键点检测精度与效率

Lightweight Facial Landmark Detection in Thermal Images via Multi-Level Cross-Modal Knowledge Transfer

  • 通过双向知识蒸馏实现跨模态特征对齐
  • 在热成像数据上达到新最优性能且计算开销大幅降低
  • 适合部署在资源受限的红外人脸识别系统

热成像中的人脸关键点检测在复杂光照条件下至关重要,但因缺乏丰富视觉线索而困难重重。传统跨模态方法如特征融合或从RGB图像进行图像转换,通常计算成本高或引入结构伪影,限制了实际应用。为此,我们提出多层级跨模态知识蒸馏(MLCM-KD)框架,将高保真度的RGB到热成像知识迁移与模型压缩解耦,构建既准确又高效的热成像人脸关键点检测模型。跨模态知识迁移的核心挑战在于RGB与热成像数据间存在显著模态差异,传统单向蒸馏无法在异质特征空间中保持语义一致性。为此,我们提出双注入知识蒸馏(DIKD),一种专为该任务设计的双向机制:不仅用丰富的RGB特征指导热成像学生模型,还将其学习到的表示反馈至冻结教师模型的预测头以验证其合理性。这种闭环监督迫使学生模型学习具有模态不变性的语义一致特征,确保鲁棒且深层的知识迁移。实验表明,本方法在公开热成像人脸关键点检测基准上达到新最优水平,显著优于先前方法,同时大幅降低计算开销。

原文摘要 · Abstract (English)

Facial Landmark Detection (FLD) in thermal imagery is critical for applications in challenging lighting conditions, but it is hampered by the lack of rich visual cues. Conventional cross-modal solutions, like feature fusion or image translation from RGB data, are often computationally expensive or introduce structural artifacts, limiting their practical deployment. To address this, we propose Multi-Level Cross-Modal Knowledge Distillation (MLCM-KD), a novel framework that decouples high-fidelity RGB-to-thermal knowledge transfer from model compression to create both accurate and efficient thermal FLD models. A central challenge during knowledge transfer is the profound modality gap between RGB and thermal data, where traditional unidirectional distillation fails to enforce semantic consistency across disparate feature spaces. To overcome this, we introduce Dual-Injected Knowledge Distillation (DIKD), a bidirectional mechanism designed specifically for this task. DIKD establishes a connection between modalities: it not only guides the thermal student with rich RGB features but also validates the student's learned representations by feeding them back into the frozen teacher's prediction head. This closed-loop supervision forces the student to learn modality-invariant features that are semantically aligned with the teacher, ensuring a robust and profound knowledge transfer. Experiments show that our approach sets a new state-of-the-art on public thermal FLD benchmarks, notably outperforming previous methods while drastically reducing computational overhead.

人脸检测跨模态知识蒸馏热成像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。