arXiv:2508.09202cs.CVcs.AI2025-08被引 10

无需源数据和生成图像,用隐空间翻译实现个性化表情识别

Personalized Feature Translation for Expression Recognition: An Efficient Source-Free Domain Adaptation Method

  • 在隐空间设计风格翻译器,保留表情信息同时迁移个体特征
  • 仅用中性表情目标数据,性能超越现有最先进方法
  • 适合隐私敏感场景,计算高效且无需生成面部图像

面部表情识别(FER)模型广泛应用于人机交互与健康监测等视频情感计算场景。然而,深度FER模型常因细微表情和高个体差异导致真实环境性能受限。无源域适应(SFDA)通过仅使用未标注目标数据个性化预训练模型,规避了隐私、存储与传输问题。本文针对源数据不可用且目标数据仅含中性表情的极端情况,提出无源域适应下的个性化特征翻译方法(SFDA-PFT)。该方法首先在源数据上预训练一个翻译器,实现跨个体风格特征迁移并保持表情一致性;随后在无需源数据或图像生成的前提下,适配至中性目标数据。由于在隐空间操作,SFDA-PFT避免了噪声图像生成,降低计算开销,并学习更具判别性的嵌入表示。在BioVid、StressID、BAH与Aff-Wild2数据集上的实验表明,该方法在隐私敏感的FER场景中持续优于现有最优的SFDA方法。代码已公开于GitHub。

原文摘要 · Abstract (English)

Facial expression recognition (FER) models are widely used in video-based affective computing applications, such as human-computer interaction and healthcare monitoring. However, deep FER models often struggle with subtle expressions and high inter-subject variability, limiting performance in real-world settings. Source-free domain adaptation (SFDA) has been proposed to personalize a pretrained source model using only unlabeled target data, avoiding privacy, storage, and transmission constraints. We address a particularly challenging setting where source data is unavailable and the target data contains only neutral expressions. Existing SFDA methods are not designed for adaptation from a single target class, while generating non-neutral facial images is often unstable and expensive. To address this, we propose Source-Free Domain Adaptation with Personalized Feature Translation (SFDA-PFT), a lightweight latent-space approach. A translator is first pretrained on source data to map subject-specific style features between subjects while preserving expression information through expression-consistency and style-aware objectives. It is then adapted to neutral target data without source data or image synthesis. By operating in the latent space, SFDA-PFT avoids noisy facial image generation, reduces computation, and learns discriminative embeddings for classification. Experiments on BioVid, StressID, BAH, and Aff-Wild2 show that SFDA-PFT consistently outperforms state-of-the-art SFDA methods in privacy-sensitive FER scenarios. Our code is publicly available at: \href{https://github.com/MasoumehSharafi/SFDA-PFT}{GitHub}.

表情识别域适应隐空间轻量级

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。