arXiv:2603.15648cs.CVcs.GR2026-03

RegGAN通过中间表征提升表情合成泛化能力,更适应未见人脸。

Improving Generative Adversarial Network Generalization for Facial Expression Synthesis

论文配图:Improving Generative Adversarial Network Generalization for Facial Expression Synthesis
图 1 · 摘自论文原文
  • 引入回归层与局部感受野,通过岭回归损失学习表情细节
  • 在CFEE及跨分布图像上表现优于6个顶尖模型,尤其在表达质量与真实感上
  • 适合需要跨类型人脸生成的场景,如名人、雕塑、虚拟形象

面部表情合成旨在生成逼真表情的同时保持身份一致。现有条件生成对抗网络(GAN)在图像到图像翻译上表现优异,但在测试图像偏离训练数据分布时性能下降。本文提出回归GAN(RegGAN),通过学习中间表示提升模型泛化能力。RegGAN包含两个部分:具有局部感受野的回归层,通过岭回归损失最小化重建误差以学习表情细节;以及对抗训练的细化网络,提升生成图像的真实感。在CFEE数据集上训练,并在CFEE及挑战性分布外图像(包括名人照片、肖像、雕像、虚拟角色渲染)上评估泛化性能。采用四种常用指标:表达分类得分(ECS)衡量表达质量,人脸相似度得分(FSS)衡量身份保留,QualiCLIP评估感知真实感,弗雷谢尔激活距离(FID)评估表达质量和真实感。RegGAN在ECS、FID和QualiCLIP上超越六种先进模型,FSS排名第二。人工评估显示,其在表达质量上比最优对比模型提升25%,身份保留提升26%,真实感提升30%。

原文摘要 · Abstract (English)

Facial expression synthesis aims to generate realistic facial expressions while preserving identity. Existing conditional generative adversarial networks (GANs) achieve excellent image-to-image translation results, but their performance often degrades when test images differ from the training dataset. We present Regression GAN (RegGAN), a model that learns an intermediate representation to improve generalization beyond the training distribution. RegGAN consists of two components: a regression layer with local receptive fields that learns expression details by minimizing the reconstruction error through a ridge regression loss, and a refinement network trained adversarially to enhance the realism of generated images. We train RegGAN on the CFEE dataset and evaluate its generalization performance both on CFEE and challenging out-of-distribution images, including celebrity photos, portraits, statues, and avatar renderings. For evaluation, we employ four widely used metrics: Expression Classification Score (ECS) for expression quality, Face Similarity Score (FSS) for identity preservation, QualiCLIP for perceptual realism, and Fréchet Inception Distance (FID) for assessing both expression quality and realism. RegGAN outperforms six state-of-the-art models in ECS, FID, and QualiCLIP, while ranking second in FSS. Human evaluations indicate that RegGAN surpasses the best competing model by 25% in expression quality, 26% in identity preservation, and 30% in realism.

表情合成GAN泛化身份保持跨分布生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。