用小数据训练出可调控情绪强度的虚拟人表情生成模型
Emotion Intensity Matters: Generating Realistic Expressions in Virtual Humans with CVAEs

- 基于条件变分自编码器,从真实表情数据中学习情绪强度变化规律
- 仅用7680个样本即实现高保真表情生成,高低强度特征均保留
- 适合无真人表演时快速生成自然情绪表达,降低动画制作成本
在情感计算与角色动画领域,生成逼真的虚拟人面部表情仍是核心挑战。本文提出一种基于条件变分自编码器(CVAE)的新方法,利用包含六种基本情绪、每种情绪分低/高强度的实测人脸表情数据进行训练,合成可控情绪强度的虚拟表情。尽管训练数据仅7,680个样本,模型仍能学习有意义的隐空间表示,并生成语义一致的表情变化。实验表明,该模型在不同强度间保持关键表达特征,具备跨强度泛化能力,可在不依赖演员表演或人工干预的前提下,实现情感丰富的虚拟角色动画生成。
原文摘要 · Abstract (English)
Generating expressive facial behavior in virtual humans (VHs) remains a central challenge in affective computing and character animation. This paper presents a novel approach based on Conditional Variational Autoencoders (CVAEs), trained on real human facial expression data, to synthesize controllable emotional expressions at varying intensities. Using a dataset comprising six basic emotions represented at two intensity levels (low and high), we train a CVAE model to generate synthetic facial expression data while preserving semantic consistency with real human expressions. Despite the limited amount of training data (only 7,680 facial expression samples), the proposed approach learns meaningful latent representations and generates coherent emotional variations. Our method enables control over emotional intensity, making it suitable for animating virtual characters without requiring actor performances or manual artistic intervention. Our research aimed to evaluate whether the method (CVAE) preserves the characteristics associated with the different intensity levels present in the dataset. Results show that the proposed model preserves key expressive characteristics across intensity levels while supporting generalization across emotional intensity levels, contributing to the creation of emotionally expressive virtual characters from relatively small datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。