arXiv:2603.14781cs.CV2026-03

用文本控制精细表情,生成高保真3D人脸形象

High-Fidelity 3D Facial Avatar Synthesis with Controllable Fine-Grained Expressions

  • 双映射模块分别优化纹理和表情参数
  • 通过文本提示实现对细微表情的精准调控
  • 适合需要精细表情编辑的虚拟人开发

面部表情编辑方法主要分为基于2D和基于3D的两类。前者缺乏3D建模能力,难以有效编辑3D属性;后者虽能利用单视角2D图像生成高质量且视角一致的渲染结果,但在精细表情控制上仍有不足。为此,本文提出一种新方法:同时优化预训练3D-Aware GAN模型的隐空间代码(用于纹理编辑)和驱动3DMM模型的表情代码(用于网格编辑)。具体地,设计了双映射模块——纹理映射器与情绪映射器,分别学习输入隐码在纹理和网格上的变换。为优化该模块,引入基于CLIP的文本引导优化方法,以表情文本提示为目标函数,并结合子空间投影机制将文本嵌入映射至表情子空间,从而实现更精确的细粒度表情控制。大量实验与对比分析验证了方法的有效性与优越性。

原文摘要 · Abstract (English)

Facial expression editing methods can be mainly categorized into two types based on their architectures: 2D-based and 3D-based methods. The former lacks 3D face modeling capabilities, making it difficult to edit 3D factors effectively. The latter has demonstrated superior performance in generating high-quality and view-consistent renderings using single-view 2D face images. Although these methods have successfully used animatable models to control facial expressions, they still have limitations in achieving precise control over fine-grained expressions. To address this issue, in this paper, we propose a novel approach by simultaneously refining both the latent code of a pretrained 3D-Aware GAN model for texture editing and the expression code of the driven 3DMM model for mesh editing. Specifically, we introduce a Dual Mappers module, comprising Texture Mapper and Emotion Mapper, to learn the transformations of the given latent code for textures and the expression code for meshes, respectively. To optimize the Dual Mappers, we propose a Text-Guided Optimization method, leveraging a CLIP-based objective function with expression text prompts as targets, while integrating a SubSpace Projection mechanism to project the text embedding to the expression subspace such that we can have more precise control over fine-grained expressions. Extensive experiments and comparative analyses demonstrate the effectiveness and superiority of our proposed method.

3D人脸表情控制生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。