让人脸表情生成保持身份一致,解决少样本下表情失真问题
Identity-Consistent Expression Fields: A Disentangled Neural Radiance Field Framework for Few-Shot Facial Expression Synthesis
- 分离身份与表情特征,仅修改表达相关区域
- 新正则化约束使身份细节不随表情变化而漂移
- 适合需要高保真身份一致的人脸动画应用
神经辐射场(NeRF)已实现3D场景的逼真新视角合成,并被拓展至从少量图像中重建和动画化3D人脸。然而,现有少样本动态NeRF方法通常基于目标表情参数对单一学习特征体进行变形,导致当驱动至远超输入样本范围的表情时,身份特有外观细节(如皮肤纹理、精细几何结构)出现漂移。本文提出身份一致的表情场(ICEF),显式分离静态身份特异性辐射成分与动态表达条件变形成分,并引入身份保持正则化,约束变形网络仅修改表达相关区域,保留身份不变的原始外观。ICEF还加入置信度加权条件特征扭曲步骤,对远离输入表达参数空间的目标表达降低不可靠扭曲权重,缓解了先前方法在表达外推时的伪影。本文关联了该工作与先前少样本动态NeRF、静态3D感知人脸生成及解耦人脸编辑辐射场方法,并设计评估协议,同时衡量新表情渲染质量与不同表达参数外推距离下的身份一致性指标。
原文摘要 · Abstract (English)
Neural Radiance Fields (NeRF) have enabled photorealistic novel-view synthesis of 3D scenes and, in the facial domain, have been extended to reconstruct and animate 3D face models from a small number of images. However, existing few-shot dynamic NeRF methods for facial expression editing typically warp a single learned feature volume conditioned on target expression parameters, which can cause identity-specific appearance details (skin texture, fine geometric structure) to drift when the model is driven toward expressions far from those seen in the few-shot input set. We propose Identity-Consistent Expression Fields (ICEF), a framework that explicitly disentangles a static, identity-specific radiance component from a dynamic, expression-conditioned deformation component, and introduces an identity preservation regularizer that constrains the deformation network to modify only expression-relevant regions while leaving identity-specific canonical appearance untouched. ICEF further incorporates a confidence-weighted conditional feature warping step that down-weights unreliable warps for target expressions that are far, in parameter space, from the observed few-shot inputs, mitigating artifacts observed in prior few-shot dynamic NeRF methods when extrapolating to novel expressions. We relate ICEF to prior few-shot dynamic NeRF, static 3D-aware face generation, and disentangled face-editing radiance field methods, and describe an evaluation protocol measuring both novel-expression rendering quality and, specifically, identity-consistency metrics across a range of expression-parameter extrapolation distances.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。