arXiv:2604.13918cs.CV2026-04

用分块变形场重建可驱动人脸,能自然表现未见过的表情。

PartNerFace: Part-based Neural Radiance Fields for Animatable Facial Avatar Reconstruction

论文配图:PartNerFace: Part-based Neural Radiance Fields for Animatable Facial Avatar Reconstruction
图 1 · 摘自论文原文
  • 按面部区域分块建模形变,每个区域用独立MLP处理
  • 在未见表情上表现更好,细节更细腻,优于现有方法
  • 适合做虚拟形象、影视动画的高保真人脸建模

我们提出PartNerFace,一种基于部件的神经辐射场方法,用于从单目RGB视频重建可驱动的人脸虚拟形象。现有方法或仅用参数化头模型条件控制隐式网络,或学习虚构的基准辐射场,导致难以泛化到未见表情且无法捕捉细粒度运动细节。为此,我们首先基于参数化头模型进行逆皮肤映射,将观测点映射到基准空间,再通过分块变形场建模细粒度运动。核心洞察是不同面部区域的形变应差异化建模。具体而言,分块变形场由多个局部MLP组成,自适应地将基准空间划分为不同区域,3D点的形变通过所有局部MLP的预测并采用软加权机制聚合得到。大量实验表明,本方法在未见表情上具有良好泛化能力,能精准建模细粒度面部运动,定量与定性结果均优于当前最优方法。

原文摘要 · Abstract (English)

We present PartNerFace, a part-based neural radiance fields approach, for reconstructing animatable facial avatar from monocular RGB videos. Existing solutions either simply condition the implicit network with the morphable model parameters or learn an imaginary canonical radiance field, making them fail to generalize to unseen facial expressions and capture fine-scale motion details. To address these challenges, we first apply inverse skinning based on a parametric head model to map an observed point to the canonical space, and then model fine-scale motions with a part-based deformation field. Our key insight is that the deformation of different facial parts should be modeled differently. Specifically, our part-based deformation field consists of multiple local MLPs to adaptively partition the canonical space into different parts, where the deformation of a 3D point is computed by aggregating the prediction of all local MLPs by a soft-weighting mechanism. Extensive experiments demonstrate that our method generalizes well to unseen expressions and is capable of modeling fine-scale facial motions, outperforming state-of-the-art methods both quantitatively and qualitatively.

人脸重建神经辐射场可驱动模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。