arXiv:2601.03319cs.GRcs.AI2026-01

用高斯曲率夸张人脸3D形态,实现可控逼真漫画化效果。

CaricatureGS: Exaggerating 3D Gaussian Splatting Faces With Gaussian Curvature

  • 基于高斯曲率加权泊松方程变形人脸表面,生成夸张几何形态。
  • 通过合成伪真值图像训练,使单个高斯集合同时表达真实与夸张人脸。
  • 支持局部编辑和实时连续控制夸张强度,适合动画与虚拟形象创作。

本文提出一种可控制的逼真3D人脸漫画化框架。首先基于高斯曲率构建表面夸张方法,但直接结合纹理会导致渲染过平滑。为此引入3D高斯溅射(3DGS),利用多视角序列提取FLAME网格,求解加权泊松方程获得夸张形变。为解决直接变形效果差的问题,通过局部仿射变换将每帧扭曲至夸张二维表示,合成伪真值图像。设计交替监督训练策略,使单一高斯集合能同时表征自然与夸张人脸。该方法提升保真度,支持局部编辑,并实现夸张强度的连续控制。为实现实时形变,引入原形与夸张形之间的高效插值,分析表明其偏差有界。定量与定性评估均优于现有方法,生成具有几何控制的逼真漫画化3D角色。

原文摘要 · Abstract (English)

A photorealistic and controllable 3D caricaturization framework for faces is introduced. We start with an intrinsic Gaussian curvature-based surface exaggeration technique, which, when coupled with texture, tends to produce over-smoothed renders. To address this, we resort to 3D Gaussian Splatting (3DGS), which has recently been shown to produce realistic free-viewpoint avatars. Given a multiview sequence, we extract a FLAME mesh, solve a curvature-weighted Poisson equation, and obtain its exaggerated form. However, directly deforming the Gaussians yields poor results, necessitating the synthesis of pseudo-ground-truth caricature images by warping each frame to its exaggerated 2D representation using local affine transformations. We then devise a training scheme that alternates real and synthesized supervision, enabling a single Gaussian collection to represent both natural and exaggerated avatars. This scheme improves fidelity, supports local edits, and allows continuous control over the intensity of the caricature. In order to achieve real-time deformations, an efficient interpolation between the original and exaggerated surfaces is introduced. We further analyze and show that it has a bounded deviation from closed-form solutions. In both quantitative and qualitative evaluations, our results outperform prior work, delivering photorealistic, geometry-controlled caricature avatars.

3D生成人脸建模高斯溅射卡通化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。