arXiv:2606.05912cs.CV2026-06

用自监督学习让3D高斯人脸仅凭少量数据就能高保真动画

Self-Learning Expression Deformations for Data-Efficient Gaussian Avatars

论文配图:Self-Learning Expression Deformations for Data-Efficient Gaussian Avatars
图 1 · 摘自论文原文
  • 通过联合优化高斯点与SDF,实现紧凑贴合表面的表达变形
  • 单帧或多视角旋转即可生成高质量可动画人脸,数据量降几个数量级
  • 适合追求低数据成本的实时虚拟人开发与个性化头像创建

使用3D高斯表示建模动态面部表情仍面临挑战,因其结构不规则。传统高斯头像流程需大量多视角及序列化表情数据,限制了可扩展性与可及性。本文提出自适应高斯表达(SAGE)框架,实现自学习的表情驱动高斯变形,可在极简输入下生成高保真、可动画的虚拟形象。方法联合优化2D高斯点和有符号距离场(SDF),以强制高斯分布紧凑且贴合表面;同时引入自监督表达学习阶段,用几何与外观一致性约束替代长时间训练序列。该设计支持多种重建模式:在多视角设置中,仅需单帧而非数千帧;在单目设置中,仅需头部旋转数据,无需表情序列;在一次性设置中,无需预训练或先验知识。实验表明,本方法在重建与动画质量上媲美现有最优水平,但数据需求降低数个数量级。结果凸显自监督高斯变形学习在实现低成本、高可及性虚拟人创作中的潜力。

原文摘要 · Abstract (English)

Modeling dynamic facial expressions using 3D Gaussian representations remains challenging due to their unstructured nature. Conventional Gaussian avatar pipelines require extensive multiview and sequential expression data, limiting scalability and accessibility. In this work, we introduce Self-Adaptive Gaussian Expression (SAGE), a framework for self-learning expression-induced Gaussian deformations that enables high-fidelity, animatable avatars from minimal input data. Our method jointly optimizes 2D Gaussian surfels and a Signed Distance Field (SDF) to enforce compact, surface-aligned Gaussian distributions, while a self-supervised expression learning phase replaces long training sequences with geometric and appearance consistency constraints. This design allows flexible deployment across multiple reconstruction regimes: in the multiview setting, only a single frame (timestep) is required instead of thousands; in the monocular setting, only head rotations are needed without expression sequences; and in the one-shot setting, no pretraining or priors are necessary. Experiments demonstrate that our approach achieves reconstruction and animation quality comparable to state-of-the-art methods, while reducing data requirements by several orders of magnitude. Our results highlight the potential of self-supervised Gaussian deformation learning as a step toward accessible, data-efficient avatar creation.

3D高斯虚拟人自监督低数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。