arXiv:2605.20185cs.GRcs.CV2026-05

用神经场解耦身体模板,让虚拟人像自由呈现复杂衣物动态。

PiG-Avatar: Hierarchical Neural-Field-Guided Gaussian Avatars

论文配图:PiG-Avatar: Hierarchical Neural-Field-Guided Gaussian Avatars
图 1 · 摘自论文原文
  • 以神经场构建体积化空间,高斯点锚定其上实现无拓扑束缚建模
  • 通过三维重心传输保持动作一致性,支持真实衣物形变与稳定时序对应
  • 自动聚类高曲率/高变化区域,无需人工设定即可生成多层次细节

现有高斯虚拟人方法通常在身体模板表面参数化几何,导致表示空间与模板形变空间耦合,难以捕捉分层、非贴身及非刚性衣物结构。本文提出PiG-Avatar,仅将参数化人体模型用于运动传输,而将虚拟人表示为锚定在由连续神经场控制的体积化规范空间中的高斯点。该方法解耦了表示与模板拓扑,突破了基于表面参数化的几何限制。通过3D重心锚点传输维持运动一致性,允许锚点自由偏离模板表面,自然形成密集且稳定的时序表面对应关系。为使此无约束形式可训练,引入双层次空间一致优化:结合Sobolev预条件神经场更新与新颖的KNN预条件规范锚点几何。两者共同促成锚点密度的自组织演化——锚点自发迁移至高曲率、外观变化显著及运动不一致区域,无需显式启发式规则。由此,复杂衣物结构和分层表面作为自然高保真输出出现。该统一表示还支持多层级细节的分层重建,粗粒度监督通过共享神经场与耦合锚点图传递至细粒度层级。在包含复杂衣物与挑战性非刚性运动的基准测试中,PiG-Avatar达到最优渲染质量,对不完美人体模型初始化具有鲁棒泛化能力,并可在所有细节层级实现实时渲染。

原文摘要 · Abstract (English)

Existing Gaussian avatar methods typically parameterize geometry on a body-template surface, which entangles the avatar's representation space with the template's deformation space and limits the capture of layered, off-body, and non-rigid clothing geometry. We present PiG-Avatar, which addresses this limitation by using the parametric body model solely for kinematic transport, while representing the avatar as Gaussians anchored in a volumetric canonical space governed by a continuous neural field. This decouples representation from template topology, avoiding the geometric constraints of surface-based parameterizations. Kinematic coherence is maintained through 3D barycentric anchor transport, which guides motion without constraining geometry and allows anchors to deviate freely from the template surface, yielding dense, stable temporal surface correspondences by construction. To make this unconstrained formulation tractable, we introduce dual-level spatially coherent optimization, combining Sobolev-preconditioned neural-field updates with a novel KNN-based preconditioning of canonical anchor geometry. Together, these mechanisms induce an emergent self-organization of anchor density: anchors migrate toward regions of high curvature, appearance variation, and non-coherent motion without explicit heuristics. As a result, complex clothing geometry and layered surfaces emerge as natural, high-fidelity outputs. This single representation further supports hierarchical reconstruction across multiple levels of detail, with coarse-level supervision propagating to finer levels through the shared field and coupled anchor graph. On established benchmarks featuring subjects with complex clothing and challenging non-rigid motion, PiG-Avatar achieves state-of-the-art rendering quality, generalizes robustly to imperfect body model initialization, and renders in real time across all detail levels.

虚拟人像神经场高斯表示动作同步

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。