arXiv:2608.01726cs.CV2026-08

用生成模型模拟骨骼动作先验,给3D高斯点云自动绑定皮肤权重。

G-Skin: Learning to Bind 3D Gaussians with Generative Visual Priors

论文配图:G-Skin: Learning to Bind 3D Gaussians with Generative Visual Priors
图 1 · 摘自论文原文
  • 基于2D视觉模型生成骨骼可控图像,提炼动作先验作为伪指导
  • 设计几何感知正则化优化流程,稳定学习并生成结构一致的权重
  • 可适配多种高斯表示变体,对未见数据泛化能力强

3D高斯点阵在逼真高效渲染方面取得显著进展,催生了大量由3D高斯原语表示的3D资产。直接为这些资产绑定任意骨骼拓扑极具吸引力,但训练前馈式绑定框架因缺乏高质量3D高斯绑定数据集而不可行。另一种方案是将基于网格的技术迁移到3D高斯表示,但3D高斯原语不受限于表面且无显式拓扑连接性,且该类方法因强依赖训练数据而泛化能力差,而获取高质量绑定数据成本高昂。为此,我们提出G-Skin,一种专为3D高斯表示设计的生成式绑定框架,实现高保真、高表达力动画。为克服3D数据稀缺问题,引入骨架可控图像生成模型,利用2D视觉基础模型将强大运动先验提炼为伪引导。在此先验指导下,构建结合几何感知正则化的优化流程,稳定学习过程并确保皮肤权重平滑、结构一致。G-Skin还可灵活适配多种用于缓解动画引发渲染伪影的3D高斯表示增强变体。大量实验验证了方法有效性,相比现有最优方法具有明显优势。

原文摘要 · Abstract (English)

3D Gaussian Splatting has achieved remarkable success in photorealistic and efficient rendering, leading to a rapid increase in 3D assets represented by 3D Gaussian primitives. Directly rigging these assets with arbitrary skeleton topologies is highly desirable. However, training a feed-forward skinning framework is infeasible due to the lack of high-quality 3D Gaussian rigging datasets. An alternative solution is to transfer mesh-based techniques to 3D Gaussian-based representation, but 3D Gaussian primitives are not restricted to the surface and lack explicit topological connectivity. Moreover, this kind of method suffers from poor generalization to unseen data due to its strong dependence on training data, while acquiring high-quality rigging data is prohibitively expensive. To address this challenging problem, we propose G-Skin, a novel generative skinning framework designed for expressive and high-fidelity animation with 3D Gaussian representation. To overcome this 3D data scarcity, we introduce a skeleton-controllable image generation model leveraging 2D vision foundation models to distill powerful motion priors into pseudo-guidance. Guided by these priors, we formulate an optimization pipeline incorporating geometry-aware regularizations, which stabilizes the learning process and ensures smooth, structurally coherent skinning weights. G-Skin also generalizes flexibly to the augmented variants of 3D Gaussian representation designed to mitigate animation-induced rendering artifacts. Extensive experiments validate the effectiveness of our approach, demonstrating clear advantages over state-of-the-art methods. Project page: https://yaoyx689.github.io/GSkin.html.

3D高斯动画绑定生成模型皮肤权重

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。