arXiv:2504.20403cs.GRcs.CV2025-04CVPR被引 6

用四面体约束高斯溅射,让普通人也能生成可编辑的逼真3D虚拟形象。

Creating Your Editable 3D Photorealistic Avatar with Tetrahedron-constrained Gaussian Splatting

  • 分三阶段优化:初始化、局部空间调整、渐进式外观生成
  • 支持精准区域定位与几何自适应,渲染结果高度逼真
  • 适合想快速创建个性化3D avatar的普通用户或虚拟试穿应用

个性化3D虚拟形象编辑因其易用性,在AR/VR和虚拟试穿等领域具有重要应用前景。以往研究在复杂重建场景中常因几何与纹理混合优化导致表示不稳定,难以生成视觉上令人满意的成果。本文提出一种面向普通用户的可编辑3D虚拟形象构建框架,实现精确区域定位、几何自适应与逼真渲染。核心方法为混合四面体约束高斯溅射(TetGS),融合四面体网格的可控显式结构与3D高斯溅射的高精度渲染能力,并采用三阶段渐进优化策略:从单目视频中实例化3D虚拟形象,提供准确先验;通过显式分割的四面体引导高斯核重分布,实现局部空间适配;基于几何的粗到精激活策略生成外观。定性与定量实验均验证了该方法在生成逼真可编辑3D虚拟形象上的有效性与优越性。

原文摘要 · Abstract (English)

Personalized 3D avatar editing holds significant promise due to its user-friendliness and availability to applications such as AR/VR and virtual try-ons. Previous studies have explored the feasibility of 3D editing, but often struggle to generate visually pleasing results, possibly due to the unstable representation learning under mixed optimization of geometry and texture in complicated reconstructed scenarios. In this paper, we aim to provide an accessible solution for ordinary users to create their editable 3D avatars with precise region localization, geometric adaptability, and photorealistic renderings. To tackle this challenge, we introduce a meticulously designed framework that decouples the editing process into local spatial adaptation and realistic appearance learning, utilizing a hybrid Tetrahedron-constrained Gaussian Splatting (TetGS) as the underlying representation. TetGS combines the controllable explicit structure of tetrahedral grids with the high-precision rendering capabilities of 3D Gaussian Splatting and is optimized in a progressive manner comprising three stages: 3D avatar instantiation from real-world monocular videos to provide accurate priors for TetGS initialization; localized spatial adaptation with explicitly partitioned tetrahedrons to guide the redistribution of Gaussian kernels; and geometry-based appearance generation with a coarse-to-fine activation strategy. Both qualitative and quantitative experiments demonstrate the effectiveness and superiority of our approach in generating photorealistic 3D editable avatars.

3D虚拟形象高斯溅射可编辑四面体约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。