将高斯点云与纹理映射结合，实现可编辑、可光照重演的逼真头像重建。
GTAvatar: Bridging Gaussian Splatting and Texture Mapping for Relightable and Editable Gaussian Avatars
- 用高效的UV映射方式将高斯原语嵌入模板网格，实现连续可编辑材质贴图。
- 仅需单目视频即可重建头像，支持物理光照模型下的高质量重光照。
- 适合需要直观外观修改的影视特效与虚拟会议场景使用。
近年来，高斯点云技术实现了越来越精准的逼真头部头像重建，为视觉特效、视频会议和虚拟现实等应用打开了新可能。然而，其缺乏传统三角网格方法所具备的直观可编辑性。为此，我们提出一种方法，将二维高斯点云的精度与保真度，与UV纹理映射的直观性相结合。通过高效地将每个规范高斯原语的局部坐标系嵌入模板网格的UV空间，我们仅需单目视频即可在标准UV域上重建连续可编辑的材质头像。此外，我们采用高效的基于物理的反射模型，实现对这些固有材质图的重光照与编辑。大量实验对比表明，我们的方法在重建精度、重光照质量以及通过纹理映射进行外观与几何修改的直观控制方面均表现优异，且无需额外优化。
原文摘要 · Abstract (English)
Recent advancements in Gaussian Splatting have enabled increasingly accurate reconstruction of photorealistic head avatars, opening the door to numerous applications in visual effects, videoconferencing, and virtual reality. This, however, comes with the lack of intuitive editability offered by traditional triangle mesh-based methods. In contrast, we propose a method that combines the accuracy and fidelity of 2D Gaussian Splatting with the intuitiveness of UV texture mapping. By embedding each canonical Gaussian primitive's local frame into a patch in the UV space of a template mesh in a computationally efficient manner, we reconstruct continuous editable material head textures from a single monocular video on a conventional UV domain. Furthermore, we leverage an efficient physically based reflectance model to enable relighting and editing of these intrinsic material maps. Through extensive comparisons with state-of-the-art methods, we demonstrate the accuracy of our reconstructions, the quality of our relighting results, and the ability to provide intuitive controls for modifying an avatar's appearance and geometry via texture mapping without additional optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。