让3D场景纹理迁移更贴合几何结构,提升视觉真实感。
GT2-GS: Geometry-aware Texture Transfer for Gaussian Splatting
- 引入几何感知损失,结合视角与几何参数优化纹理一致性
- 自适应细粒度控制模块缓解低分辨率纹理导致的信息退化
- 新增几何保真分支,分离外观与几何优化目标,适合高精度建模
将2D纹理迁移到复杂3D场景对提升3D多媒体内容创作效率和可控性至关重要。然而,现有3D风格迁移方法多聚焦于抽象艺术风格迁移,忽视场景几何信息,难以实现高质量纹理迁移。本文提出GT2-GS,一种面向高斯点云渲染的几何感知纹理迁移框架。首先设计几何感知纹理迁移损失,利用视图依赖特征与增强几何参数的纹理特征,实现视图一致的纹理迁移;其次提出自适应细粒度控制模块,缓解低粒度纹理特征引起的场景信息退化;最后引入几何保真分支,通过附加高斯颜色先验优化几何参数,解耦外观与几何的优化目标。大量实验验证了方法的有效性与可控性。借助几何感知,本方法生成的纹理迁移结果更符合人类视觉感知。
原文摘要 · Abstract (English)
Transferring 2D textures onto complex 3D scenes plays a vital role in enhancing the efficiency and controllability of 3D multimedia content creation. However, existing 3D style transfer methods primarily focus on transferring abstract artistic styles to 3D scenes. These methods often overlook the geometric information of the scene, which makes it challenging to achieve high-quality 3D texture transfer results. In this paper, we present GT2-GS, a geometry-aware texture transfer framework for gaussian splatting. First, we propose a geometry-aware texture transfer loss that enables view-consistent texture transfer by leveraging prior view-dependent feature information and texture features augmented with additional geometric parameters. Moreover, an adaptive fine-grained control module is proposed to address the degradation of scene information caused by low-granularity texture features. Finally, a geometry preservation branch is introduced. This branch refines the geometric parameters using additionally bound Gaussian color priors, thereby decoupling the optimization objectives of appearance and geometry. Extensive experiments demonstrate the effectiveness and controllability of our method. Through geometric awareness, our approach achieves texture transfer results that better align with human visual perception. Our homepage is available at https://vpx-ecnu.github.io/GT2-GS-website.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。