用高斯点云分布匹配实现3D场景风格迁移,无需训练
WaSt-3D: Wasserstein-2 Distance for Scene-to-Scene Stylization on 3D Gaussians
- 通过地球移动距离直接对齐风格与内容场景的高斯分布
- 在不依赖训练的情况下实现高清3D风格化效果
- 适合需要快速、高质量3D风格迁移的视觉创作人员
尽管2D图像风格迁移技术已较为成熟,但其向3D场景的扩展仍相对有限。现有方法虽能有效传递颜色和纹理,却难以复现场景几何结构。本文利用显式的高斯点阵(Gaussian Splatting, GS)表示,通过地球移动距离(Earth Mover's Distance, EMD)直接匹配风格与内容场景中高斯分布。采用熵正则化的Wasserstein-2距离,确保变换过程的空间平滑性。同时将场景风格迁移问题分解为小块以提升效率。该范式将风格迁移从依赖隐空间损失的生成过程,转变为两个高斯表示间的显式分布匹配。本方法可在无需任何训练的前提下,实现高分辨率3D风格化,忠实还原风格场景中的细节。结果在多种内容与风格组合下均保持一致性能,仅依赖优化技术完成。
原文摘要 · Abstract (English)
While style transfer techniques have been well-developed for 2D image stylization, the extension of these methods to 3D scenes remains relatively unexplored. Existing approaches demonstrate proficiency in transferring colors and textures but often struggle with replicating the geometry of the scenes. In our work, we leverage an explicit Gaussian Splatting (GS) representation and directly match the distributions of Gaussians between style and content scenes using the Earth Mover's Distance (EMD). By employing the entropy-regularized Wasserstein-2 distance, we ensure that the transformation maintains spatial smoothness. Additionally, we decompose the scene stylization problem into smaller chunks to enhance efficiency. This paradigm shift reframes stylization from a pure generative process driven by latent space losses to an explicit matching of distributions between two Gaussian representations. Our method achieves high-resolution 3D stylization by faithfully transferring details from 3D style scenes onto the content scene. Furthermore, WaSt-3D consistently delivers results across diverse content and style scenes without necessitating any training, as it relies solely on optimization-based techniques. See our project page for additional results and source code: $\href{https://compvis.github.io/wast3d/}{https://compvis.github.io/wast3d/}$.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。