arXiv:2508.08136cs.CV2025-08AAAI被引 4

用扩散模型蒸馏实现3D高斯点云可控风格迁移,解决多视角不一致和内容泄露问题。

FantasyStyle: Controllable Stylized Distillation for 3D Gaussian Splatting

  • 基于扩散模型蒸馏,避免依赖VGG特征
  • 通过频域滤波提升多视角风格一致性
  • 引入负向引导抑制内容泄露,支持可控风格生成

3D高斯点云(3DGS)在生成与编辑应用中的成功激发了基于3DGS的风格迁移研究兴趣。然而,现有方法仍面临两大挑战:(1) 多视角不一致常导致风格冲突,造成外观平滑与畸变;(2) 过度依赖VGG特征,难以分离风格与内容,易引发内容泄露与过度风格化。为此,我们提出FantasyStyle,首个完全基于扩散模型蒸馏的3DGS风格迁移框架。其核心包含两部分:(1) 多视角频率一致性——对多视角噪声隐空间应用3D滤波器,选择性抑制低频成分以缓解风格先验冲突;(2) 可控风格蒸馏——引入负向引导排除不需要的内容,并识别出Score Distillation Sampling与Delta Denoising Score在3D风格迁移中的局限性,移除重建项。基于此,我们提出一种可控制的风格蒸馏机制,更有效地优化3D高斯分布。大量实验表明,本方法持续优于当前最优方案,在多种场景与风格下均实现更高风格质量与视觉真实感。代码已开源。

原文摘要 · Abstract (English)

The success of 3DGS in generative and editing applications has sparked growing interest in 3DGS-based style transfer. However, current methods still face two major challenges: (1) multi-view inconsistency often leads to style conflicts, resulting in appearance smoothing and distortion; and (2) heavy reliance on VGG features, which struggle to disentangle style and content from style images, often causing content leakage and excessive stylization. To tackle these issues, we introduce \textbf{FantasyStyle}, a 3DGS-based style transfer framework, and the first to rely entirely on diffusion model distillation. It comprises two key components: (1) \textbf{Multi-View Frequency Consistency}. We enhance cross-view consistency by applying a 3D filter to multi-view noisy latent, selectively reducing low-frequency components to mitigate stylized prior conflicts. (2) \textbf{Controllable Stylized Distillation}. To suppress content leakage from style images, we introduce negative guidance to exclude undesired content. In addition, we identify the limitations of Score Distillation Sampling and Delta Denoising Score in 3D style transfer and remove the reconstruction term accordingly. Building on these insights, we propose a controllable stylized distillation that leverages negative guidance to more effectively optimize the 3D Gaussians. Extensive experiments demonstrate that our method consistently outperforms state-of-the-art approaches, achieving higher stylization quality and visual realism across various scenes and styles. The code is available at https://github.com/yangyt46/FantasyStyle.

3D生成风格迁移扩散模型高斯点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。