用户可调节风格强度的3D风格迁移方法,提升个性化定制能力。
Tune-Your-Style: Intensity-tunable 3D Style Transfer with Gaussian Splatting
- 引入高斯神经元和可学习调制器,实现风格强度可控的3D风格迁移。
- 通过多视角一致的扩散模型生成风格化图像,优化风格与内容平衡。
- 支持灵活调节风格强度,适合需要个性化风格控制的创作者。
3D风格迁移指基于参考风格图像对3D资产进行艺术化处理。近期基于3D高斯泼溅(3DGS)的方法因训练与渲染速度显著提升而受到关注。然而,如何在保持内容真实性的同时合理融合风格图案与色彩仍是关键挑战。现有方法采用固定输出模式,难以适应不同用户对内容-风格平衡的需求。为此,本文提出可调风格强度的3D风格迁移框架Tune-Your-Style,允许用户自由调节注入场景的风格强度,以匹配其偏好。核心方法包括:1)引入高斯神经元显式建模风格强度,并设计可学习风格调制器;2)提出可调风格引导机制,利用扩散模型生成多视角一致的风格化视图,通过跨视角风格对齐,并采用两阶段优化策略,动态平衡完整风格引导与初始渲染的零风格引导。大量实验表明,该方法不仅视觉效果出色,且具备高度可定制性。项目主页:https://zhao-yian.github.io/TuneStyle。
原文摘要 · Abstract (English)
3D style transfer refers to the artistic stylization of 3D assets based on reference style images. Recently, 3DGS-based stylization methods have drawn considerable attention, primarily due to their markedly enhanced training and rendering speeds. However, a vital challenge for 3D style transfer is to strike a balance between the content and the patterns and colors of the style. Although the existing methods strive to achieve relatively balanced outcomes, the fixed-output paradigm struggles to adapt to the diverse content-style balance requirements from different users. In this work, we introduce a creative intensity-tunable 3D style transfer paradigm, dubbed \textbf{Tune-Your-Style}, which allows users to flexibly adjust the style intensity injected into the scene to match their desired content-style balance, thus enhancing the customizability of 3D style transfer. To achieve this goal, we first introduce Gaussian neurons to explicitly model the style intensity and parameterize a learnable style tuner to achieve intensity-tunable style injection. To facilitate the learning of tunable stylization, we further propose the tunable stylization guidance, which obtains multi-view consistent stylized views from diffusion models through cross-view style alignment, and then employs a two-stage optimization strategy to provide stable and efficient guidance by modulating the balance between full-style guidance from the stylized views and zero-style guidance from the initial rendering. Extensive experiments demonstrate that our method not only delivers visually appealing results, but also exhibits flexible customizability for 3D style transfer. Project page is available at https://zhao-yian.github.io/TuneStyle.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。