arXiv:2412.03571cs.CV2024-12被引 9

无需训练即可快速生成风格一致的3D模型。

Style3D: Attention-guided Multi-view Style Transfer for 3D Object Generation

  • 用多视角注意力对齐内容与风格特征,保持一致性。
  • 支持即时生成,效率高于现有方法,视觉质量更优。
  • 适合需要快速生成3D风格资产的设计师或开发者。

我们提出Style3D,一种从内容图像和风格图像生成风格化3D对象的新方法。不同于需针对特定案例或风格训练的以往方法,Style3D实现即时3D风格化。核心思路是将3D风格化分解为多视角双特征对齐与稀疏视角空间重建两个相互关联的过程。引入MultiFusion Attention,通过内容图像的查询特征保持多视角几何一致性,风格图像的键和值特征引导风格迁移。该双特征对齐确保多视角图像间空间连贯性与风格保真度。最后,借助大型3D重建模型生成连贯的风格化3D物体。通过在多视角间建立结构与风格特征的协同关系,实现整体3D风格化。大量实验表明,Style3D在计算效率和视觉质量上均优于现有方法,提供更灵活、可扩展的风格一致3D资产生成方案。

原文摘要 · Abstract (English)

We present Style3D, a novel approach for generating stylized 3D objects from a content image and a style image. Unlike most previous methods that require case- or style-specific training, Style3D supports instant 3D object stylization. Our key insight is that 3D object stylization can be decomposed into two interconnected processes: multi-view dual-feature alignment and sparse-view spatial reconstruction. We introduce MultiFusion Attention, an attention-guided technique to achieve multi-view stylization from the content-style pair. Specifically, the query features from the content image preserve geometric consistency across multiple views, while the key and value features from the style image are used to guide the stylistic transfer. This dual-feature alignment ensures that spatial coherence and stylistic fidelity are maintained across multi-view images. Finally, a large 3D reconstruction model is introduced to generate coherent stylized 3D objects. By establishing an interplay between structural and stylistic features across multiple views, our approach enables a holistic 3D stylization process. Extensive experiments demonstrate that Style3D offers a more flexible and scalable solution for generating style-consistent 3D assets, surpassing existing methods in both computational efficiency and visual quality.

3D生成风格迁移多视角

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。