arXiv:2506.02620cs.GRcs.CV2025-06被引 6

FlexPainter实现多视角纹理生成一致性与灵活控制。

FlexPainter: Flexible and Multi-View Consistent Texture Generation

  • 构建共享条件嵌入空间,融合多模态输入指导生成。
  • 多视图同步与自适应加权提升局部一致性,生成高质量纹理。
  • 适合需要精细控制和高一致性的3D纹理设计人员使用。

纹理贴图生成是3D建模中决定渲染质量的关键环节。近年来,基于扩散的方法为纹理生成提供了新路径,但受限于控制灵活性不足和提示模态有限,难以生成理想结果。此外,多视图生成间的不一致性常导致纹理质量下降。为此,我们提出 extbf{FlexPainter},一个支持灵活多模态条件引导的纹理生成框架,实现高度一致的纹理生成。通过构建共享条件嵌入空间,实现不同输入模态的灵活融合;利用该空间,提出基于图像的CFG方法,分离结构与风格信息,实现参考图像风格化。借助图像扩散先验中的3D知识,采用网格表示同时生成多视图图像以增强全局理解;同时,在扩散采样过程中引入视图同步与自适应加权模块,进一步保障局部一致性。最后,结合3D感知纹理补全模型与纹理增强模型,生成无缝且高分辨率的纹理贴图。大量实验表明,本框架在灵活性与生成质量上显著优于现有最优方法。

原文摘要 · Abstract (English)

Texture map production is an important part of 3D modeling and determines the rendering quality. Recently, diffusion-based methods have opened a new way for texture generation. However, restricted control flexibility and limited prompt modalities may prevent creators from producing desired results. Furthermore, inconsistencies between generated multi-view images often lead to poor texture generation quality. To address these issues, we introduce \textbf{FlexPainter}, a novel texture generation pipeline that enables flexible multi-modal conditional guidance and achieves highly consistent texture generation. A shared conditional embedding space is constructed to perform flexible aggregation between different input modalities. Utilizing such embedding space, we present an image-based CFG method to decompose structural and style information, achieving reference image-based stylization. Leveraging the 3D knowledge within the image diffusion prior, we first generate multi-view images simultaneously using a grid representation to enhance global understanding. Meanwhile, we propose a view synchronization and adaptive weighting module during diffusion sampling to further ensure local consistency. Finally, a 3D-aware texture completion model combined with a texture enhancement model is used to generate seamless, high-resolution texture maps. Comprehensive experiments demonstrate that our framework significantly outperforms state-of-the-art methods in both flexibility and generation quality.

纹理生成扩散模型多视图一致3D建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。