用两阶段方法从纹理图高效还原高质量PBR材质。
Chord: Chain of Rendering Decomposition for PBR Material Estimation from Generated Texture Images
- 分两步生成:先用微调扩散模型产纹理,再链式分解预测材质通道。
- 在合成纹理和真实照片上均表现稳健,优于现有方法。
- 支持文本/图像生成、结构引导与材质编辑,控制灵活。
材质创建与重建对外观建模至关重要,但传统方式需大量艺术家时间和专业知识。尽管近期方法利用视觉基础模型从用户输入合成PBR材质,但仍存在质量低、灵活性差、用户控制弱等问题。本文提出一种新颖的两阶段生成-估计框架用于PBR材质生成:生成阶段采用微调扩散模型,生成与用户输入对齐的着色、可平铺纹理图像;估计阶段引入链式分解方案,通过将先前提取的表示作为输入,使用单步图像条件扩散模型逐通道预测SVBRDF。该方法高效、高质量,并实现灵活用户控制。我们在多种材料生成与估计方法上进行评估,结果表明性能更优。所提材质估计方法在合成纹理与真实照片上均表现出强鲁棒性。此外,框架在文本到材质、图像到材质、结构引导生成及材质编辑等多样化应用场景中展现高度灵活性。
原文摘要 · Abstract (English)
Material creation and reconstruction are crucial for appearance modeling but traditionally require significant time and expertise from artists. While recent methods leverage visual foundation models to synthesize PBR materials from user-provided inputs, they often fall short in quality, flexibility, and user control. We propose a novel two-stage generate-and-estimate framework for PBR material generation. In the generation stage, a fine-tuned diffusion model synthesizes shaded, tileable texture images aligned with user input. In the estimation stage, we introduce a chained decomposition scheme that sequentially predicts SVBRDF channels by passing previously extracted representation as input into a single-step image-conditional diffusion model. Our method is efficient, high quality, and enables flexible user control. We evaluate our approach against existing material generation and estimation methods, demonstrating superior performance. Our material estimation method shows strong robustness on both generated textures and in-the-wild photographs. Furthermore, we highlight the flexibility of our framework across diverse applications, including text-to-material, image-to-material, structure-guided generation, and material editing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。