LumiTex 生成高保真 PBR 贴图，解决光照不足与纹理不连贯问题。
LumiTex: Towards High-Fidelity PBR Texture Generation with Illumination Context
- 多分支架构分离反照率与金属/粗糙度，共享光照先验增强理解
- 光照感知注意力机制提升贴图生成的物理真实性
- 基于大视图合成模型的几何引导修复，实现无缝一致贴图补全
基于物理的渲染（PBR）为计算机图形学中的材质-光照交互提供了原则性标准。尽管近期在生成 PBR 贴图方面取得进展，现有方法仍难以应对两大核心挑战：1）在光照线索有限的情况下从图像提示中分解材质；2）实现无缝且视角一致的纹理补全。为此，我们提出 LumiTex，一个端到端框架，包含三个关键组件：(1) 多分支生成方案，在共享光照先验下解耦反照率与金属-粗糙度，以增强材质理解；(2) 光照感知材质注意力机制，在解码过程中注入光照上下文，实现反照率、金属和粗糙度图的物理合理生成；(3) 基于大规模视图合成模型的几何引导修补模块，丰富纹理覆盖并确保 UV 补全的无缝与视角一致性。大量实验表明，LumiTex 在贴图质量上达到当前最优水平，超越现有开源与商业方法。
原文摘要 · Abstract (English)
Physically-based rendering (PBR) provides a principled standard for realistic material-lighting interactions in computer graphics. Despite recent advances in generating PBR textures, existing methods fail to address two fundamental challenges: 1) materials decomposition from image prompts under limited illumination cues, and 2) seamless and view-consistent texture completion. To this end, we propose LumiTex, an end-to-end framework that comprises three key components: (1) a multi-branch generation scheme that disentangles albedo and metallic-roughness under shared illumination priors for robust material understanding, (2) a lighting-aware material attention mechanism that injects illumination context into the decoding process for physically grounded generation of albedo, metallic, and roughness maps, and (3) a geometry-guided inpainting module based on a large view synthesis model that enriches texture coverage and ensures seamless, view-consistent UV completion. Extensive experiments demonstrate that LumiTex achieves state-of-the-art performance in texture quality, surpassing both existing open-source and commercial methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。