用多视角扩散模型生成高精度3D纹理，支持几何对齐与真实渲染。
MVPainter: Accurate and Detailed 3D Texture Generation via Multi-View Diffusion with Geometric Control
- 通过控制网实现几何引导的多视角纹理生成
- 在对齐、一致性和局部细节上均达当前最优
- 输出可直接用于真实场景渲染的PBR材质
近期3D物体生成取得显著进展。现有流程通常先生成3D几何体，再用图像扩散模型生成多视角RGB图像，最后通过纹理烘焙重建UV纹理。尽管3D几何生成已大幅提升，但3D纹理生成仍缺乏深入研究。本文系统考察了三个核心维度：参考纹理对齐、几何-纹理一致性及局部纹理质量。为此提出MVPainter，采用数据过滤与增强策略提升纹理保真度与细节，并引入基于ControlNet的几何条件控制以改善纹理-几何对齐。此外，从生成视图中提取物理基础渲染（PBR）属性，生成适用于真实渲染的PBR网格。MVPainter在三项指标上均达到当前最优，经人工评估验证。为促进后续研究与复现，我们开源完整流程，包含数据构建、模型架构与评估工具。
原文摘要 · Abstract (English)
Recently, significant advances have been made in 3D object generation. Building upon the generated geometry, current pipelines typically employ image diffusion models to generate multi-view RGB images, followed by UV texture reconstruction through texture baking. While 3D geometry generation has improved significantly, supported by multiple open-source frameworks, 3D texture generation remains underexplored. In this work, we systematically investigate 3D texture generation through the lens of three core dimensions: reference-texture alignment, geometry-texture consistency, and local texture quality. To tackle these issues, we propose MVPainter, which employs data filtering and augmentation strategies to enhance texture fidelity and detail, and introduces ControlNet-based geometric conditioning to improve texture-geometry alignment. Furthermore, we extract physically-based rendering (PBR) attributes from the generated views to produce PBR meshes suitable for real-world rendering applications. MVPainter achieves state-of-the-art results across all three dimensions, as demonstrated by human-aligned evaluations. To facilitate further research and reproducibility, we also release our full pipeline as an open-source system, including data construction, model architecture, and evaluation tools.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。