用多视角提示生成高质量3D纹理，解决视角不一致和遮挡区域缺图问题。
MV2UV: Generating High-quality UV Texture Maps with Multiview Prompts
- 在UV空间中联合建模多视角图像，同步修复不一致与缺失区域。
- 在未见遮挡和视角不一致区域的纹理生成质量优于现有方法。
- 适合需要高保真3D纹理生成的场景，如游戏、影视建模。
为3D资产生成高质量纹理是一项挑战性任务。现有多视角纹理生成方法存在视角不一致和未见区域缺图的问题，而基于UV补全的方法因缺乏足够的UV数据，难以有效利用2D图像扩散先验，泛化能力差。本文提出一种名为MV2UV的新方法，结合多视角生成的2D生成先验与UV精修的补全能力，生成高质量纹理图。核心思想是构建一个在UV空间中运行的生成模型，能够同时补全多视角图像中未见部分并解决视角间不一致性。实验表明，该方法在未见遮挡及多视角不一致区域的纹理生成质量上显著优于现有方法。
原文摘要 · Abstract (English)
Generating high-quality textures for 3D assets is a challenging task. Existing multiview texture generation methods suffer from the multiview inconsistency and missing textures on unseen parts, while UV inpainting texture methods do not generalize well due to insufficient UV data and cannot well utilize 2D image diffusion priors. In this paper, we propose a new method called MV2UV that combines 2D generative priors from multiview generation and the inpainting ability of UV refinement to get high-quality texture maps. Our key idea is to adopt a UV space generative model that simultaneously inpaints unseen parts of multiview images while resolving the inconsistency of multiview images. Experiments show that our method enables a better texture generation quality than existing methods, especially in unseen occluded and multiview-inconsistent parts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。