用扩散模型生成与网格对齐的无接缝纹理，解决视图不一致问题。
RoCoTex: A Robust Method for Consistent Texture Synthesis with Diffusion Models
- 结合SDXL和多ControlNet捕捉纹理结构与细节。
- 采用对称视图合成与区域提示提升多视角一致性。
- 创新纹理融合与软修复技术，显著减少接缝区域。
文本到纹理生成近年受到关注，但现有方法常存在视图不一致、明显接缝以及纹理与底层网格错位等问题。本文提出一种稳健的文本到纹理生成方法，可生成与网格良好对齐且无缝的一致纹理。该方法利用先进的2D扩散模型（包括SDXL和多个ControlNets）来捕捉生成纹理中的结构特征与精细细节。同时，采用对称视图合成策略并结合区域提示以增强多视角一致性。此外，引入新颖的纹理融合与软修补技术，显著减少接缝区域。大量实验表明，本方法优于现有最先进方法。
原文摘要 · Abstract (English)
Text-to-texture generation has recently attracted increasing attention, but existing methods often suffer from the problems of view inconsistencies, apparent seams, and misalignment between textures and the underlying mesh. In this paper, we propose a robust text-to-texture method for generating consistent and seamless textures that are well aligned with the mesh. Our method leverages state-of-the-art 2D diffusion models, including SDXL and multiple ControlNets, to capture structural features and intricate details in the generated textures. The method also employs a symmetrical view synthesis strategy combined with regional prompts for enhancing view consistency. Additionally, it introduces novel texture blending and soft-inpainting techniques, which significantly reduce the seam regions. Extensive experiments demonstrate that our method outperforms existing state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。