arXiv:2603.08228cs.CV2026-03

用角色参考图生成3D服装纹理,无需对齐即可保持全局一致性。

GarmentPainter: Efficient 3D Garment Texture Synthesis with Character-Guided Diffusion Model

  • 以UV位置图为3D结构引导,确保纹理生成时的表面一致性。
  • 支持按服装部件细粒度控制,仅需角色参考图,不依赖图像与模型对齐。
  • 直接融合多类引导信号,不修改网络结构,效率高且效果领先。

高保真、3D一致的服装纹理生成因服装结构复杂性和对细节全局一致性的严苛要求而极具挑战。现有方法或依赖2D扩散模型(难以保证3D一致性),或需昂贵的多步优化,或严格依赖2D参考图与3D网格的空间对齐,限制了灵活性与可扩展性。本文提出GarmentPainter,一种在UV空间中高效生成高质量3D感知服装纹理的框架。该方法利用UV位置图作为3D结构引导,确保纹理生成过程中的表面一致性。为提升可控性与适应性,引入类型选择模块,可根据角色参考图实现特定服装组件的细粒度纹理生成,无需参考图与3D网格对齐。GarmentPainter将所有引导信号以空间对齐方式融入扩散模型输入,不修改底层UNet架构。大量实验表明,该方法在视觉保真度、3D一致性和计算效率方面均达到当前最优,定性与定量评估全面优于现有方法。

原文摘要 · Abstract (English)

Generating high-fidelity, 3D-consistent garment textures remains a challenging problem due to the inherent complexities of garment structures and the stringent requirement for detailed, globally consistent texture synthesis. Existing approaches either rely on 2D-based diffusion models, which inherently struggle with 3D consistency, require expensive multi-step optimization or depend on strict spatial alignment between 2D reference images and 3D meshes, which limits their flexibility and scalability. In this work, we introduce GarmentPainter, a simple yet efficient framework for synthesizing high-quality, 3D-aware garment textures in UV space. Our method leverages a UV position map as the 3D structural guidance, ensuring texture consistency across the garment surface during texture generation. To enhance control and adaptability, we introduce a type selection module, enabling fine-grained texture generation for specific garment components based on a character reference image, without requiring alignment between the reference image and the 3D mesh. GarmentPainter efficiently integrates all guidance signals into the input of a diffusion model in a spatially aligned manner, without modifying the underlying UNet architecture. Extensive experiments demonstrate that GarmentPainter achieves state-of-the-art performance in terms of visual fidelity, 3D consistency, and computational efficiency, outperforming existing methods in both qualitative and quantitative evaluations.

服装生成扩散模型3D纹理图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。