arXiv:2511.18765cs.CVcs.AI2025-11中稿 · CVPR被引 1

解决3D服装纹理生成中图像与网格非一致形变问题,实现跨姿态高质量纹理合成。

NI-Tex: Non-isometric Image-based Garment Texture Generation

  • 构建服装中心的3D服装视频数据集,支持多变形下的几何与材质一致性监督。
  • 采用纳米香蕉技术实现非等距图像间的高保真纹理编辑,突破拓扑限制。
  • 通过不确定性引导的视角选择与重加权,融合多视角预测生成无缝生产级PBR纹理。

现有工业级3D服装网格已覆盖多数真实衣物几何形态,但其纹理多样性仍受限。为获取更真实的纹理,常通过生成方法从大量自然图像中提取基于物理的渲染(PBR)纹理与材质,并投影回服装网格。然而,多数图像条件纹理生成方法要求输入图像与3D网格之间具有严格的拓扑一致性,或依赖精确的网格变形以匹配图像姿态,严重制约了纹理生成质量与灵活性。为解决非等距图像驱动的服装纹理生成难题,我们构建了3D Garment Videos数据集,该数据集通过物理模拟提供跨多样化形变的一致几何与材质监督,支持鲁棒的跨姿态纹理学习。进一步采用Nano Banana实现高质量非等距图像编辑,成功实现非等距图像-几何对之间的可靠纹理生成。最后,提出一种基于不确定性引导视角选择与重加权的迭代烘焙方法,将多视角预测融合为无缝、可直接用于生产的PBR纹理。大量实验表明,所提出的前馈双分支架构能生成多样且空间对齐的PBR材质,适用于工业级3D服装设计。

原文摘要 · Abstract (English)

Existing industrial 3D garment meshes already cover most real-world clothing geometries, yet their texture diversity remains limited. To acquire more realistic textures, generative methods are often used to extract Physically-based Rendering (PBR) textures and materials from large collections of wild images and project them back onto garment meshes. However, most image-conditioned texture generation approaches require strict topological consistency between the input image and the input 3D mesh, or rely on accurate mesh deformation to match to the image poses, which significantly constrains the texture generation quality and flexibility. To address the challenging problem of non-isometric image-based garment texture generation, we construct 3D Garment Videos, a physically simulated, garment-centric dataset that provides consistent geometry and material supervision across diverse deformations, enabling robust cross-pose texture learning. We further employ Nano Banana for high-quality non-isometric image editing, achieving reliable cross-topology texture generation between non-isometric image-geometry pairs. Finally, we propose an iterative baking method via uncertainty-guided view selection and reweighting that fuses multi-view predictions into seamless, production-ready PBR textures. Through extensive experiments, we demonstrate that our feedforward dual-branch architecture generates versatile and spatially aligned PBR materials suitable for industry-level 3D garment design.

纹理生成3D服装非等距映射PBR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。