用参数化方法生成可穿、高保真的3D服装,避免自交问题。
GarmentX: Autoregressive Parametric Representations for High-Fidelity 3D Garment Generation
- 通过自回归模型逐个预测服装参数,保证结构合理。
- 在37.8万对图像-参数数据上训练,生成效果优于现有方法。
- 适合服装设计、虚拟试衣等需要高质量3D建模的场景。
本文提出GarmentX,一种从单张输入图像生成多样、高保真且可穿戴的3D服装的新框架。传统方法直接预测2D裁剪边及其连接关系,过于自由导致严重自交和物理不可行结构。GarmentX引入与GarmentCode兼容的结构化可编辑参数表示,确保解码后的缝制图案始终形成有效、可仿真的3D服装,并支持直观修改服装形状与风格。为此,采用掩码自回归模型,分步预测服装参数,利用自回归建模实现结构化生成,同时缓解直接预测图案带来的不一致性。此外,我们构建了大规模的GarmentX数据集,包含378,682对服装参数-图像样本,通过自动数据生成流程合成多样且高质量的服装图像,条件基于参数化服装表示。结合本方法与数据集,在几何保真度和输入图像对齐方面达到当前最优性能,显著超越先前方法。论文发表后将公开GarmentX数据集。
原文摘要 · Abstract (English)
This work presents GarmentX, a novel framework for generating diverse, high-fidelity, and wearable 3D garments from a single input image. Traditional garment reconstruction methods directly predict 2D pattern edges and their connectivity, an overly unconstrained approach that often leads to severe self-intersections and physically implausible garment structures. In contrast, GarmentX introduces a structured and editable parametric representation compatible with GarmentCode, ensuring that the decoded sewing patterns always form valid, simulation-ready 3D garments while allowing for intuitive modifications of garment shape and style. To achieve this, we employ a masked autoregressive model that sequentially predicts garment parameters, leveraging autoregressive modeling for structured generation while mitigating inconsistencies in direct pattern prediction. Additionally, we introduce GarmentX dataset, a large-scale dataset of 378,682 garment parameter-image pairs, constructed through an automatic data generation pipeline that synthesizes diverse and high-quality garment images conditioned on parametric garment representations. Through integrating our method with GarmentX dataset, we achieve state-of-the-art performance in geometric fidelity and input image alignment, significantly outperforming prior approaches. We will release GarmentX dataset upon publication.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。