arXiv:2607.23189cs.CVcs.AI2026-07

用2D设计元素生成可物理模拟的3D服装,支持虚拟试穿。

Fashion-3DLR: A Controllable 3D Garment Generation Using Pairwise Fashion Elements for Intelligent Design

论文配图:Fashion-3DLR: A Controllable 3D Garment Generation Using Pairwise Fashion Elements for Intelligent Design
图 1 · 摘自论文原文
  • 通过融合草图与纹理等2D元素生成3D服装
  • 可生成非封闭结构且支持物理仿真和虚拟试穿的3D资产
  • 适用于智能服装设计、虚拟试穿等下游任务

AI生成内容(AIGC)在2D生成模型方面已趋于成熟,广泛应用于数字时尚领域。然而,3D服装生成仍处于初级阶段,由于不同设计元素在3D表示中存在复杂的语义耦合关系,生成多样化3D服装面临巨大挑战。为此,本文提出Fashion-3DLR框架,利用多种2D设计元素生成高质量、多样化的3D服装资产。具体而言,我们设计了服装特征融合扩散Transformer(GFF-DiT)模块,将草图、纹理等2D设计元素融合至潜在空间;随后通过修正流Transformer生成几何潜在表示,可解码为3D高斯或网格等多种3D服装形式。此外,我们将Fashion-3DLR应用于下游任务,实现了基于3D高斯溅射(3DGS)的布料物理模拟与基于网格的虚拟试穿。实验表明,该方法优于现有最先进方法,能够生成结构良好、非封闭的3D服装,具备物理模拟与虚拟试穿能力,展现出作为通用3D服装设计工具的巨大潜力。

原文摘要 · Abstract (English)

AI-generated content (AIGC) has made significant progress, with 2D generative models becoming ready-to-use tools for the digital fashion industry. However, 3D garment generation remains in its nascent stage, where in the realm of fashion, the semantic information of diverse design elements exhibits intricate coupling relationships in 3D representations, posing substantial challenges for generating diverse 3D garments. In this work, to handle the above problem, We introduce Fashion-3DLR, a novel 3D garment generation framework that utilizes diverse design elements to create high-quality, versatile 3D garment assets. Specifically, to bridge the semantic gaps between different fashion elements, we propose a Garment Feature Fusion Diffusion Transformer (GFF-DiT) module to integrate 2D fashion design elements, e.g., sketch and texture, into latent space. Within the latent space, we then employ a rectified flow transformer to generate geometry latents, which can be decoded into various 3D garment representations, including 3D Gaussians and meshes. Furthermore, we integrate Fashion-3DLR into downstream tasks, achieving the 3D Gaussian Splatting (3DGS)-driven cloth physical simulation and mesh-based virtual try-on. Experimental results indicate that Fashion-3DLR surpass the previous state-of-the-art methods, which verify that the proposed work can generate well-structured, non-watertight garments capable of physical simulation and virtual try-on, underscoring its potential as a versatile 3D garment design tool.

3D生成虚拟试穿服装设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。