arXiv:2505.09998cs.CV2025-05被引 4

普通人用AR/VR画草图就能自动生成逼真3D虚拟服装。

From Air to Wear: Personalized 3D Digital Fashion with AR/VR Immersive 3D Sketching

  • 用AR/VR中自由手绘的3D草图驱动服装生成。
  • 在100+用户测试中,生成效果显著优于现有方法。
  • 适合想玩虚拟穿搭的普通用户和设计师新手。

在沉浸式消费电子设备(如AR/VR头显)兴起的背景下,人们越来越希望通过虚拟时尚表达自我。然而,现有3D服装设计工具因技术门槛高、数据稀缺,难以被普通用户使用。本文提出一种基于3D草图的3D服装生成框架,让用户即使无设计经验,也能通过AR/VR环境中的简单3D手绘创作高质量数字服装。系统结合条件扩散模型、共享隐空间训练的草图编码器及自适应课程学习策略,有效理解不精确的手绘输入并生成逼真个性化服装。为解决训练数据不足问题,我们构建了新数据集KO3DClothes,包含成对的3D服装与用户手绘草图。大量实验与用户研究证实,该方法在保真度与易用性上显著超越现有基线,展现出在下一代消费平台实现时尚设计民主化的潜力。

原文摘要 · Abstract (English)

In the era of immersive consumer electronics, such as AR/VR headsets and smart devices, people increasingly seek ways to express their identity through virtual fashion. However, existing 3D garment design tools remain inaccessible to everyday users due to steep technical barriers and limited data. In this work, we introduce a 3D sketch-driven 3D garment generation framework that empowers ordinary users - even those without design experience - to create high-quality digital clothing through simple 3D sketches in AR/VR environments. By combining a conditional diffusion model, a sketch encoder trained in a shared latent space, and an adaptive curriculum learning strategy, our system interprets imprecise, free-hand input and produces realistic, personalized garments. To address the scarcity of training data, we also introduce KO3DClothes, a new dataset of paired 3D garments and user-created sketches. Extensive experiments and user studies confirm that our method significantly outperforms existing baselines in both fidelity and usability, demonstrating its promise for democratized fashion design on next-generation consumer platforms.

3D服装生成AR/VR交互扩散模型用户友好

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。