arXiv:2506.10468cs.GRcs.CV2025-06被引 2

用真人代替机器人采集服装数据,实现更真实高效的虚拟试穿。

Low-Barrier Dataset Collection with Real Human Body for Interactive Per-Garment Virtual Try-On

  • 用真人替代昂贵机器人采集每件服装数据,降低采集门槛。
  • 引入简化版DensePose融合表示,提升服装与人体对齐精度。
  • 无需穿戴设备即可实现人衣交互,适合电商试穿场景。

现有基于图像的虚拟试穿方法通常仅支持正面视角且无法实时运行。虽然基于每件服装的试穿方法通过采集每件服装数据并训练专属神经网络解决了这些问题,但仍面临实际限制:(1) 用于采集服装数据的机器人模特成本高昂,且无法准确模拟自然人体形变;(2) 合成服装常与人体错位。为解决这些挑战,我们提出一种利用真人身体采集每件服装数据的低门槛方法,无需定制机器人模特。同时引入混合人体表示,通过简化版DensePose图增强中间表示,确保合成服装图像与人体精准对齐,并实现无需穿戴设备的人衣交互。我们在定性和定量评估中对比了其他先进图像式虚拟试穿方法,并进行消融实验,验证了本方法在图像质量与时间一致性方面的优越性。最终用户研究结果显示,多数参与者认为本系统有助于做出服装购买决策。

原文摘要 · Abstract (English)

Existing image-based virtual try-on methods are often limited to the front view and lack real-time performance. While per-garment virtual try-on methods have tackled these issues by capturing per-garment datasets and training per-garment neural networks, they still encounter practical limitations: (1) the robotic mannequin used to capture per-garment datasets is prohibitively expensive for widespread adoption and fails to accurately replicate natural human body deformation; (2) the synthesized garments often misalign with the human body. To address these challenges, we propose a low-barrier approach for collecting per-garment datasets using real human bodies, eliminating the necessity for a customized robotic mannequin. We also introduce a hybrid person representation that enhances the existing intermediate representation with a simplified DensePose map. This ensures accurate alignment of synthesized garment images with the human body and enables human-garment interaction without the need for customized wearable devices. We performed qualitative and quantitative evaluations against other state-of-the-art image-based virtual try-on methods and conducted ablation studies to demonstrate the superiority of our method regarding image quality and temporal consistency. Finally, our user study results indicated that most participants found our virtual try-on system helpful for making garment purchasing decisions.

虚拟试穿真人采集服装对齐人衣交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。