arXiv:2504.15232cs.CV2025-04中稿 · ACM MM 2024被引 10

通过形状约束与肢体细节重建,提升虚拟试衣的贴合度与真实感。

Shape-Guided Clothing Warping for Virtual Try-On

  • 引入双路径变形模块,结合形状对齐与外观流估计。
  • 在人体四肢区域减少形变失真,提升试衣结果自然度。
  • 适合需要高精度服装贴合的应用场景,如电商试穿系统。

基于图像的虚拟试衣旨在将店内服装无缝地适配到人物图像上,同时保持姿态一致性。现有方法通常使用薄板样条(TPS)变换或外观光流来变形服装以对齐人体。尽管表现良好,但这些方法往往难以精确控制细节,导致服装与人体形状不一致,以及暴露肢体区域出现扭曲。为此,我们提出一种新型的形状引导服装变形方法(SCW-VTON),通过引入全局形状约束和额外的肢体纹理信息,增强变形后服装的真实感与一致性。为整合全局形状约束,设计了双路径服装变形模块,包含形状路径与光流路径:前者捕捉与人体对齐的服装形状,后者利用变形前后服装形状的映射关系指导外观光流估计。此外,为缓解试衣结果中肢体区域的形变问题,提出基于掩码图像建模的肢体重建网络,以提供精细的肢体引导。实验表明,所提方法在定性与定量评估上均优于现有最优方法。代码已开源:https://github.com/xyhanHIT/SCW-VTON。

原文摘要 · Abstract (English)

Image-based virtual try-on aims to seamlessly fit in-shop clothing to a person image while maintaining pose consistency. Existing methods commonly employ the thin plate spline (TPS) transformation or appearance flow to deform in-shop clothing for aligning with the person's body. Despite their promising performance, these methods often lack precise control over fine details, leading to inconsistencies in shape between clothing and the person's body as well as distortions in exposed limb regions. To tackle these challenges, we propose a novel shape-guided clothing warping method for virtual try-on, dubbed SCW-VTON, which incorporates global shape constraints and additional limb textures to enhance the realism and consistency of the warped clothing and try-on results. To integrate global shape constraints for clothing warping, we devise a dual-path clothing warping module comprising a shape path and a flow path. The former path captures the clothing shape aligned with the person's body, while the latter path leverages the mapping between the pre- and post-deformation of the clothing shape to guide the estimation of appearance flow. Furthermore, to alleviate distortions in limb regions of try-on results, we integrate detailed limb guidance by developing a limb reconstruction network based on masked image modeling. Through the utilization of SCW-VTON, we are able to generate try-on results with enhanced clothing shape consistency and precise control over details. Extensive experiments demonstrate the superiority of our approach over state-of-the-art methods both qualitatively and quantitatively. The code is available at https://github.com/xyhanHIT/SCW-VTON.

虚拟试衣服装变形图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。