通过分步对齐与肢体感知,提升虚拟试衣的细节真实感。
Progressive Limb-Aware Virtual Try-On
- 分两阶段基于衣物属性进行像素级形变对齐。
- 引入肢体感知特征,显著减少肢体区域纹理混淆。
- 适合服装设计、电商试穿等需高精度还原的场景。
现有图像级虚拟试衣方法直接转移衣物但未利用衣物属性优化几何与纹理,导致外观不完整或模糊。同时,这些方法常遮蔽输入人物的肢体纹理以实现无衣人表示,造成在长袖与短袖互换时肢体区域预测不准(如裸露手臂皮肤)。为此,本文提出渐进式虚拟试衣框架PL-VTON,基于多属性进行像素级衣物形变,并显式嵌入肢体感知特征,生成逼真试穿结果。具体地,设计了多属性衣物形变(MCW)模块,采用双阶段对齐策略逐步估计像素级位移;引入人体解析估计器(HPE),语义分割人体区域,提供结构约束以缓解衣物与肢体间的纹理溢出;最后提出肢体感知纹理融合(LTF)模块,结合衣物与人体纹理,在显式肢体感知特征引导下重建高质量肢体细节。大量实验表明,本方法在定性和定量上均优于当前最优方法。代码已开源:https://github.com/xyhanHIT/PL-VTON。
原文摘要 · Abstract (English)
Existing image-based virtual try-on methods directly transfer specific clothing to a human image without utilizing clothing attributes to refine the transferred clothing geometry and textures, which causes incomplete and blurred clothing appearances. In addition, these methods usually mask the limb textures of the input for the clothing-agnostic person representation, which results in inaccurate predictions for human limb regions (i.e., the exposed arm skin), especially when transforming between long-sleeved and short-sleeved garments. To address these problems, we present a progressive virtual try-on framework, named PL-VTON, which performs pixel-level clothing warping based on multiple attributes of clothing and embeds explicit limb-aware features to generate photo-realistic try-on results. Specifically, we design a Multi-attribute Clothing Warping (MCW) module that adopts a two-stage alignment strategy based on multiple attributes to progressively estimate pixel-level clothing displacements. A Human Parsing Estimator (HPE) is then introduced to semantically divide the person into various regions, which provides structural constraints on the human body and therefore alleviates texture bleeding between clothing and limb regions. Finally, we propose a Limb-aware Texture Fusion (LTF) module to estimate high-quality details in limb regions by fusing textures of the clothing and the human body with the guidance of explicit limb-aware features. Extensive experiments demonstrate that our proposed method outperforms the state-of-the-art virtual try-on methods both qualitatively and quantitatively. The code is available at https://github.com/xyhanHIT/PL-VTON.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。