提出新试穿范式,低质量图像也能生成自然穿搭图
Try-On-Adapter: A Simple and Flexible Try-On Paradigm
- 用外推代替修补,直接补全人物缺失部分
- 在VITON-HD上达5.56和7.23的最优FID分数
- 支持姿态、服装属性等灵活控制,适合电商应用
基于图像的虚拟试穿广泛应用于在线购物,旨在根据特定服饰生成穿着自然的人物图像,具有重要研究与商业价值。试穿的核心挑战是生成真实感强且保留服饰细节的图像。现有方法将试穿视为修复任务,需用户提供完整高质量的人体站立图像,实用性差。本文提出试穿适配器(Try-On-Adapter, TOA),采用外推范式,可保留给定人脸与服饰,自然补全其余部分,并支持姿态、服饰属性等多条件灵活控制。实验表明,即使输入低质量人脸与服饰图像,TOA仍能生成高质量结果;在定量评估中,于VITON-HD数据集上实现配对与非配对场景下分别为5.56与7.23的最优FID分数。
原文摘要 · Abstract (English)
Image-based virtual try-on, widely used in online shopping, aims to generate images of a naturally dressed person conditioned on certain garments, providing significant research and commercial potential. A key challenge of try-on is to generate realistic images of the model wearing the garments while preserving the details of the garments. Previous methods focus on masking certain parts of the original model's standing image, and then inpainting on masked areas to generate realistic images of the model wearing corresponding reference garments, which treat the try-on task as an inpainting task. However, such implements require the user to provide a complete, high-quality standing image, which is user-unfriendly in practical applications. In this paper, we propose Try-On-Adapter (TOA), an outpainting paradigm that differs from the existing inpainting paradigm. Our TOA can preserve the given face and garment, naturally imagine the rest parts of the image, and provide flexible control ability with various conditions, e.g., garment properties and human pose. In the experiments, TOA shows excellent performance on the virtual try-on task even given relatively low-quality face and garment images in qualitative comparisons. Additionally, TOA achieves the state-of-the-art performance of FID scores 5.56 and 7.23 for paired and unpaired on the VITON-HD dataset in quantitative comparisons.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。