用语义对齐与搭配分类生成整套穿搭,提升设计与推荐效果。
Learning to Synthesize Compatible Fashion Items Using Semantic Alignment and Collocation Classification: An Outfit Generation Framework
- 基于已有单品和目标品类掩码,生成完整搭配
- 在2万套服饰数据集上实现更真实、更兼容的合成效果
- 适合时尚设计辅助与个性化推荐系统
近年来,时尚搭配学习受到学术界和工业界的广泛关注。尽管已有研究聚焦于搭配预测、成套推荐与AI驱动的时尚设计,但现有生成模型多仅关注上下装之间的图像到图像转换。本文提出一种新框架OutfitGAN,旨在给定一件现有时尚单品及目标合成品类的参考掩码时,生成一组互补单品组成完整穿搭。该框架包含语义对齐模块,用于建立现有单品与合成单品间的映射关系以提升图像质量;以及搭配分类模块,用于增强合成穿搭的搭配合理性。为评估模型性能,我们构建了一个包含20,000套服饰的大规模数据集。大量实验结果表明,OutfitGAN能生成照片级真实的穿搭,在相似度、真实感和搭配性指标上均优于现有最先进方法。
原文摘要 · Abstract (English)
The field of fashion compatibility learning has attracted great attention from both the academic and industrial communities in recent years. Many studies have been carried out for fashion compatibility prediction, collocated outfit recommendation, artificial intelligence (AI)-enabled compatible fashion design, and related topics. In particular, AI-enabled compatible fashion design can be used to synthesize compatible fashion items or outfits in order to improve the design experience for designers or the efficacy of recommendations for customers. However, previous generative models for collocated fashion synthesis have generally focused on the image-to-image translation between fashion items of upper and lower clothing. In this paper, we propose a novel outfit generation framework, i.e., OutfitGAN, with the aim of synthesizing a set of complementary items to compose an entire outfit, given one extant fashion item and reference masks of target synthesized items. OutfitGAN includes a semantic alignment module, which is responsible for characterizing the mapping correspondence between the existing fashion items and the synthesized ones, to improve the quality of the synthesized images, and a collocation classification module, which is used to improve the compatibility of a synthesized outfit. In order to evaluate the performance of our proposed models, we built a large-scale dataset consisting of 20,000 fashion outfits. Extensive experimental results on this dataset show that our OutfitGAN can synthesize photo-realistic outfits and outperform state-of-the-art methods in terms of similarity, authenticity and compatibility measurements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。