arXiv:2509.02445cs.CV2025-09

解耦化妆生成与渲染,实现高保真实时试妆。

Towards High-Fidelity, Identity-Preserving Real-Time Makeup Transfer: Decoupling Style Generation

  • 分两步:先提取透明妆容掩码,再图形化渲染,支持实时试妆。
  • 在多种表情、姿态和肤色下保持妆容细节与身份一致。
  • 适合美妆应用开发、实时虚拟试妆系统研发者参考。

我们提出一种新型实时虚拟试妆框架,实现高保真、身份保留的妆容迁移,并具备鲁棒的时间一致性。在实时试妆中,需合成时间连贯的结果,精准还原细微妆容并保持用户身份特征。然而现有方法难以将半透明化妆品与肤色等身份特征解耦,导致身份偏移并引发公平性问题。此外,当前方法缺乏实时能力且难以维持时间一致性,限制了实际应用。为此,我们把妆容迁移分为两步:透明妆容掩码提取与基于图形的掩码渲染。妆容提取模型通过两种互补方法生成伪真实数据训练:基于图形的渲染流程和无监督k均值聚类。为增强透明度估计与色彩保真度,我们设计专用训练目标,包括加权重建损失与唇色损失。实验表明,该方法在不同姿态、表情和肤色下均能实现稳健妆容迁移,保持时间平滑性。大量实验显示,本方法在捕捉细节、维持时间稳定性和身份完整性方面优于现有基线。

原文摘要 · Abstract (English)

We present a novel framework for real-time virtual makeup try-on that achieves high-fidelity, identity-preserving cosmetic transfer with robust temporal consistency. In live makeup transfer applications, it is critical to synthesize temporally coherent results that accurately replicate fine-grained makeup and preserve user's identity. However, existing methods often struggle to disentangle semitransparent cosmetics from skin tones and other identify features, causing identity shifts and raising fairness concerns. Furthermore, current methods lack real-time capabilities and fail to maintain temporal consistency, limiting practical adoption. To address these challenges, we decouple makeup transfer into two steps: transparent makeup mask extraction and graphics-based mask rendering. After the makeup extraction step, the makeup rendering can be performed in real time, enabling live makeup try-on. Our makeup extraction model trained on pseudo-ground-truth data generated via two complementary methods: a graphics-based rendering pipeline and an unsupervised k-means clustering approach. To further enhance transparency estimation and color fidelity, we propose specialized training objectives, including alpha-weighted reconstruction and lip color losses. Our method achieves robust makeup transfer across diverse poses, expressions, and skin tones while preserving temporal smoothness. Extensive experiments demonstrate that our approach outperforms existing baselines in capturing fine details, maintaining temporal stability, and preserving identity integrity.

实时试妆妆容迁移图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。