arXiv:2508.05069cs.CV2025-08被引 5

无需额外控制模块,实现高保真妆容迁移。

FLUX-Makeup: High-Fidelity, Identity-Consistent, and Robust Makeup Transfer via Diffusion Transformer

  • 基于扩散变换器,直接用源图和参考图对进行端到端迁移。
  • 在多个数据集上达到最优性能,且对不同场景鲁棒性强。
  • 自研数据生成管道提升训练精度,适合实际应用部署。

妆容迁移旨在将参考人脸的妆容风格迁移到目标人脸,已在实际应用中广泛应用。现有基于GAN的方法通常依赖精心设计的损失函数来平衡迁移质量与面部身份一致性,而基于扩散的方法则常需额外的面部控制模块或算法来保持身份一致。但这些附加组件容易引入误差,导致效果不佳。为此,我们提出FLUX-Makeup,一种无需任何辅助面部控制组件的高保真、身份一致且鲁棒的妆容迁移框架。该方法直接利用源图与参考图对实现优异迁移性能。具体而言,我们在FLUX-Kontext基础上,以源图像作为原生条件输入,并引入轻量级的RefLoRAInjector,解耦参考路径与主干网络,高效提取妆容相关信息。同时,设计了稳健可扩展的数据生成流水线,在训练中提供更精确的监督信号。该流水线生成的成对妆容数据集质量显著优于现有数据集。大量实验表明,FLUX-Makeup在多种场景下均达到当前最佳表现。

原文摘要 · Abstract (English)

Makeup transfer aims to apply the makeup style from a reference face to a target face and has been increasingly adopted in practical applications. Existing GAN-based approaches typically rely on carefully designed loss functions to balance transfer quality and facial identity consistency, while diffusion-based methods often depend on additional face-control modules or algorithms to preserve identity. However, these auxiliary components tend to introduce extra errors, leading to suboptimal transfer results. To overcome these limitations, we propose FLUX-Makeup, a high-fidelity, identity-consistent, and robust makeup transfer framework that eliminates the need for any auxiliary face-control components. Instead, our method directly leverages source-reference image pairs to achieve superior transfer performance. Specifically, we build our framework upon FLUX-Kontext, using the source image as its native conditional input. Furthermore, we introduce RefLoRAInjector, a lightweight makeup feature injector that decouples the reference pathway from the backbone, enabling efficient and comprehensive extraction of makeup-related information. In parallel, we design a robust and scalable data generation pipeline to provide more accurate supervision during training. The paired makeup datasets produced by this pipeline significantly surpass the quality of all existing datasets. Extensive experiments demonstrate that FLUX-Makeup achieves state-of-the-art performance, exhibiting strong robustness across diverse scenarios.

妆容迁移扩散模型身份一致图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。