用流匹配框架实现精准且快速的颜色迁移。
ColorFM: An Optimization-to-Learning Framework for Color Transfer via Flow Matching

- 将颜色迁移建模为沿速度场的分布传输,通过分层色彩耦合优化轨迹。
- 生成高质量伪监督数据,训练出比现有方法更优的前馈模型。
- 兼顾精度与效率,适合需要高保真颜色迁移的应用场景。
颜色迁移旨在对齐源图像与参考图像的颜色分布,同时保持结构和语义一致性。现有方法常出现全局映射不准、语义错位和视觉伪影问题。为此,我们提出ColorFM,一种从优化到学习的框架。ColorFM将在线优化与离线推理结合,将颜色迁移重新表述为通过流匹配沿速度场传输像素分布。具体而言,我们设计了ColorFM-O,一种基于语义先验引导的分层色彩耦合实例化优化方案,通过数值积分诱导的流轨迹,生成精确且语义一致的颜色迁移结果,并生成高质量成对伪监督数据。在此基础上,我们构建ColorFM-L,一个在生成配对数据上训练的高效前馈模型。通过隐式状态建模,ColorFM-L提取深层语义特征以预测双向线性化传输的流参数,确保准确的颜色迁移。大量实验表明,ColorFM-L在视觉质量、结构保真度和语义一致性方面优于当前最先进方法,成功融合了优化的精度与前馈推理的速度。
原文摘要 · Abstract (English)
Color transfer aims to align the color distribution of a source image with that of a reference image while preserving structural and semantic consistency. However, existing methods often suffer from inaccurate global mapping, semantic misalignment, and visual artifacts. To address these issues, we propose ColorFM, an optimization-to-learning framework. ColorFM connects online optimization to offline inference by reformulating color transfer as the transport of pixel distributions along velocity fields via Flow Matching. Specifically, we introduce ColorFM-O, an instance-specific optimization scheme that fits the velocity field through hierarchical color coupling guided by semantic priors. By numerically integrating the induced flow trajectories, ColorFM-O produces precise and semantically consistent color transfer results, while generating high-quality paired data as pseudo-supervision. Building upon this, we design ColorFM-L, an efficient feed-forward model trained on the generated pairs. Through implicit state modeling, ColorFM-L extracts deep semantic features to predict flow parameters for bidirectional linearized transport, ensuring accurate color transfer. Extensive experiments demonstrate that ColorFM-L outperforms state-of-the-art methods in visual quality, structural fidelity, and semantic consistency, successfully combining the accuracy of optimization with the speed of feed-forward inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。