分离结构与颜色,让老照片恢复自然色彩。
ColorFLUX: A Structure-Color Decoupling Framework for Old Photo Colorization
- 分两步处理:先保结构,再复原颜色
- 在真实和合成数据集上均超越现有方法
- 用图片语义提示避免颜色偏差,适合历史修复
老照片承载珍贵历史记忆,其修复与着色极具价值。现有修复模型虽能处理噪声、划痕等问题,但在准确着色方面表现不佳,原因在于老照片特有的褪色亮度与偏移色相等退化特征,与现代照片分布差异大,导致着色时存在显著领域差距。本文提出基于生成扩散模型FLUX的新型老照片着色框架ColorFLUX,引入结构-颜色解耦策略,将结构保持与颜色恢复分离,实现老照片在保留结构一致性的前提下精准着色。通过渐进式直接偏好优化(Pro-DPO)策略,模型可从粗到细学习细微色彩偏好。同时,采用视觉语义提示替代文本提示,直接从老照片提取细粒度语义信息,有效消除老照片固有的颜色偏差。在合成与真实数据集上的实验表明,本方法优于现有最先进着色技术,包括闭源商业模型,生成高质量且生动的着色结果。
原文摘要 · Abstract (English)
Old photos preserve invaluable historical memories, making their restoration and colorization highly desirable. While existing restoration models can address some degradation issues like denoising and scratch removal, they often struggle with accurate colorization. This limitation arises from the unique degradation inherent in old photos, such as faded brightness and altered color hues, which are different from modern photo distributions, creating a substantial domain gap during colorization. In this paper, we propose a novel old photo colorization framework based on the generative diffusion model FLUX. Our approach introduces a structure-color decoupling strategy that separates structure preservation from color restoration, enabling accurate colorization of old photos while maintaining structural consistency. We further enhance the model with a progressive Direct Preference Optimization (Pro-DPO) strategy, which allows the model to learn subtle color preferences through coarse-to-fine transitions in color augmentation. Additionally, we address the limitations of text-based prompts by introducing visual semantic prompts, which extract fine-grained semantic information directly from old photos, helping to eliminate the color bias inherent in old photos. Experimental results on both synthetic and real datasets demonstrate that our approach outperforms existing state-of-the-art colorization methods, including closed-source commercial models, producing high-quality and vivid colorization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。