用调色板引导实现视频色彩还原的生动与稳定
Consistent Video Colorization via Palette Guidance
- 以调色板提供颜色上下文，指导生成过程
- 在多个视频序列中保持颜色一致性，提升视觉稳定性
- 适用于老电影修复等需色彩连贯性的场景
色彩化是传统计算机视觉任务，在老旧影片修复等耗时任务中至关重要。现有方法存在色彩饱和度不足与时间不一致的问题。本文提出一种新流程，将色彩化视为生成任务，采用Stable Video Diffusion（SVD）作为基础模型，并设计基于调色板的颜色引导机制。该调色板提供的颜色上下文不仅指导色彩生成，还在多序列间建立统一颜色基准，增强生成颜色的稳定性。实验表明，该方法能为视频生成更生动、更稳定的色彩，优于先前方法。
原文摘要 · Abstract (English)
Colorization is a traditional computer vision task and it plays an important role in many time-consuming tasks, such as old film restoration. Existing methods suffer from unsaturated color and temporally inconsistency. In this paper, we propose a novel pipeline to overcome the challenges. We regard the colorization task as a generative task and introduce Stable Video Diffusion (SVD) as our base model. We design a palette-based color guider to assist the model in generating vivid and consistent colors. The color context introduced by the palette not only provides guidance for color generation, but also enhances the stability of the generated colors through a unified color context across multiple sequences. Experiments demonstrate that the proposed method can provide vivid and stable colors for videos, surpassing previous methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。