arXiv:2507.01945cs.CV2025-07ICCV被引 9

解决长视频动画上色中颜色不一致问题,实现全局动态记忆的连贯上色。

LongAnimation: Long Animation Generation with Dynamic Global-Local Memory

  • 采用动态全局-局部记忆机制,融合历史信息与当前帧特征。
  • 在平均500帧的长动画上保持颜色一致性,短时(14帧)效果更优。
  • 适合需要长时间颜色一致性的动画生成任务,如影视级动画制作。

动画上色是真实动画产业生产中的关键环节,长动画上色成本高昂。因此,基于视频生成模型的自动化长动画上色具有重要研究价值。现有研究局限于短期上色,采用局部范式,通过重叠特征融合实现局部段落间的平滑过渡,但忽略了全局信息,难以维持长期颜色一致性。本文提出动态全局-局部范式,即动态提取与当前生成相关联的全局颜色一致特征,以实现理想的长期颜色一致性。为此,我们提出LongAnimation框架,主要包括SketchDiT、动态全局-局部记忆(DGLM)模块和颜色一致性奖励。SketchDiT捕捉混合参考特征以支持DGLM模块;DGLM利用长视频理解模型动态压缩全局历史特征,并自适应融合至当前生成特征;为提升颜色一致性,引入颜色一致性奖励。推理阶段提出颜色一致性融合策略,以平滑视频段间过渡。在短时(14帧)和长时(平均500帧)动画上的大量实验表明,LongAnimation在开放域动画上色任务中有效维持了短期与长期的颜色一致性。

原文摘要 · Abstract (English)

Animation colorization is a crucial part of real animation industry production. Long animation colorization has high labor costs. Therefore, automated long animation colorization based on the video generation model has significant research value. Existing studies are limited to short-term colorization. These studies adopt a local paradigm, fusing overlapping features to achieve smooth transitions between local segments. However, the local paradigm neglects global information, failing to maintain long-term color consistency. In this study, we argue that ideal long-term color consistency can be achieved through a dynamic global-local paradigm, i.e., dynamically extracting global color-consistent features relevant to the current generation. Specifically, we propose LongAnimation, a novel framework, which mainly includes a SketchDiT, a Dynamic Global-Local Memory (DGLM), and a Color Consistency Reward. The SketchDiT captures hybrid reference features to support the DGLM module. The DGLM module employs a long video understanding model to dynamically compress global historical features and adaptively fuse them with the current generation features. To refine the color consistency, we introduce a Color Consistency Reward. During inference, we propose a color consistency fusion to smooth the video segment transition. Extensive experiments on both short-term (14 frames) and long-term (average 500 frames) animations show the effectiveness of LongAnimation in maintaining short-term and long-term color consistency for open-domain animation colorization task. The code can be found at https://cn-makers.github.io/long_animation_web/.

动画生成颜色一致性长视频生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。