用AI自动上色并补帧，让2D动画制作更省力。
AniDoc: Animation Creation Made Easier
- 基于视频扩散模型，通过显式对应匹配实现精准上色。
- 可自动补全中间帧，仅需起始与结束草图即可生成连贯动画。
- 适合动画初学者或希望提升效率的创作者使用。
2D动画制作遵循标准流程，包括角色设计、关键帧动画、补间动画和上色四个阶段。本文研究通过利用日益强大的生成式AI降低该流程的人工成本。AniDoc基于视频扩散模型，成为一种视频线稿上色工具，能根据参考角色规范，自动将草图序列转化为彩色动画。模型采用显式对应匹配作为引导，对参考角色与各线稿帧之间的姿态差异具有强鲁棒性。此外，模型还可自动完成补间过程，用户仅需提供角色图像及起始与结束草图，即可轻松生成时间一致的动画。代码已公开：https://yihao-meng.github.io/AniDoc_demo。
原文摘要 · Abstract (English)
The production of 2D animation follows an industry-standard workflow, encompassing four essential stages: character design, keyframe animation, in-betweening, and coloring. Our research focuses on reducing the labor costs in the above process by harnessing the potential of increasingly powerful generative AI. Using video diffusion models as the foundation, AniDoc emerges as a video line art colorization tool, which automatically converts sketch sequences into colored animations following the reference character specification. Our model exploits correspondence matching as an explicit guidance, yielding strong robustness to the variations (e.g., posture) between the reference character and each line art frame. In addition, our model could even automate the in-betweening process, such that users can easily create a temporally consistent animation by simply providing a character image as well as the start and end sketches. Our code is available at: https://yihao-meng.github.io/AniDoc_demo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。