只需画草图并描述动作，自动生成流畅手绘风格动画。
FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animations
- 用文本引导的扩散模型生成草图动画帧
- 通过参考帧和噪声优化保持草图视觉一致性
- 适合想快速创作手绘动画的创作者或教育者
草图动画是视觉叙事的强大媒介，从简单的翻页书涂鸦到专业工作室制作皆可。传统动画需大量熟练艺术家绘制关键帧与中间帧，现有自动化方法仍需精确运动路径或关键帧设定。我们提出 FlipSketch，让翻页书动画重现魔力——只需画出想法并描述移动方式即可！该方法利用文本到视频扩散模型中的运动先验，通过三项关键创新实现：(i) 针对草图风格帧生成进行微调；(ii) 参考帧机制通过噪声精炼保持输入草图的视觉完整性；(iii) 双注意力组合结构实现无失真的流畅运动。相比受约束的矢量动画，本系统采用栅格帧支持动态草图变换，捕捉传统动画的表现自由。结果是一个直观易用的系统，使草图动画如同涂鸦与描述般简单，同时保留手绘动画的艺术精髓。
原文摘要 · Abstract (English)
Sketch animations offer a powerful medium for visual storytelling, from simple flip-book doodles to professional studio productions. While traditional animation requires teams of skilled artists to draw key frames and in-between frames, existing automation attempts still demand significant artistic effort through precise motion paths or keyframe specification. We present FlipSketch, a system that brings back the magic of flip-book animation -- just draw your idea and describe how you want it to move! Our approach harnesses motion priors from text-to-video diffusion models, adapting them to generate sketch animations through three key innovations: (i) fine-tuning for sketch-style frame generation, (ii) a reference frame mechanism that preserves visual integrity of input sketch through noise refinement, and (iii) a dual-attention composition that enables fluid motion without losing visual consistency. Unlike constrained vector animations, our raster frames support dynamic sketch transformations, capturing the expressive freedom of traditional animation. The result is an intuitive system that makes sketch animation as simple as doodling and describing, while maintaining the artistic essence of hand-drawn animation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。