让剪纸动画自然流畅,避免动作突变和形变失真。
FlexiClip: Locality-Preserving Free-Form Character Animation
- 用贝塞尔曲线结合动态修正机制,精准控制运动轨迹。
- 在快速移动和非刚性变形下仍保持动作连贯与结构稳定。
- 适合需要高质量手绘风格动画的创作者或设计场景。
在保持视觉清晰度和时间一致性的同时实现剪纸图像的无缝运动,仍是重大挑战。现有方法如AniClipart虽能建模空间形变,但常导致动作突变和几何失真。文本到视频(T2V)与图像到视频(I2V)模型也因自然视频与剪纸风格的统计差异难以处理此类内容。本文提出FlexiClip,通过引入时序雅可比矩阵逐步校正运动动力学、基于概率流常微分方程(pfODEs)的连续时间建模以减少时序噪声,并采用受GFlowNet启发的流匹配损失优化平滑过渡。这些改进在包含人类与动物在内的多种剪纸类型中,有效保证复杂场景下的动作连贯性与结构一致性。结合预训练视频扩散模型,FlexiClip显著提升剪纸动画质量,为高保真剪纸动画树立新标准。
原文摘要 · Abstract (English)
Animating clipart images with seamless motion while maintaining visual fidelity and temporal coherence presents significant challenges. Existing methods, such as AniClipart, effectively model spatial deformations but often fail to ensure smooth temporal transitions, resulting in artifacts like abrupt motions and geometric distortions. Similarly, text-to-video (T2V) and image-to-video (I2V) models struggle to handle clipart due to the mismatch in statistical properties between natural video and clipart styles. This paper introduces FlexiClip, a novel approach designed to overcome these limitations by addressing the intertwined challenges of temporal consistency and geometric integrity. FlexiClip extends traditional Bézier curve-based trajectory modeling with key innovations: temporal Jacobians to correct motion dynamics incrementally, continuous-time modeling via probability flow ODEs (pfODEs) to mitigate temporal noise, and a flow matching loss inspired by GFlowNet principles to optimize smooth motion transitions. These enhancements ensure coherent animations across complex scenarios involving rapid movements and non-rigid deformations. Extensive experiments validate the effectiveness of FlexiClip in generating animations that are not only smooth and natural but also structurally consistent across diverse clipart types, including humans and animals. By integrating spatial and temporal modeling with pre-trained video diffusion models, FlexiClip sets a new standard for high-quality clipart animation, offering robust performance across a wide range of visual content. Project Page: https://creative-gen.github.io/flexiclip.github.io/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。