arXiv:2604.11792cs.CV2026-04中稿 · CVPR被引 8

首个可自回归生成矢量动画的框架,让AI直接用自然语言造出可编辑的动态图形。

LottieGPT: Tokenizing Vector Animation for Autoregressive Generation

论文配图:LottieGPT: Tokenizing Vector Animation for Autoregressive Generation
图 1 · 摘自论文原文
  • 将Lottie动画转为紧凑语义令牌序列,支持自回归生成。
  • 构建660K规模真实矢量动画数据集,提升模型泛化能力。
  • 适合需要动态图形生成、可编辑设计的创作者和开发者使用。

尽管视频生成技术快速进步,现有模型仍无法生成主流且富有表现力的矢量动画。矢量动画具有分辨率无关、体积小、语义结构清晰及可编辑参数化运动等优势,但当前生成模型仅在位图空间操作,难以实现此类内容生成。近期大模型在生成幻灯片、3D网格、乐高序列和室内布局等结构化数据方面展现出强大能力,暗示原生矢量动画生成具备可行性。本文提出首个矢量动画分词与自回归生成框架。采用广泛使用的基于JSON的Lottie标准,设计专用的Lottie Tokenizer,将分层几何图形、变换及关键帧运动编码为紧凑且语义对齐的令牌序列。为支持大规模训练,构建了目前最大最多样化的矢量动画数据集LottieAnimation-660K,包含660k条真实世界Lottie动画及1500万张静态Lottie图像,均来自广泛互联网来源。在此基础上,微调Qwen-VL,打造可直接由自然语言或视觉提示生成连贯可编辑矢量动画的原生多模态模型LottieGPT。实验表明,该分词器显著压缩序列长度,同时保持结构保真度,使动态矢量内容的自回归学习成为可能。LottieGPT在多种动画风格上展现强泛化能力,在SVG生成(单帧矢量动画特例)任务上优于现有最先进模型。

原文摘要 · Abstract (English)

Despite rapid progress in video generation, existing models are incapable of producing vector animation, a dominant and highly expressive form of multimedia on the Internet. Vector animations offer resolution-independence, compactness, semantic structure, and editable parametric motion representations, yet current generative models operate exclusively in raster space and thus cannot synthesize them. Meanwhile, recent advances in large multimodal models demonstrate strong capabilities in generating structured data such as slides, 3D meshes, LEGO sequences, and indoor layouts, suggesting that native vector animation generation may be achievable. In this work, we present the first framework for tokenizing and autoregressively generating vector animations. We adopt Lottie, a widely deployed JSON-based animation standard, and design a tailored Lottie Tokenizer that encodes layered geometric primitives, transforms, and keyframe-based motion into a compact and semantically aligned token sequence. To support large-scale training, we also construct LottieAnimation-660K, the largest and most diverse vector animation dataset to date, consisting of 660k real-world Lottie animation and 15M static Lottie image files curated from broad Internet sources. Building upon these components, we finetune Qwen-VL to create LottieGPT, a native multimodal model capable of generating coherent, editable vector animations directly from natural language or visual prompts. Experiments show that our tokenizer dramatically reduces sequence length while preserving structural fidelity, enabling effective autoregressive learning of dynamic vector content. LottieGPT exhibits strong generalization across diverse animation styles and outperforms previous state-of-the-art models on SVG generation (a special case of single-frame vector animation).

矢量动画自回归生成多模态Lottie

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。