用逻辑语言自动检查动画是否符合描述,提升文本生成动画的准确性。
MoVer: Motion Verification for Motion Graphics Animations
- 设计基于一阶逻辑的运动验证语言MoVer,可检验动画的时空属性。
- 在5600个提示上测试,迭代修正后正确率从58.8%提升至93.6%。
- 适合需要精准控制动画语义的设计师和自动化生成系统使用。
大型视觉语言模型虽能根据文本提示生成运动图形动画,但常遗漏提示中描述的时空属性。本文提出MoVer,一种基于一阶逻辑的运动验证领域特定语言,用于检查运动图形动画的时空特性。我们归纳了人们常用于描述动画的通用属性(如运动方向、时间节奏、物体相对位置等),并将其作为谓词在MoVer中实现。我们构建了执行引擎,可对任意SVG格式的运动图形动画应用MoVer程序。进一步展示如何将MoVer集成到基于LLM的合成与验证流水线中,实现动画的迭代优化:给定文本提示,系统生成动画及对应的MoVer程序;执行验证后得到失败谓词报告,并自动反馈给LLM以修正动画。为评估该流程,我们构建了一个包含5600个文本提示及其真实MoVer验证程序的合成数据集。结果显示,无需迭代时,系统可正确生成58.8%的动画;经最多50次修正后,正确率提升至93.6%。代码与数据集详见https://mover-dsl.github.io。
原文摘要 · Abstract (English)
While large vision-language models can generate motion graphics animations from text prompts, they regularly fail to include all spatio-temporal properties described in the prompt. We introduce MoVer, a motion verification DSL based on first-order logic that can check spatio-temporal properties of a motion graphics animation. We identify a general set of such properties that people commonly use to describe animations (e.g., the direction and timing of motions, the relative positioning of objects, etc.). We implement these properties as predicates in MoVer and provide an execution engine that can apply a MoVer program to any input SVG-based motion graphics animation. We then demonstrate how MoVer can be used in an LLM-based synthesis and verification pipeline for iteratively refining motion graphics animations. Given a text prompt, our pipeline synthesizes a motion graphics animation and a corresponding MoVer program. Executing the verification program on the animation yields a report of the predicates that failed and the report can be automatically fed back to LLM to iteratively correct the animation. To evaluate our pipeline, we build a synthetic dataset of 5600 text prompts paired with ground truth MoVer verification programs. We find that while our LLM-based pipeline is able to automatically generate a correct motion graphics animation for 58.8% of the test prompts without any iteration, this number raises to 93.6% with up to 50 correction iterations. Our code and dataset are at https://mover-dsl.github.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。