arXiv:2608.20699cs.CV2026-08

用智能体实现无需训练的文本驱动关节模型动画。

ArtiMo: Agent-Driven Articulated Mesh Animation

论文配图:ArtiMo: Agent-Driven Articulated Mesh Animation
图 1 · 摘自论文原文
  • 基于大模型构建智能体,按语义规划动作并满足物理约束。
  • 在21类物体上生成因果连贯的动作,显著优于基线方法。
  • 适合需要零样本动画生成的研究者与开发者。

通过文本驱动关节3D网格动画,需满足严格的运动学约束,建模部件间的因果交互,并保持指令一致性。由于缺乏特定任务训练数据和显式关节监督,现有数据驱动方法难以适用。为此,我们提出ArtiMo,一种新型零样本代理驱动框架,实现文本引导的关节网格动画。该框架利用大语言模型(LLMs)和视觉-语言模型(VLMs)构建智能体流水线,协同URDF的显式运动学约束与智能体的推理规划能力,无需微调即可生成因果一致的部件运动与交互。为确保动作正确性,智能体还引入视觉自优化机制:将生成动画渲染为紧凑关键帧与运动线索,供VLM迭代诊断并修正错误。此外,我们构建了一个新基准数据集,涵盖21类关节物体,包含高质量运动标注及因果关系信息。大量实验表明,ArtiMo在复杂因果驱动动作上显著超越基线方法。

原文摘要 · Abstract (English)

Animating articulated 3D meshes via text requires satisfying strict kinematic constraints, modeling causal interactions between parts, and achieving instruction fidelity. Due to the absence of task-specific training data and explicit articulation supervision, existing data-driven mesh animation methods are largely inapplicable to this setting. To address this, we propose ArtiMo, a novel agent-driven framework for text-guided articulated mesh animation. Operating in a zero-shot manner, ArtiMo develops an agentic pipeline powered by Large Language and Vision-Language Models (LLMs/VLMs) to orchestrate motion generation. By synergizing the explicit kinematic constraints of URDF with the agent's reasoning and planning capabilities, it effectively produces causally coherent part motions and interactions without requiring model fine-tuning. To ensure motion correctness, the agent additionally utilizes a visual self-improvement mechanism: generated animations are rendered into compact keyframes and motion cues, enabling the VLM to iteratively diagnose and correct errors. Furthermore, we contribute a new benchmark dataset spanning 21 articulated object categories, featuring high-quality motion annotations enriched with causal relationships. Extensive experiments demonstrate that ArtiMo significantly outperforms baselines, particularly on complex, causally driven motions. The project page is available at https://zou-2004.github.io/ArtiMo/.

3D动画智能体文本生成关节模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。