用内心独白指导行为,让AI能灵活模仿人类动作并实时调整。
Inner Speech as Behavior Guides: Steerable Imitation of Diverse Behaviors for Human-AI coordination
- 用视觉语言模型生成行为意图的内部语言描述
- 在机器人操作和人机协作中实现高多样性与高还原度行为
- 无需额外训练即可在推理时精细控制行为类型
有效的人机协同需要具备类人行为表现与响应能力,并能适应动态环境的智能体。模仿学习已成为构建此类智能体的重要方法,通过训练智能体模仿人类示范行为。然而,现有方法难以捕捉人类行为固有的多样性与非马尔可夫特性,且缺乏推理时的行为调控能力。受人类认知过程中‘内心独白’引导行为选择的启发,我们提出MIMIC(Modeling Inner Motivations for Imitation and Control)框架,利用语言作为行为意图的内在表征。MIMIC采用视觉-语言模型作为语言支架,训练一个条件变分自编码器,从观察中生成内心独白;再通过基于扩散模型的行为克隆策略,根据当前观测与生成的内心独白选择动作。该框架可在推理时通过特定行为语言实现细粒度行为调控。在机器人抓取任务与人机协作游戏中实验表明,MIMIC显著提升了行为多样性与对人类示范的忠实度,同时无需额外示范即可实现精细化行为调节。代码与预训练模型已开源:https://mimic-research.github.io。
原文摘要 · Abstract (English)
Effective human-AI coordination requires artificial agents capable of exhibiting and responding to human-like behaviors while adapting to changing contexts. Imitation learning has emerged as one of the prominent approaches to build such agents by training them to mimic human-demonstrated behaviors. However, current methods struggle to capture the inherent diversity and non-Markovian nature of human behavior and lack the ability to steer behavior at inference time. Drawing inspiration from the theory of human cognitive processes, where inner speech guides action selection before execution, we propose MIMIC (Modeling Inner Motivations for Imitation and Control), a framework that uses language as an internal representation of behavioral intent. MIMIC employs the novel use of vision-language models as linguistic scaffolding to train a conditional variational autoencoder capable of generating inner speech from observations. A diffusion-based behavior cloning policy then selects actions conditioned on current observations and the generated inner speech. MIMIC enables fine-grained steering of behavior at inference time by conditioning the agent on behavior-specific speech. Experiments across robotic manipulation tasks and human-AI collaboration games demonstrate that MIMIC significantly enhances both behavior diversity and fidelity to human demonstrations while enabling nuanced behavioral steering without training on additional demonstrations. We open source our code and provide pre-trained MIMIC agents and qualitative demos at: https://mimic-research.github.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。