arXiv:2508.05535cs.ROcs.CL2025-08被引 5

让机器人和人通过自然语言轮流主导协作任务,提升完成率与体验。

Mixed-Initiative Dialog for Human-Robot Collaborative Manipulation

  • 采用混合主导对话机制,双方可自由提出、接受或拒绝任务分工。
  • 在18名参与者实验中,任务成功率显著高于纯大模型基线与传统分配模型。
  • 适合需要灵活人机协作的长期任务场景,如家庭助老或工业装配。

面向长时程人机协作的智能机器人系统需适应不同人类伙伴的物理行为、协助意愿及对机器人能力的理解变化。这要求双方具备紧密耦合的沟通回路,能灵活发起、接受或拒绝任务请求以高效协同。本文提出MICoBot系统,采用混合主导对话范式,使机器人与人类通过自然语言自主决定由谁执行任务中的各步骤。系统分三层决策:(1)元规划器分析人类对话,制定高层协作策略;(2)规划器根据机器人能力(基于仿真预训练的可达性模型)和人类可用性估计,最优分配剩余任务;(3)动作执行器决定低层动作或向人类发送语言指令。在18名独立参与者的实体机器人测试中,MICoBot显著优于纯大语言模型基线与标准任务分配模型,在任务成功率和用户体验上均有提升。

原文摘要 · Abstract (English)

Effective robotic systems for long-horizon human-robot collaboration must adapt to a wide range of human partners, whose physical behavior, willingness to assist, and understanding of the robot's capabilities may change over time. This demands a tightly coupled communication loop that grants both agents the flexibility to propose, accept, or decline requests as they coordinate toward completing the task effectively. We apply a Mixed-Initiative dialog paradigm to Collaborative human-roBot teaming and propose MICoBot, a system that handles the common scenario where both agents, using natural language, take initiative in formulating, accepting, or rejecting proposals on who can best complete different steps of a task. To handle diverse, task-directed dialog, and find successful collaborative strategies that minimize human effort, MICoBot makes decisions at three levels: (1) a meta-planner considers human dialog to formulate and code a high-level collaboration strategy, (2) a planner optimally allocates the remaining steps to either agent based on the robot's capabilities (measured by a simulation-pretrained affordance model) and the human's estimated availability to help, and (3) an action executor decides the low-level actions to perform or words to say to the human. In physical robot trials with 18 unique human participants, MICoBot significantly improves task success and user experience over a pure LLM baseline and standard agent allocation models. See additional videos and materials at https://robin-lab.cs.utexas.edu/MicoBot/.

人机协作自然语言交互任务规划机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。