arXiv:2602.13081cs.RO2026-02AAAI被引 3

用语言模型驱动机器人自主决策,灵活但易出错。

Agentic AI for Robot Control: Flexible but still Fragile

  • 用语言模型迭代规划并调用技能控制机器人
  • 在两个真实机器人上测试均出现非确定性错误
  • 适合研究人机协作与智能系统鲁棒性

近期工作利用生成模型的能力和常识先验进行机器人控制。本文提出一种代理式控制系统,通过具备推理能力的语言模型,在迭代的规划与执行循环中选择并调用机器人技能来完成任务。我们在两个物理机器人平台上部署该系统:(i) 室内移动操作中的桌面抓取、放置和盒内插入(Mobipick);(ii) 自主农业导航与传感(Valdemar)。两种场景均存在不确定性、部分可观测性、传感器噪声和模糊自然语言指令。系统可结构化地展示其规划与决策过程,通过显式事件检查响应外部变化,并支持操作员干预以修改或重定向执行流程。在两个平台上的概念验证实验揭示了显著的脆弱性,包括非确定性次优行为、指令跟随错误以及对提示细节的高度敏感性。同时,该架构具有灵活性:迁移到不同机器人和任务领域仅需更新系统提示(领域模型、可操作性及动作目录),并重新绑定相同工具接口到平台特定的技能API。

原文摘要 · Abstract (English)

Recent work leverages the capabilities and commonsense priors of generative models for robot control. In this paper, we present an agentic control system in which a reasoning-capable language model plans and executes tasks by selecting and invoking robot skills within an iterative planner and executor loop. We deploy the system on two physical robot platforms in two settings: (i) tabletop grasping, placement, and box insertion in indoor mobile manipulation (Mobipick) and (ii) autonomous agricultural navigation and sensing (Valdemar). Both settings involve uncertainty, partial observability, sensor noise, and ambiguous natural-language commands. The system exposes structured introspection of its planning and decision process, reacts to exogenous events via explicit event checks, and supports operator interventions that modify or redirect ongoing execution. Across both platforms, our proof-of-concept experiments reveal substantial fragility, including non-deterministic suboptimal behavior, instruction-following errors, and high sensitivity to prompt specification. At the same time, the architecture is flexible: transfer to a different robot and task domain largely required updating the system prompt (domain model, affordances, and action catalogue) and re-binding the same tool interface to the platform-specific skill API.

机器人控制语言模型代理系统鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。