多机器人协作导航中,用受限大模型提升策略稳定性,避免局部学习崩溃。
A Schema Bounded Language Model for Refining Robot Policies Without Destabilizing Local Learning

- 大模型仅在回合级生成策略,不直接控制动作,降低干扰
- 四组配置中完整方案全部成功达目标,平均用时42跳,最快90%完成73.2跳
- 适合需要稳定协作的异构机器人系统,尤其关注策略安全性的研究者
本文研究去中心化系统中异构机器人协同导航问题,其中策略推理与本地控制更新频率不同。在NetLogo-Python实现中,三台机器人共享运动模型但使用不同大语言模型(LLM)后端。每台机器人独立结合LLM策略代理、上置信界(UCB)老虎机和双深度Q网络(Double DQN)控制器;无中央LLM生成团队动作。LLM推理限于回合级策略生成与优化,而非逐周期动作选择。机器人通过共享回合摘要进行跨模型通信,内容包括策略、结果和学习反馈。UCB负责策略优化选择,策略条件化的Double DQN则从导航变量、激活策略参数及LLM动作先验中选出周期级动作。四个配置在30轮实验中评估,完整配置在90个机器人-回合记录中均达成目标,中位完成时间42跳,第90百分位为73.2跳,优于其他配置25.0%-39.1%。这些结果提供了配置层面的描述性证据。
原文摘要 · Abstract (English)
This paper addresses navigation by composite heterogeneous robots in a decentralized system when policy reasoning and local control operate at different update levels. In a NetLogo--Python implementation, three robots share motion dynamics but use different LLM backends. Each robot independently combines a large language model (LLM) policy agent, an Upper Confidence Bound (UCB) bandit, and a Double Deep Q-Network (Double DQN) controller; no central LLM generates team actions. LLM inference is confined to round-level policy generation and refinement rather than tick-level action selection. The robots perform cross-LLM communication through a shared round summary containing policies, outcomes, and learning feedback. UCB performs refinement-mode selection, and the policy-conditioned Double DQN performs tick-level action selection from navigation variables, active policy parameters, and the LLM action prior. Each of the four configurations was evaluated over 30 rounds. In the fixed simulation, the complete configuration reached the goal in all 90 correlated robot--round records and achieved the lowest median completion time (42 ticks) and P90 (73.2 ticks); its median was 25.0--39.1\% lower than those of the other configurations. These observations provide descriptive, configuration-level evidence from the evaluated configurations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。