arXiv:2602.07776cs.RO2026-02

让多机器人协作搬运时,一主一从角色更稳定一致。

CoLF: Learning Consistent Leader-Follower Policies for Vision-Language-Guided Multi-Robot Cooperative Transport

  • 用不对称策略让主从角色自然分化
  • 通过互信息最大化让跟随者预测领导者动作
  • 适合需要稳定协作的现实机器人场景

本文研究视觉语言引导的多机器人协同搬运任务,各机器人基于机载摄像头观测理解自然语言指令。在去中心化设置中,视角差异和语言模糊常导致感知不一致,影响协作效果。为此提出一致主从学习(CoLF)框架,采用依赖式主从结构:一个机器人担任领导者,另一个为跟随者。为解决对称智能体易产生对称或不稳定行为的问题,CoLF包含两个关键组件:(1) 不对称策略设计,诱导主从角色分化;(2) 基于互信息的训练目标,最大化变分下界,促使跟随者从自身局部观测预测领导者的动作。主从策略在集中训练、分散执行(CTDE)框架下联合优化,兼顾任务完成与一致协作行为。在两个四足机器人仿真与真实实验中验证了CoLF的有效性。演示视频见 https://sites.google.com/view/colf/。

原文摘要 · Abstract (English)

In this study, we address vision-language-guided multi-robot cooperative transport, where each robot grounds natural-language instructions from onboard camera observations. A key challenge in this decentralized setting is perceptual misalignment across robots, where viewpoint differences and language ambiguity can yield inconsistent interpretations and degrade cooperative transport. To mitigate this problem, we adopt a dependent leader-follower design, where one robot serves as the leader and the other as the follower. Although such a leader-follower structure appears straightforward, learning with independent and symmetric agents often yields symmetric or unstable behaviors without explicit inductive biases. To address this challenge, we propose Consistent Leader-Follower (CoLF), a multi-agent reinforcement learning (MARL) framework for stable leader-follower role differentiation. CoLF consists of two key components: (1) an asymmetric policy design that induces leader-follower role differentiation, and (2) a mutual-information-based training objective that maximizes a variational lower bound, encouraging the follower to predict the leader's action from its local observation. The leader and follower policies are jointly optimized under the centralized training and decentralized execution (CTDE) framework to balance task execution and consistent cooperative behaviors. We validate CoLF in both simulation and real-robot experiments using two quadruped robots. The demonstration video is available at https://sites.google.com/view/colf/.

多机器人主从协作视觉语言强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。