arXiv:2606.20962cs.ROcs.MA2026-06被引 11

让不同能力的机器人团队高效通信协作,性能提升最高超7倍。

Heterogeneous Policy Networks for Composite Robot Team Communication and Coordination

论文配图:Heterogeneous Policy Networks for Composite Robot Team Communication and Coordination
图 1 · 摘自论文原文
  • 用异构策略网络建模不同机器人的角色差异,自适应通信
  • 跨多领域性能提升5.84%至707.65%,通信带宽减少200倍
  • 支持端到端训练二值化消息,适合复杂异构机器人团队

高性能的人类团队通过智能高效的沟通与协作策略实现整体效能最大化。这些团队隐含理解成员的角色差异,并据此调整通信方式。多智能体强化学习(MARL)尝试构建此类协同-通信策略的计算方法,但如何在状态、动作和观测空间各异的智能体间模拟异构通信模式仍具挑战。以往基于同质图网络的MARL方法因未充分建模智能体异质性,导致通信效果下降甚至损害团队表现。此前我们提出异构策略网络(HetNet),用于学习协调异构团队的高效多样通信模型。本文扩展了该方法,支持大规模异构机器人团队的可扩展性。基于异构图注意力网络,我们证明HetNet不仅能学习异构协作策略,还可实现端到端训练的高效二值化消息通信。实证评估显示,相较于次优基线,HetNet在多个领域中性能提升5.84%至707.65%,同时通信带宽降低200倍。

原文摘要 · Abstract (English)

High-performing human-human teams learn intelligent and efficient communication and coordination strategies to maximize their joint utility. These teams implicitly understand the different roles of heterogeneous team members and adapt their communication protocols accordingly. Multi-Agent Reinforcement Learning (MARL) has attempted to develop computational methods for synthesizing such joint coordination-communication strategies, but emulating heterogeneous communication patterns across agents with different state, action, and observation spaces has remained a challenge. Without properly modeling agent heterogeneity, as in prior MARL work that leverages homogeneous graph networks, communication becomes less helpful and can even deteriorate the team's performance. In the past, we proposed Heterogeneous Policy Networks (HetNet) to learn efficient and diverse communication models for coordinating cooperative heterogeneous teams. In this extended work, we extend Heterogeneous Policy Networks (HetNet) to support scaling heterogeneous robot teams. Building on heterogeneous graph-attention networks, we show that HetNet not only facilitates learning heterogeneous collaborative policies but also enables end-to-end training for learning highly efficient binarized messaging. Our empirical evaluation shows that HetNet sets a new state of the art in learning coordination and communication strategies for heterogeneous multi-agent teams by achieving an 5.84% to 707.65% performance improvement over the next-best baseline across multiple domains while simultaneously achieving a 200x reduction in the required communication bandwidth.

多智能体机器人协作异构网络通信优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。