解决多智能体通信延迟问题,让协作更稳定可靠
CoDe: Communication Delay-Tolerant Multi-Agent Collaboration via Dual Alignment of Intent and Timeliness
- 用未来动作推断构建意图表示,应对异步通信
- 双对齐机制融合意图与时效性,提升延迟场景表现
- 在3个基准上超越基线,支持固定与动态延迟
通信广泛用于增强多智能体协作,但以往研究多假设无延迟通信,这一强假设在现实中难以满足。实际智能体面临信道延迟,接收来自不同时刻的消息,称为异步通信,导致认知偏差并破坏协作。本文首次定义了MARL中的两种通信延迟设置,并强调其对协作的危害。为此提出新框架CoDe,首先通过未来动作推理学习意图表示作为消息;随后设计意图与时效性双重对齐机制,强化异步消息的融合过程。该方法使智能体即使在接收延迟消息时仍可提取对方长期意图,并仅选择与自身意图相关的最新信息。实验表明,CoDe在三个MARL基准上无延迟时优于基线算法,在固定和时变延迟下均表现出鲁棒性。
原文摘要 · Abstract (English)
Communication has been widely employed to enhance multi-agent collaboration. Previous research has typically assumed delay-free communication, a strong assumption that is challenging to meet in practice. However, real-world agents suffer from channel delays, receiving messages sent at different time points, termed {\it{Asynchronous Communication}}, leading to cognitive biases and breakdowns in collaboration. This paper first defines two communication delay settings in MARL and emphasizes their harm to collaboration. To handle the above delays, this paper proposes a novel framework, Communication Delay-tolerant Multi-Agent Collaboration (CoDe). At first, CoDe learns an intent representation as messages through future action inference, reflecting the stable future behavioral trends of the agents. Then, CoDe devises a dual alignment mechanism of intent and timeliness to strengthen the fusion process of asynchronous messages. In this way, agents can extract the long-term intent of others, even from delayed messages, and selectively utilize the most recent messages that are relevant to their intent. Experimental results demonstrate that CoDe outperforms baseline algorithms in three MARL benchmarks without delay and exhibits robustness under fixed and time-varying delays.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。