arXiv:2501.15695cs.MAcs.AI2025-01被引 4

让智能体在目标与时间上下文中共享知识,提升协作效率

Contextual Knowledge Sharing in Multi-Agent Reinforcement Learning with Decentralized Communication and Coordination

  • 设计了基于目标和时间感知的去中心化知识共享机制
  • 在动态障碍环境中任务成功率显著优于现有方法
  • 适合需要自主决策与协同的复杂多智能体系统

去中心化多智能体强化学习(Dec-MARL)已成为应对动态环境中复杂任务的关键方法。现有MARL方法通常假设智能体具有共同目标并依赖集中控制,但现实场景中智能体常有独立目标且观测受限,导致协调困难、适应性差。现有Dec-MARL策略往往只侧重通信或协调,缺乏二者融合的统一框架。本文提出一种新型Dec-MARL框架,整合点对点通信与协调机制,将目标感知和时间感知引入知识共享过程。该框架使智能体具备:(i) 分享上下文相关知识以辅助其他智能体;(ii) 基于多智能体信息推理,同时考虑自身目标与历史知识的时间上下文。我们在包含动态障碍物的多个复杂任务中评估该方法,结果表明引入目标感知与时间感知的知识共享能显著提升整体性能。

原文摘要 · Abstract (English)

Decentralized Multi-Agent Reinforcement Learning (Dec-MARL) has emerged as a pivotal approach for addressing complex tasks in dynamic environments. Existing Multi-Agent Reinforcement Learning (MARL) methodologies typically assume a shared objective among agents and rely on centralized control. However, many real-world scenarios feature agents with individual goals and limited observability of other agents, complicating coordination and hindering adaptability. Existing Dec-MARL strategies prioritize either communication or coordination, lacking an integrated approach that leverages both. This paper presents a novel Dec-MARL framework that integrates peer-to-peer communication and coordination, incorporating goal-awareness and time-awareness into the agents' knowledge-sharing processes. Our framework equips agents with the ability to (i) share contextually relevant knowledge to assist other agents, and (ii) reason based on information acquired from multiple agents, while considering their own goals and the temporal context of prior knowledge. We evaluate our approach through several complex multi-agent tasks in environments with dynamically appearing obstacles. Our work demonstrates that incorporating goal-aware and time-aware knowledge sharing significantly enhances overall performance.

多智能体强化学习知识共享去中心化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。