在通信受限下实现多智能体高效协同,动态优化通信范围以逼近最优决策。
Self-Configurable Mesh-Networks for Scalable Distributed Submodular Bandit Optimization
- 仅允许单跳通信且每轮只传自身动作,降低通信开销。
- 通过在线优化通信邻域,在任意网络拓扑下保持近优性能。
- 提出协调价值(VoC)度量,适用于资源受限的实时协同场景。
我们研究在带宽、数据速率和连通性等现实通信约束下,如何实现分布式子模带状优化的可扩展性。该问题源于未知、部分可观测且资源受限环境中多智能体主动态势感知任务,要求智能体通过点对点通信进行协调。本文方法通过(i)限制信息传递仅为单跳通信,(ii)保持智能体间消息极小,仅传输自身动作信息,实现可扩展性。尽管存在信息访问限制,通过分布式在线带状优化动态调整智能体通信邻域,可在满足带宽约束下实现近似最优协调。特别地,该方法在任意网络拓扑(甚至不连通)下均具有严格为正的即时次优性界。为此,我们引入协调价值(VoC)这一信息论度量,量化每个智能体从邻居信息中获得的收益。仿真验证表明,该方法收敛更快,优于基准方案,在带状子模协调任务中表现优异,甚至超越那些事先掌握环境信息的基准方案。
原文摘要 · Abstract (English)
We study how to scale distributed bandit submodular coordination under realistic communication constraints in bandwidth, data rate, and connectivity. We are motivated by multi-agent tasks of active situational awareness in unknown, partially-observable, and resource-limited environments, where the agents must coordinate through agent-to-agent communication. Our approach enables scalability by (i) limiting information relays to only one-hop communication and (ii) keeping inter-agent messages small, having each agent transmit only its own action information. Despite these information-access restrictions, our approach enables near-optimal action coordination by optimizing the agents' communication neighborhoods over time, through distributed online bandit optimization, subject to the agents' bandwidth constraints. Particularly, our approach enjoys an anytime suboptimality bound that is also strictly positive for arbitrary network topologies, even disconnected. To prove the bound, we define the Value of Coordination (VoC), an information-theoretic metric that quantifies for each agent the benefit of information access to its neighbors. We validate in simulations the scalability and near-optimality of our approach: it is observed to converge faster, outperform benchmarks for bandit submodular coordination, and can even outperform benchmarks that are privileged with a priori knowledge of the environment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。