多智能体通过预测编码构建共享空间记忆,高效协作抗带宽下降。
Shared Spatial Memory Through Predictive Coding
- 用预测编码最小化智能体间互不确定,自动生成空间编码与通信策略。
- 带宽降至4位/步时仍保持64.4%成功率,远超全广播基准的28.6%。
- 模拟海马体社会位置细胞,适合研究具身智能与群体协作系统。
在多智能体系统中,部分可观测性和有限带宽常导致协作崩溃。本文提出一种基于预测编码的多智能体框架,将协作建模为最小化智能体间互不确定性。通过信息瓶颈目标,智能体自发学习通信内容、对象与时机。其内部空间编码由自监督运动预测自发生成,类似网格细胞。在此基础上,智能体发展出高效通信机制与编码伙伴位置的神经群体,类比海马体社会位置细胞(SPCs)。层级强化学习策略主动探索以降低联合不确定性。在Memory-Maze基准上,带宽从128降至4比特/步时,成功率仅从73.5%降为64.4%,而全广播基线从67.6%骤降至28.6%。结果表明,统一的预测驱动力可催生复杂社会表征,实现集体智能。
原文摘要 · Abstract (English)
Constructing a consistent shared spatial memory is a critical challenge in multi-agent systems, where partial observability and limited bandwidth often lead to catastrophic failures in coordination. We introduce a multi-agent predictive coding framework that formulates coordination as the minimization of mutual uncertainty among agents. Through an information bottleneck objective, this framework prompts agents to learn not only who and what to communicate but also when. At the foundation of this framework lies a grid-cell-like metric as internal spatial coding for self-localization, emerging spontaneously from self-supervised motion prediction. Building upon this internal spatial code, agents gradually develop a bandwidth-efficient communication mechanism and specialized neural populations that encode partners' locations-an artificial analogue of hippocampal social place cells (SPCs). These social representations are further utilized by a hierarchical reinforcement learning policy that actively explores to reduce joint uncertainty. On the Memory-Maze benchmark, our approach shows exceptional resilience to bandwidth constraints: success degrades gracefully from 73.5% to 64.4% as bandwidth shrinks from 128 to 4 bits/step, whereas a full-broadcast baseline collapses from 67.6% to 28.6%. Our findings establish a theoretically principled and biologically plausible basis for how complex social representations emerge from a unified predictive drive, leading to collective intelligence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。