arXiv:2511.23347cs.LGeess.SP2025-11被引 1

多智能体动态记忆系统实现高效协同学习。

Distributed Dynamic Associative Memory via Online Convex Optimization

  • 基于树形通信结构的在线梯度更新算法,支持实时记忆共享。
  • 理论证明在非平稳环境下可实现路径依赖的动态误差控制。
  • 适合分布式强化学习与多智能体系统中的信息协作场景。

关联记忆(AM)支持线索-响应回忆,被广泛认为是现代神经架构(如Transformer)的关键机制。本文提出分布式动态关联记忆(DDAM),将经典AM扩展至多智能体与时变数据流场景。每个智能体维护本地记忆,需不仅存储自身关联,还需根据指定兴趣矩阵选择性记忆其他智能体信息。为此,我们提出一种基于树结构的分布式在线梯度下降算法(DDAM-TOGD),通过预设路由树实现智能体间实时通信与记忆更新。理论分析表明,该算法在平稳环境中具有次线性静态后悔,在非平稳环境中具有路径长度相关的动态后悔界。进一步提出组合式树结构设计策略,以最小化通信延迟,从而优化后悔上界。数值实验显示,相比共识型分布式优化等基线方法,DDAM-TOGD在准确性和鲁棒性方面表现更优,验证了其在动态分布式环境中的有效性。

原文摘要 · Abstract (English)

An associative memory (AM) enables cue-response recall, and it has recently been recognized as a key mechanism underlying modern neural architectures such as Transformers. In this work, we introduce the concept of distributed dynamic associative memory (DDAM), which extends classical AM to settings with multiple agents and time-varying data streams. In DDAM, each agent maintains a local AM that must not only store its own associations but also selectively memorize information from other agents based on a specified interest matrix. To address this problem, we propose a novel tree-based distributed online gradient descent algorithm, termed DDAM-TOGD, which enables each agent to update its memory on the fly via inter-agent communication over designated routing trees. We derive rigorous performance guarantees for DDAM-TOGD, proving sublinear static regret in stationary environments and a path-length dependent dynamic regret bound in non-stationary environments. These theoretical results provide insights into how communication delays and network structure impact performance. Building on the regret analysis, we further introduce a combinatorial tree design strategy that optimizes the routing trees to minimize communication delays, thereby improving regret bounds. Numerical experiments demonstrate that the proposed DDAM-TOGD framework achieves superior accuracy and robustness compared to representative online learning baselines such as consensus-based distributed optimization, confirming the benefits of the proposed approach in dynamic, distributed environments.

分布式学习在线优化多智能体记忆系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。