用层叠优化框架让多智能体协作解难题,能自动学协调机制。
Learning Multi-Agent Coordination via Sheaf-ADMM

- 基于层叠优化的多智能体协同架构,通过局部视图和约束协调
- 在数独、迷宫寻路等任务中实现比基线更高的求解率
- 结构可分析可干预,适合研究协作机制的场景
我们提出一种用于多智能体协调的可微优化框架。输入被分解为重叠的局部视图,每个视图由一个智能体处理,该智能体通过神经编码器参数化的凸子问题求解。智能体通过交替方向乘子法(ADMM)进行协调,邻近智能体间的约束由细胞层叠(cellular sheaf)指定。层叠定义了相邻解之间必须一致的方面,支持异构的全局共识概念。通过展开优化过程反向传播,联合训练整个多智能体系统。我们在迷宫路径规划、图像分类和数独求解任务上进行了评估,结果显示仅具有局部视图的智能体能学会协作生成正确全局输出。在MNIST上,局部视图分解相比标准CNN提升了对分布偏移的鲁棒性;在数独任务中,优化推导出的结构显著优于参数匹配的图神经网络基线。此外,ADMM结构揭示了独立的原始、共识与对偶状态变量,使协调动态可直接分析与干预,这是传统消息传递架构所不具备的特性。
原文摘要 · Abstract (English)
We present a differentiable optimization framework for multi-agent coordination. An input is decomposed into overlapping local views, each processed by an agent that solves a convex subproblem parameterized by a neural encoder. Agents coordinate through the Alternating Direction Method of Multipliers (ADMM) with inter-agent constraints specified by a cellular sheaf. The sheaf specifies which aspects of neighboring solutions must agree, allowing for heterogeneous notions of global consensus. Backpropagating through the unrolled optimization jointly trains all components of the multi-agent system. We evaluate on maze pathfinding, image classification, and Sudoku, where agents with individually insufficient local views learn to coordinate to produce correct global outputs. On MNIST, the local-view decomposition yields improved robustness to distribution shifts relative to a standard CNN. On Sudoku, the optimization-derived structure yields markedly higher solve rates than parameter-matched MPNN baselines. Finally, the ADMM structure exposes distinct primal, consensus, and dual state variables, opening the coordination dynamics to direct analysis and intervention -- a property unavailable in standard message-passing architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。