用流模型提升多智能体协作效率,推理速度提升14.5倍
Multi-agent Coordination via Flow Matching
- 先用流模型学习联合行为表示,再蒸馏为单步决策策略
- 在12个环境34个数据集上实现推理速度提升14.5倍
- 适合需要高效实时决策的多智能体系统
本文提出MAC-Flow框架,解决多智能体协调中的性能与计算成本权衡问题。现有方法或计算慢(如基于去噪扩散),或对交互敏感(如高斯策略)。MAC-Flow首先学习联合行为的流表示,再将其蒸馏为去中心化的单步策略,在保持协调性的同时实现快速执行。在包含12个环境和34个数据集的四个基准测试中,该方法相比扩散类多智能体强化学习(MARL)方法实现约×14.5倍的推理加速,同时推理速度与先前高斯策略方法相当。
原文摘要 · Abstract (English)
This work presents MAC-Flow, a simple yet expressive framework for multi-agent coordination. We argue that requirements of effective coordination are twofold: (i) a rich representation of the diverse joint behaviors present in offline data and (ii) the ability to act efficiently in real time. However, prior approaches often sacrifice one for the other, i.e., denoising diffusion-based solutions capture complex coordination but are computationally slow, while Gaussian policy-based solutions are fast but brittle in handling multi-agent interaction. MAC-Flow addresses this trade-off by first learning a flow-based representation of joint behaviors, and then distilling it into decentralized one-step policies that preserve coordination while enabling fast execution. Across four different benchmarks, including $12$ environments and $34$ datasets, MAC-Flow alleviates the trade-off between performance and computational cost, specifically achieving about $\boldsymbol{\times14.5}$ faster inference compared to diffusion-based MARL methods, while maintaining good performance. At the same time, its inference speed is similar to that of prior Gaussian policy-based offline multi-agent reinforcement learning (MARL) methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。