并行生成多智能体组合优化新框架,提升协同效率与推理速度。
PARCO: Parallel AutoRegressive Models for Multi-Agent Combinatorial Optimization
- 采用基于Transformer的通信层实现多智能体并行协作
- 通过多重指针机制实现低延迟并行决策,显著减少计算耗时
- 引入优先级冲突处理机制,提升解的质量与泛化能力
多智能体组合优化问题因其NP难性质和对有效协同的依赖而极具挑战。尽管学习方法有所进展,现有方法仍存在协同效果不佳、泛化能力弱及计算延迟高等问题。为此,我们提出PARCO(Parallel AutoRegressive Combinatorial Optimization),一种通用强化学习框架,可高效构建高质量多智能体组合解。PARCO融合三项创新:(1) 基于Transformer的通信层,促进并行求解过程中的智能体协作;(2) 多重指针机制,实现低延迟并行决策;(3) 基于优先级的冲突处理机制,通过学习到的优先级解决决策冲突。我们在多智能体车辆路径与调度任务中评估PARCO,结果表明其优于当前最优学习方法,在泛化能力与计算效率方面表现卓越。代码已开源:https://github.com/ai4co/parco。
原文摘要 · Abstract (English)
Combinatorial optimization problems involving multiple agents are notoriously challenging due to their NP-hard nature and the necessity for effective agent coordination. Despite advancements in learning-based methods, existing approaches often face critical limitations, including suboptimal agent coordination, poor generalization, and high computational latency. To address these issues, we propose PARCO (Parallel AutoRegressive Combinatorial Optimization), a general reinforcement learning framework designed to construct high-quality solutions for multi-agent combinatorial tasks efficiently. To this end, PARCO integrates three key novel components: (1) transformer-based communication layers to enable effective agent collaboration during parallel solution construction, (2) a multiple pointer mechanism for low-latency, parallel agent decision-making, and (3) priority-based conflict handlers to resolve decision conflicts via learned priorities. We evaluate PARCO in multi-agent vehicle routing and scheduling problems, where our approach outperforms state-of-the-art learning methods, demonstrating strong generalization ability and remarkable computational efficiency. We make our source code publicly available to foster future research: https://github.com/ai4co/parco.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。