arXiv:2605.14235cs.LGcs.MA2026-05

量子纠缠让多智能体强化学习实现超越经典极限的协作优势

Quantum Advantage in Multi Agent Reinforcement Learning

论文配图:Quantum Advantage in Multi Agent Reinforcement Learning
图 1 · 摘自论文原文
  • 用可变量子电路与共享纠缠态设计去中心化协同框架
  • 在CHSH游戏中达0.854胜率,突破经典上限0.75
  • 适合关注量子优势验证与混合量子-经典架构的研究者

我们对量子多智能体强化学习(QMARL)中量子纠缠在智能体协作中的作用进行了实证评估。尽管QMARL近年备受关注,但多数前期工作缺乏可证明的基线,难以区分量子优势与算法偶然性。本文通过采用带有共享纠缠态的可变量子电路(VQC)执行者,构建去中心化QMARL框架,直接解决此问题。在数学上已证明经典性能上限为0.75胜率的CHSH游戏中,纠缠型QMARL agents接近0.854的Tsirelson极限,提供明确量子优势证据。未纠缠的量子电路表现与经典基线一致,确认纠缠是关键协调机制。此外,特定贝尔态能提升协作性能,而部分则导致性能下降。在合作导航任务(CoopNav)中,无纠缠的QMARL相较经典MAA2C提升约2倍成功率(约0.85对0.40),混合配置(量子执行者+经典集中式评价者)优于全经典与全量子方案。

原文摘要 · Abstract (English)

We present an empirical evaluation of quantum entanglement in agent coordination within quantum multi agent reinforcement learning (QMARL). While QMARL has attracted growing interest recently, most prior work evaluates quantum policies without provable baselines, making it impossible to rigorously distinguish quantum advantage from algorithmic coincidence. We address this directly by evaluating a decentralized QMARL framework with variational quantum circuit (VQC) actors with shared entangled states. In the CHSH game, which has a mathematically proven classical performance ceiling of 0.75 win rate, we show that entangled QMARL agents approach the Tsirelson limit of 0.854, providing clear evidence of their quantum advantage. We show that unentangled quantum circuits match the classical baseline, confirming that entanglement and not the quantum circuit itself is the active coordination mechanism. We also explore the effect of specific entanglement structures, as some Bell states enable coordination gains while others actively harm performance. On cooperative navigation (CoopNav), QMARL without entanglement achieves $\sim2\times$ improvement in success rate over classical MAA2C ($\sim$0.85 versus $\sim$0.40), with the hybrid configuration, quantum actor paired with a classical centralised critic, outperforming both fully classical and fully quantum solutions. We present our experimental analysis and discuss future work.

量子强化学习多智能体纠缠优势

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。