用量子行走解决带空间限制的最优臂识别问题
Quantum spatial best-arm identification via quantum walks
- 基于量子行走构建图结构上的动作叠加态
- 在完全图和二分图上实现了最优臂识别成功概率上限
- 为量子决策在结构化环境中的应用提供新框架
量子强化学习将量子计算与序列决策结合,已应用于多臂赌博机(MAB)问题。图赌博机问题在MAB基础上引入空间约束,即臂的可访问性受图连通性限制,但该场景下的量子方法仍有限。本文提出量子空间最优臂识别(QSBAI)框架,适用于一般图结构。该框架利用量子行走对图约束动作进行叠加编码,扩展振幅放大,并通过Szegedy行走框架推广量子最优臂识别算法。我们聚焦于完全图和二分图的理论分析,推导出识别最优臂的最大成功概率及达到该概率的时间步数。结果阐明了量子行走搜索如何适配结构化约束决策问题,并为图结构环境中量子最优臂识别奠定基础。
原文摘要 · Abstract (English)
Quantum reinforcement learning has emerged as a framework combining quantum computation with sequential decision-making, and applications to the multi-armed bandit (MAB) problem have been reported. The graph bandit problem extends the MAB setting by introducing spatial constraints, where the accessibility of arms is restricted by graph connectivity, yet quantum approaches to this setting remain limited. In this paper, we formulate best-arm identification in graph bandits and propose a quantum algorithmic framework, termed Quantum Spatial Best-Arm Identification (QSBAI), which is applicable to general graph structures. This framework uses quantum walks to encode superpositions over graph-constrained actions, thereby extending amplitude amplification and generalizing the quantum BAI algorithm via Szegedy's walk framework. We focus our theoretical analysis on complete and bipartite graphs, deriving the maximal success probability of identifying the best arm and the time step at which it is achieved. Our results clarify how quantum-walk-based search can be adapted to structurally constrained decision problems and provide a foundation for quantum best-arm identification in graph-structured environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。