arXiv:2608.14319cs.LGquant-ph2026-08

量子老虎机首次证明下界,算法实现更优的维度依赖。

Quantum Multi-Armed Bandits and Linear Bandits: Lower Bounds and Algorithms

  • 提出量子老虎机与线性老虎机的首个极小极大下界
  • 设计基于最优采样策略的算法,将维度依赖从d²降至d
  • 适合研究量子强化学习下界与高效算法的学者

我们研究了基于Wan等[2023]模型的量子多臂赌博机(QMAB)与量子线性赌博机(QLB)。已有算法在周期T内分别达到O(K log T)(K臂)和O(d² polylog T)(d维)的误差。本文首次证明了QMAB的最小最大下界为Ω(K log(T/K)),有限动作的QLB下界为Ω(d log(T/d)),解决了是否可实现与T无关误差的问题。核心是通过多项式方法和三角多项式Remez型不等式,建立高置信度单臂量子检验下界;再经带状到测试的归约和线性嵌入,导出下界。为互补,我们设计一种基于采样设计的消除算法,在动作集大小为poly(d)时,误差线性于d,优于之前的d²,并逼近下界(仅差polylog因子)。该算法结合低偏差低方差量子均值估计器与小支撑G-最优设计,查询分配匹配设计权重。使用量子蒙特卡洛估计时,维度依赖进一步降为d^{3/2};低方差估计使重构误差按方差聚合而非最坏情况绝对误差,消除了剩余的√d因子。

原文摘要 · Abstract (English)

We study quantum multi-armed bandits (QMAB) and quantum linear bandits (QLB) in the model of Wan et al. [2023], where the learner queries each arm or action through a quantum reward oracle or its inverse. Prior work gives algorithms over horizon $T$ with regret $O(K\log T)$ for QMAB with $K$ arms and $O(d^2\operatorname{polylog} T)$ for $d$-dimensional QLB. This leaves open whether the $K\log T$ scale is unavoidable and whether the $d^2$ dependence can be improved. We prove the first minimax lower bounds of $Ω(K\log(T/K))$ for QMAB and $Ω(d\log(T/d))$ for finite-action QLB, resolving the question raised by Wan et al. [2023] of whether regret independent of $T$ is achievable. At the heart of our argument is a high-confidence single-arm quantum testing lower bound for distinguishing a fixed reward mean from an interval of alternatives, proved by the polynomial method and a Remez-type inequality for trigonometric polynomials. A bandit-to-testing reduction then lifts it to the QMAB lower bound, while a linear embedding gives the finite-action QLB lower bound. Complementing the lower bounds, we give a design-based elimination algorithm for finite-action QLB. When the action set has size $\operatorname{poly}(d)$, its regret is linear in $d$, improving the prior $d^2$ dependence and matching our lower bound up to polylogarithmic factors. The algorithm couples a low-bias low-variance quantum mean estimator with a small-support $G$-optimal design through a query allocation matched to the design weights. The design-based elimination reduces the dimension dependence from $d^2$ to $d^{3/2}$ when using Quantum Monte Carlo estimates. The low-variance estimator then makes reconstruction error aggregate through variance rather than worst-case absolute error, removing the remaining $\sqrt d$ factor.

量子机器学习强化学习下界分析算法设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。