用连续博弈方法解决量子优化梯度消失问题,提升算法效率
Variational Quantum Optimization with Continuous Bandits
- 将量子参数优化转化为连续空间的最优臂识别问题
- 在连续空间中实现纯探索,首次给出信息理论下界
- 实测优于传统梯度法,在PQC与QAOA上显著提效
我们提出一种基于连续博弈的新方法来优化变分量子算法(VQA)。VQA是量子-经典混合算法,通过经典优化器调整量子电路参数。以往方法依赖零阶或一阶梯度,但面临梯度消失的荒原悬崖问题,导致梯度和损失差值指数级缩小。本文将VQA建模为具有利普希茨光滑性的连续空间中的最优臂识别问题。尽管该设定下的后悔最小化已有研究,但现有纯探索方法仅适用于离散空间。我们首次给出连续空间纯探索的信息理论下界,并在期望收益满足特定假设下,提出一个近似最优的简单算法。最后,我们将该连续博弈算法应用于两种VQA方案:通用量子线路(PQC)和量子近似优化算法(QAOA),实验表明其显著优于此前最先进的梯度方法。
原文摘要 · Abstract (English)
We introduce a novel approach to variational Quantum algorithms (VQA) via continuous bandits. VQA are a class of hybrid Quantum-classical algorithms where the parameters of Quantum circuits are optimized by classical algorithms. Previous work has used zero and first order gradient based methods, however such algorithms suffer from the barren plateau (BP) problem where gradients and loss differences are exponentially small. We introduce an approach using bandits methods which combine global exploration with local exploitation. We show how VQA can be formulated as a best arm identification problem in a continuous space of arms with Lipschitz smoothness. While regret minimization has been addressed in this setting, existing methods for pure exploration only cover discrete spaces. We give the first results for pure exploration in a continuous setting and derive a fixed-confidence, information-theoretic, instance specific lower bound. Under certain assumptions on the expected payoff, we derive a simple algorithm, which is near-optimal with respect to our lower bound. Finally, we apply our continuous bandit algorithm to two VQA schemes: a PQC and a QAOA quantum circuit, showing that we significantly outperform the previously known state of the art methods (which used gradient based methods).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。