用量子退火器采样训练受限玻尔兹曼机,探索其缓解灾难性遗忘的潜力。
Investigation of D-Wave quantum annealing for training Restricted Boltzmann Machines and mitigating catastrophic forgetting
- 混合经典与量子采样,利用两者差异提升采样多样性
- 量子采样在低概率区域表现略优,但未显著改善模型训练
- 首次验证量子生成样本可有效缓解增量学习中的灾难性遗忘
本文研究了将D-Wave量子退火器(QA)用于受限玻尔兹曼机(RBMs)采样的统计差异,旨在解释以往研究中未见显著训练性能提升的原因。通过结合经典马尔可夫链蒙特卡洛(MCMC)与量子退火采样,探索了一种新型混合采样方法。结果表明,尽管量子采样在中低概率区域存在微小差异,但对整体样本质量影响有限,未能带来训练优势;这可能源于新代D-Wave硬件上嵌入RBMs时的高保真度挑战。然而,量子采样在生成多样化的低概率模式方面具备潜力,可用于缓解增量学习中的灾难性遗忘(CF)。本工作首次实证了使用量子退火生成的目标类别样本进行生成重放(generative replay)以缓解CF的可行性。虽然当前效率与经典方法相当,但生成大量独特模式的速度及改进空间使其在多种复杂机器学习任务中前景可观。
原文摘要 · Abstract (English)
Modest statistical differences between the sampling performances of the D-Wave quantum annealer (QA) and the classical Markov Chain Monte Carlo (MCMC), when applied to Restricted Boltzmann Machines (RBMs), are explored to explain, and possibly address, the absence of significant and consistent improvements in RBM trainability when the D-Wave sampling was used in previous investigations. A novel hybrid sampling approach, combining the classical and the QA contributions, is investigated as a promising way to benefit from the modest differences between the two sampling methods. No improvements in the RBM training are achieved in this work, thereby suggesting that the differences between the QA-based and MCMC sampling, mainly found in the medium-to-low probability regions of the distribution, which are less important for the quality of the sample, are insufficient to benefit the training. Difficulties in achieving sufficiently high quality of embedding RBMs into the lattice of the newer generation of D-Wave hardware could be further complicating the task. On the other hand, the ability to generate samples of sufficient variety from lower-probability parts of the distribution has a potential to benefit other machine learning applications, such as the mitigation of catastrophic forgetting (CF) during incremental learning. The feasibility of using QA-generated patterns of desirable classes for CF mitigation by the generative replay is demonstrated in this work for the first time. While the efficiency of the CF mitigation using the D-Wave QA was comparable to that of the classical mitigation, both the speed of generating a large number of distinct desirable patterns and the potential for further improvement make this approach promising for a variety of challenging machine learning applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。