为量子密度算子设计了可训练的生成模型框架,突破传统概率模型局限。
Density Operator Expectation Maximization
- 基于相对熵单调性构造算子下界,推导出密度算子期望最大化算法
- 新模型在相同资源下生成性能超越经典对应模型
- 适用于量子机器学习中的潜在变量建模,适合量子计算研究者
基于密度算子的机器学习正随着量子计算发展而兴起。当前基于密度算子的生成模型尚无法处理概率模型常规解决的任务。概率潜变量模型的进步依赖于期望-最大化(EM)框架,但其推广至密度算子面临算子不可交换性的挑战。本文证明相对熵单调性引出的不等式可作为密度算子的证据下界,并由此提出密度算子期望最大化(DO-EM)框架。通过信息几何论证,DO-EM中的期望步对应于Petz恢复映射。该算法应用于量子受限玻尔兹曼机,采用对比分歧近似最大化步梯度。本文还提出了量子交错深度玻尔兹曼机和量子高斯-伯努利受限玻尔兹曼机两个新模型,在相同计算资源与超参数条件下,生成性能优于其经典对应模型。
原文摘要 · Abstract (English)
Machine learning with density operators, the mathematical foundation of quantum mechanics, is gaining prominence with rapid advances in quantum computing. Generative models based on density operators cannot yet handle tasks that are routinely handled by probabilistic models. The progress of latent variable models, a broad and influential class of probabilistic unsupervised models, was driven by the Expectation-Maximization framework. Deriving such a framework for density operators is challenging due to the non-commutativity of operators. To tackle this challenge, an inequality arising from the monotonicity of relative entropy is demonstrated to serve as an evidence lower bound for density operators. A minorant-maximization perspective on this bound leads to Density Operator Expectation Maximization (DO-EM), a general framework for training latent variable models defined through density operators. Through an information-geometric argument, the Expectation step in DO-EM is shown to be the Petz recovery map. The DO-EM algorithm is applied to Quantum Restricted Boltzmann Machines, adapting Contrastive Divergence to approximate the Maximization step gradient. Quantum interleaved Deep Boltzmann Machines and Quantum Gaussian-Bernoulli Restricted Boltzmann Machines, new models introduced in this work, outperform their probabilistic counterparts on generative tasks when trained with similar computational resources and identical hyperparameters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。