量子隐马尔可夫模型首次在非量子数据上超越经典模型,靠新算法实现高效训练。
Newton-Schulz Retraction-Based Inference Enables Hidden Quantum Markov Models to Outperform Classical HMMs

- 基于牛顿-舒尔茨投影的优化方法,避免复杂分解,提升训练效率。
- 在合成与真实数据上,性能比经典HMM和现有量子模型平均提升38.5%以上。
- 适合处理高维科学序列数据,尤其适用于需强表达能力的建模任务。
隐马尔可夫模型(HMM)广泛用于离散序列建模,但面对复杂隐藏动态时受限。隐量子马尔可夫模型(HQMM)通过用密度矩阵替代概率向量、量子操作替代随机转移,实现更丰富的潜在表示。然而,现有HQMM学习方法在非量子生成数据上未能持续超越期望最大化(EM)训练的HMM,限制了其实际应用。本文提出NS-RIS——基于牛顿-舒尔茨投影的斯蒂费尔流形推理算法,可扩展地学习保迹的HQMM。该方法利用牛顿-舒尔茨正交化计算极值因子搜索方向,同时保持流形可行性,避免高成本矩阵分解。我们进一步在标准光滑性、随机梯度及有限牛顿-舒尔茨精度假设下建立了有限时间驻留性保证。实验表明,NS-RIS首次提供了基准证据:即使在非量子生成数据上,HQMM仍能显著优于EM训练的HMM。在合成HMM生成的基准上,相比EM和最优现有方法COSM,NS-RIS平均提升评估指标38.5%,最高达50.6%。在合成HQMM基准上,测试指标优于COSM 18.9%,运行时间减少12.0%。在真实世界剪接分类任务中,高维潜空间下,相比COSM,潜维6时分类误差降低17.9%,潜维8时降低14.9%。这些结果将HQMM从理论泛化推向实用且表达力强的科学序列建模工具。
原文摘要 · Abstract (English)
Hidden Markov models (HMMs) are widely used probabilistic models for discrete sequential data but can be limited when hidden dynamics are complex. Hidden quantum Markov models (HQMMs) generalize HMMs by replacing probability vectors with density matrices and stochastic transitions with quantum operations, enabling richer latent representations. However, existing HQMM learning methods have not consistently outperformed Expectation--Maximization (EM)-trained HMMs on data not generated by quantum processes, limiting their practical applicability. We introduce NS-RIS, Newton--Schulz Retraction-based Inference on the Stiefel manifold, a scalable algorithm for learning trace-preserving HQMMs. NS-RIS uses Newton--Schulz orthogonalization to compute a polar-factor search direction while preserving Stiefel-manifold feasibility, avoiding costly matrix decompositions. We further establish a finite-time stationarity guarantee under standard assumptions on smoothness, stochastic gradients, and finite Newton--Schulz accuracy. Empirically, NS-RIS provides the first benchmark evidence that an HQMM can significantly outperform an EM-trained HMM on data not generated by a quantum model. On synthetic HMM-generated benchmarks, NS-RIS outperforms both EM and the state-of-the-art HQMM method COSM, improving the evaluation metric by an average of 38.5% and by up to 50.6%. On a synthetic HQMM benchmark, it improves the test metric over COSM by 18.9% while reducing runtime by 12.0%. On the real-world Splice classification benchmark, NS-RIS also surpasses both EM and COSM in higher-dimensional latent regimes, reducing mean classification error by 17.9% for latent dimension 6 and 14.9% for latent dimension 8 relative to COSM. These results move HQMMs beyond a theoretical generalization of HMMs and establish them as practical and expressive models for scientific sequence data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。