量子核方法中发现双下降现象,揭示大模型未必过拟合
Double descent in quantum kernel methods
- 基于随机矩阵理论,证明量子特征空间线性回归存在双下降
- 实测在不同数据集和系统规模下均出现测试误差峰值
- 为量子模型在过参数化下不过拟合提供理论支持
双下降现象挑战了传统统计学习理论,表明更大模型不一定导致未见数据性能下降。尽管该反直觉行为已在多种经典机器学习模型(尤其是现代神经网络架构)中被观察到,但在量子机器学习领域仍不明确。本文通过借鉴经典线性回归与随机矩阵理论,首次在量子特征空间的线性回归模型中实现双下降行为的严格分析。此外,我们在不同真实数据集和系统规模上对量子核方法进行数值实验,进一步验证了测试误差峰值的存在,这是双下降的典型特征。研究结果表明,量子模型可在现代过参数化范式下运行而无需过拟合,可能突破传统学习理论限制,为提升学习性能开辟新路径。
原文摘要 · Abstract (English)
The double descent phenomenon challenges traditional statistical learning theory by revealing scenarios where larger models do not necessarily lead to reduced performance on unseen data. While this counterintuitive behavior has been observed in a variety of classical machine learning models, particularly modern neural network architectures, it remains elusive within the context of quantum machine learning. In this work, we analytically demonstrate that linear regression models in quantum feature spaces can exhibit double descent behavior by drawing on insights from classical linear regression and random matrix theory. Additionally, our numerical experiments on quantum kernel methods across different real-world datasets and system sizes further confirm the existence of a test error peak, a characteristic feature of double descent. Our findings provide evidence that quantum models can operate in the modern, overparameterized regime without experiencing overfitting, potentially opening pathways to improved learning performance beyond traditional statistical learning theory.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。