用单量子比特电路实现高效序列建模,参数少却精度高。
Gated QKAN-FWP: Scalable Quantum-inspired Sequence Learning

- 用单量子比特数据重加载机制替代传统激活函数,提升非线性表达能力。
- 12.5k参数模型在528个月输入下预测误差低于经典模型,参数量少至1/13。
- 可在真实量子设备上运行,噪声环境下仍保持99.9%准确率,适合资源受限场景。
快速权重程序员(FWP)通过动态更新参数来捕捉时间依赖关系,而非使用循环隐藏状态。量子FWP(QFWP)引入变分量子电路(VQC),但现有实现依赖多量子比特架构,在噪声中等规模量子(NISQ)设备上难以扩展,且经典模拟成本高昂。本文提出门控量子启发的Kolmogorov-Arnold网络快速权重框架(gated QKAN-FWP),将FWP与量子启发的Kolmogorov-Arnold网络(QKAN)结合,采用单量子比特数据重加载电路作为可学习的非线性激活函数(DARUAN)。进一步提出标量门控快速权重更新规则,通过理论分析证明其具备自适应记忆核、几何有界性和可并行梯度路径。在时间序列基准、MiniGrid强化学习任务中进行评估,并以实际太阳周期预测为关键应用。在长达528个月输入窗口和132个月预测周期的长期设定下,仅12.5k参数的模型在缩放均方误差(MSE)、峰值振幅误差和峰值时序误差上优于多类经典循环基线(包括参数达25.9k–89.1k的LSTM、167k的WaveNet-LSTM、11.5k的Vanilla RNN和132k的改进回声状态网络)。为验证NISQ兼容性,将训练好的快速程序员部署于IonQ和IBM量子处理器,1024次采样后恢复精度与无噪声模拟器相比仅差0.1%相对MSE。结果表明,gated QKAN-FWP是一种可扩展、参数高效且兼容NISQ设备的量子启发序列建模方法。
原文摘要 · Abstract (English)
Fast Weight Programmers (FWPs) encode temporal dependencies through dynamically updated parameters rather than recurrent hidden states. Quantum FWPs (QFWPs) extend this idea with variational quantum circuits (VQCs), but existing implementations rely on multi-qubit architectures that are difficult to scale on noisy intermediate-scale quantum (NISQ) devices and expensive to simulate classically. We propose gated QKAN-FWP, a fast-weight framework that integrates FWP with Quantum-inspired Kolmogorov-Arnold Network (QKAN) using single-qubit data re-uploading circuits as learnable nonlinear activation, known as DatA Re-Uploading ActivatioN (DARUAN). We further introduce a scalar-gated fast-weight update rule that stabilizes parameter evolution, supported by a theoretical analysis of its adaptive memory kernel, geometric boundedness, and parallelizable gradient paths. We evaluate the framework across time-series benchmarks, MiniGrid reinforcement learning, and highlight real-world solar cycle forecasting as our main practical result. In the long-horizon setting with 528-month input window and 132-month forecast horizon, our 12.5k-parameter model achieves lower scaled Mean Square Error (MSE), peak amplitude error, and peak timing error than a suite of classical recurrent baselines with up to 13x more parameters, including Long Short-Term Memory (LSTM) networks (25.9k-89.1k parameters), WaveNet-LSTM (167k), Vanilla recurrent neural network (11.5k), and a Modified Echo State Network (132k). To validate NISQ compatibility, we further deploy the trained fast programmer on IonQ and IBM Quantum processors, recovering forecasting accuracy within 0.1% relative MSE of the noiseless simulator at 1024 shots. These results position gated QKAN-FWP as a scalable, parameter-efficient, and NISQ-compatible approach to quantum-inspired sequence modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。