提出有界门控机制,解决量子序列模型长期记忆发散问题。
Stable Self-Modulating Quantum Fast-Weight Programmers with Bounded Memory Gates

- 用符号保持的tanh门控限制旧状态更新,防止发散。
- 在量子动力学和短信预测任务中,有界门控提升稳定性与性能。
- 适合关注量子序列建模稳定性的研究者和工程师。
量子快速权重程序员(QFWP)通过动态编程变分电路参数存储时序信息,而非非线性循环隐藏状态,为量子序列建模提供实用路径。自调节QFWP利用输入依赖门控同时调控新权重更新与累积权重状态,但其旧状态乘子无界,在长序列场景下可能发散。本文提出有界旧状态调制规则:仅对递归记忆分支应用符号保持的tanh门控,而保留加性更新与新更新调制不变。在两个CUDA-Q量子动力学预测任务及米兰短信通信活动预测任务上评估了标准QFWP、完整自调节QFWP、仅新更新、仅旧状态调制四种变体。量子动力学结果表明,旧状态调制是相对于标准QFWP最一致的改进来源,且有界门控可消除长序列发散并增强整体鲁棒性。在米兰短信预测中,原始无界自调节QFWP在测试网格上均收敛,且在较长输入窗口时表现最优,行为接近仅旧状态调制消融实验。这些发现确认累积记忆调制是自调节QFWP的核心机制,有界旧状态门控是一种针对性稳定策略。
原文摘要 · Abstract (English)
Quantum Fast-Weight Programmers (QFWPs) store temporal information in dynamically programmed variational-circuit parameters rather than in nonlinear recurrent hidden states, offering a practical route to quantum sequence modeling. Self-Modulating QFWP improves this framework by using input-dependent gates for both new fast-weight updates and the accumulated fast-weight state, but its unbounded old-state multiplier can diverge in long-sequence regimes. We propose a bounded old-state modulation rule that applies a sign-preserving tanh gate only to the recurrent memory branch while leaving the additive update and new-update modulation unchanged. We evaluate standard QFWP, full Self-Modulating QFWP, Only-New, and Only-Old variants on two CUDA-Q quantum-dynamics forecasting tasks and on Milan SMS telecommunication activity prediction. The quantum-dynamics results show that old-state modulation is the most consistent source of improvement over Standard QFWP, and that bounding the old-state gate removes long-sequence divergence while improving aggregate robustness. On Milan SMS forecasting, the original unbounded Self-Modulating QFWP converges across the tested grid and shows its clearest gains at longer input windows, with behavior close to the Only-Old ablation. These findings identify accumulated-memory modulation as the key mechanism of Self-Modulating QFWP and bounded old-state gating as a targeted stabilization strategy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。