arXiv:2605.13833cs.LGcs.CV2026-05

用量子叠加态增强长序列建模,提升记忆能力与效率

QLAM: A Quantum Long-Attention Memory Approach to Long-Sequence Token Modeling

论文配图:QLAM: A Quantum Long-Attention Memory Approach to Long-Sequence Token Modeling
图 1 · 摘自论文原文
  • 将量子叠加态引入状态空间模型,实现非经典全局更新
  • 在sMNIST等任务上优于传统Transformer和递归模型
  • 适合对长序列建模有需求的研究者,尤其是量子机器学习方向

序列数据中的长距离依赖建模仍是机器学习的核心挑战。虽然Transformer通过注意力机制应对此问题,但其随序列长度呈二次增长的复杂度限制了长上下文的可扩展性。状态空间模型(SSMs)以线性时间计算提供高效替代,但其记忆通常通过加性或线性变换形成,难以捕捉复杂的全局交互。本文首次提出利用量子系统的叠加特性来增强基于状态的序列建模,引入量子长注意记忆(QLAM),一种混合量子-经典记忆机制,可视为状态空间模型的量子扩展。不同于通过加性动态更新的经典隐状态,QLAM将隐藏状态表示为量子态,其振幅编码历史信息的叠加。状态通过条件于输入的参数化量子电路演化,实现非经典的全局更新机制。在此过程中,QLAM保持了SSM的递归与线性时间结构,同时通过量子叠加从根本上丰富了记忆表示。与显式计算成对交互的注意力机制不同,QLAM通过量子态演化隐式捕捉全局依赖,并通过查询相关的测量提取任务相关的信息。我们在标准图像分类基准的序列变体(包括sMNIST、sFashion-MNIST和sCIFAR-10)上评估了QLAM,其中图像被展平为标记序列。在所有任务中,QLAM均持续优于递归基线和基于Transformer的模型。

原文摘要 · Abstract (English)

Modeling long-range dependencies in sequential data remains a central challenge in machine learning. Transformers address this challenge through attention mechanisms, but their quadratic complexity with respect to sequence length limits scalability to long contexts. State-space models (SSMs) provide an efficient alternative with linear-time computation by evolving a latent state through recurrent updates, but their memory is typically formed via additive or linear transitions, which can limit their ability to capture complex global interactions across tokens. In this work, we introduce one of the first studies to leverage the superposition property of quantum systems to enhance state-based sequence modeling. In particular, we propose Quantum Long-Attention Memory (QLAM), a hybrid quantum-classical memory mechanism that can be viewed as a quantum extension of state-space models. Instead of maintaining a classical latent state updated through additive dynamics, QLAM represents the hidden state as a quantum state whose amplitudes encode a superposition of historical information. The state evolves through parameterized quantum circuits conditioned on the input, enabling a non-classical, globally update mechanism. In this way, QLAM preserves the recurrent and linear-time structure of SSMs while fundamentally enriching the memory representation through quantum superposition. Unlike attention mechanisms that explicitly compute pairwise interactions, QLAM implicitly captures global dependencies through the evolution of the quantum state, and retrieves task-relevant information via query-dependent measurements. We evaluate QLAM on sequential variants of standard image classification benchmarks, including sMNIST, sFashion-MNIST, and sCIFAR-10, where images are flattened into token sequences. Across all tasks, QLAM consistently improves over recurrent baselines and transformer-based models.

量子机器学习长序列建模状态空间模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。