arXiv:2509.05729cs.CL2025-09被引 1

用量子计算建模词语上下文,提升低资源语言的语义表达

QCSE: A Pretrained Quantum Context-Sensitive Word Embedding for Natural Language Processing

  • 设计五种量子原生上下文矩阵计算方法,实现词语在语境中的独特编码
  • 在富拉尼语(小规模)和英语数据集上验证,有效捕捉上下文敏感性
  • 为低资源语言提供新范式,适合关注量子自然语言处理的研究者

量子自然语言处理(QNLP)通过量子计算能力为理解自然语言复杂性提供了新途径。本文提出一种预训练的量子上下文敏感词嵌入模型——QCSE,利用量子系统的特性学习语言中的上下文关系。该模型引入量子原生上下文学习机制,实现基于量子计算机的语言任务处理。核心是五种创新的上下文矩阵计算方法,包括指数衰减、正弦调制、相位偏移和基于哈希的变换,确保量子嵌入保持上下文敏感性,适用于对表达力要求高的下游任务。在富拉尼语(小规模非洲语言)和稍大规模英语语料库上进行评估,结果表明,QCSE不仅能有效捕捉上下文敏感性,还充分运用了量子系统的表现力来表示丰富、上下文感知的语言信息。富拉尼语的应用进一步凸显了QNLP在缓解低资源语言数据匮乏问题上的潜力。本工作证明了量子计算在自然语言处理中的强大能力,为将QNLP应用于多种实际语言任务开辟了新路径。

原文摘要 · Abstract (English)

Quantum Natural Language Processing (QNLP) offers a novel approach to encoding and understanding the complexity of natural languages through the power of quantum computation. This paper presents a pretrained quantum context-sensitive embedding model, called QCSE, that captures context-sensitive word embeddings, leveraging the unique properties of quantum systems to learn contextual relationships in languages. The model introduces quantum-native context learning, enabling the utilization of quantum computers for linguistic tasks. Central to the proposed approach are innovative context matrix computation methods, designed to create unique, representations of words based on their surrounding linguistic context. Five distinct methods are proposed and tested for computing the context matrices, incorporating techniques such as exponential decay, sinusoidal modulation, phase shifts, and hash-based transformations. These methods ensure that the quantum embeddings retain context sensitivity, thereby making them suitable for downstream language tasks where the expressibility and properties of quantum systems are valuable resources. To evaluate the effectiveness of the model and the associated context matrix methods, evaluations are conducted on both a Fulani corpus, a low-resource African language, dataset of small size and an English corpus of slightly larger size. The results demonstrate that QCSE not only captures context sensitivity but also leverages the expressibility of quantum systems for representing rich, context-aware language information. The use of Fulani further highlights the potential of QNLP to mitigate the problem of lack of data for this category of languages. This work underscores the power of quantum computation in natural language processing (NLP) and opens new avenues for applying QNLP to real-world linguistic challenges across various tasks and domains.

量子计算上下文嵌入低资源语言NLP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。