用量子理论重构语言模型,解释并优化词向量表示。
Universal language model with the intervention of quantum theory
- 将量子力学框架引入符号-语义对,构建语言表征新模型。
- 实验证明量子统计可描述自然语言的演化与分布特性。
- 适合对量子计算与语言建模交叉研究感兴趣的读者。
本文探讨基于量子力学理论的语言建模方法,重点将量子理论引入语言中的符号-语义对,以构建自然语言的表示模型。同时指出,广泛用于统计语言建模的词嵌入技术,可通过量子力学的数学框架得到解释与改进。在此基础上,尝试运用量子统计等理论研究自然语言的数学表示、自然演化及统计特性。假设这些量子特性源于信息的物理性。通过实验代码验证了利用量子理论建模自然语言的可行性,并讨论该理论在当前流行生成模型构建中的潜在帮助。最后初步展望了该理论在未来量子计算机上的应用前景。
原文摘要 · Abstract (English)
This paper examines language modeling based on the theory of quantum mechanics. It focuses on the introduction of quantum mechanics into the symbol-meaning pairs of language in order to build a representation model of natural language. At the same time, it is realized that word embedding, which is widely used as a basic technique for statistical language modeling, can be explained and improved by the mathematical framework of quantum mechanics. On this basis, this paper continues to try to use quantum statistics and other related theories to study the mathematical representation, natural evolution and statistical properties of natural language. It is also assumed that the source of such quantum properties is the physicality of information. The feasibility of using quantum theory to model natural language is pointed out through the construction of a experimental code. The paper discusses, in terms of applications, the possible help of the theory in constructing generative models that are popular nowadays. A preliminary discussion of future applications of the theory to quantum computers is also presented.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。