arXiv:2604.25902cs.CLcs.AI2026-04

用几何代数重构语言语义,让模型理解概念组合与层级关系。

Toward a Functional Geometric Algebra for Natural Language Semantics

  • 用克里福代数构建带类型和组合性的语义框架
  • 在 $n$ 维空间中扩展为 $2^n$ 维多向量空间,显式表达概念交互
  • 可解释性强,适配当前神经网络结构,支持推理与变换

分布式与神经网络语言语义方法几乎全部基于传统线性代数:向量、矩阵、张量及其运算。这些方法虽取得显著经验成功,但在组合语义、类型敏感性和可解释性方面仍存在持续的结构性局限。本文主张,几何代数(特别是克里福代数)为语义表征提供了数学上更优的基础,而功能型几何代数(FGA)框架将几何代数拓展为一种支持推断、变换与可解释性的类型化、组合性语义体系,同时完全兼容分布学习与现代神经架构。本文建立形式基础,指出几何代数具备三项线性代数所不具备的核心能力,通过详实案例展示算子级语义差异,并揭示当前变压器架构中隐含的几何代数操作可被显式化并扩展。核心观点并非单纯提升维度,而是增强结构组织:几何代数将 $n$ 维嵌入空间扩展为 $2^n$ 维多向量代数,使基本语义概念及其高阶交互均能在单一、一致的代数框架中表示。

原文摘要 · Abstract (English)

Distributional and neural approaches to natural language semantics have been built almost exclusively on conventional linear algebra: vectors, matrices, tensors, and the operations that accompany them. These methods have achieved remarkable empirical success, yet they face persistent structural limitations in compositional semantics, type sensitivity, and interpretability. I argue in this paper that geometric algebra (GA) -- specifically, Clifford algebras -- provides a mathematically superior foundation for semantic representation, and that a Functional Geometric Algebra (FGA) framework extends GA toward a typed, compositional semantics capable of supporting inference, transformation, and interpretability while retaining full compatibility with distributional learning and modern neural architectures. I develop the formal foundations, identify three core capabilities that GA provides and linear algebra does not, present a detailed worked example illustrating operator-level semantic contrasts, and show how GA-based operations already implicit in current transformer architectures can be made explicit and extended. The central claim is not merely increased dimensionality but increased structural organization: GA expands an $n$-dimensional embedding space into a $2^n$ multivector algebra where base semantic concepts and their higher-order interactions are represented within a single, principled algebraic framework.

语义建模几何代数组合语义可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。