提出融合大模型与知识图谱的理论框架,解决二者结构不匹配问题。
Overcoming the Impedance Mismatch: A Theoretical Roadmap for Fusing Foundation Models and Knowledge Graphs
- 构建三层次神经符号整合体系,揭示现有方法的根本缺陷。
- 指出词汇瓶颈与拓扑坍塌导致推理错误与语义混淆。
- 提出结构残差流等新机制,实现符号结构原生内化。
现代人工智能在连续概率空间的大模型与离散确定性结构的知识图谱之间存在根本分裂。尽管检索增强生成(RAG)试图通过将图数据序列化为文本来连接二者,但我们认为这种词汇桥接只是表面修补。本文形式化了底层结构与几何摩擦,称为‘阻抗不匹配’。通过将当前神经符号融合策略归入三层架构,我们证明仅靠表面提示注入或连续表示对齐无法保持多跳推理所需的严格逻辑模式。我们定义了具体数学极限,如词汇瓶颈与拓扑坍塌,表明现有架构终将产生幻觉或混淆语义节点。为实现真正的语义融合,我们提出严谨的理论路线图:倡导通过结构残差流原生内化离散符号结构,利用向量符号架构进行潜在子图注入,并通过正交子空间编辑更新模型。该可操作框架为实现符号逻辑精度与参数记忆表达力无缝融合的模型铺平道路。
原文摘要 · Abstract (English)
Modern artificial intelligence remains fundamentally divided between the continuous, probabilistic spaces of Foundation Models and the discrete, deterministic structures of Knowledge Graphs. While Retrieval-Augmented Generation (RAG) attempts to connect them by serializing graph data into text, we argue this lexical bridging is merely a superficial patch. In this paper, we formalize the underlying structural and geometric friction as the \textit{Impedance Mismatch}. By categorizing current neuro-symbolic integration strategies into a three-tiered hierarchy, we demonstrate that neither surface-level prompt injection nor continuous representation alignment can preserve the strict logical motifs required for reliable multi-hop reasoning. We define the specific mathematical limits, such as the Lexical Bottleneck and Topological Collapse, that show current architectures will eventually hallucinate or conflate semantic nodes. To achieve true semantic fusion, we propose a rigorous theoretical roadmap. We advocate for natively internalizing discrete symbolic structures through Structured Residual Streams, utilizing Vector Symbolic Architectures for latent sub-graph injection, and performing model updates via Orthogonal Subspace Editing. This actionable framework paves the way for models that seamlessly fuse the precision of symbolic logic with the expressivity of parametric memory.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。