arXiv:2607.18961cs.AI2026-07

用组合范畴语法重构大模型输出,实现可审计的语义生成

From Dependency to Compositionality: A Neurosymbolic Lifting of LLM Outputs via Combinatory Categorial Grammar

  • 将自回归生成输出转化为分步可验证的组合范畴语法推导
  • 支持自然语言与编程语言等多形式语言的统一结构分析
  • 可早期发现幻觉内容,适合需要可信生成的场景

大语言模型通过逐词预测生成流畅文本,但其生成机制是否具备真正语法仍存争议。本文提出一种神经符号框架,将大模型输出映射为有类型、组合式的推导过程——并非声称模型内部使用组合范畴语法(CCG),而是其输出可被原则性地、增量式地重构为符合CCG的结构。这一方法基于柯里-霍华德对应关系,可扩展至编程语言(如Solidity)、描述逻辑和查询语言(如OWL、SQL),仅需调整类型系统而保持架构不变。该框架支持双重验证:组合层检测结构错误,内容层结合外部知识源识别幻觉内容,实现最早期的错误预警。最终,生成可信度不依赖认知,而取决于前缀驱动的生成特征。最后,本文展望了同步大模型与CCG耦合的未来方向。

原文摘要 · Abstract (English)

Large language models (LLMs) generate fluent text by incrementally predicting the next token from a prefix. Critics in the generative tradition argue that such systems lack genuine grammar; influential replies from the dependency-grammar perspective hold that LLM behavior is well described by local head-dependent structure built word by word. We argue that a sharper observation has been overlooked: the prefix-driven, type-completing dynamics of autoregressive generation align closely with the incremental processing model that Combinatory Categorial Grammar (CCG) was originally designed to support. On this basis we propose a neurosymbolic framework in which LLM outputs are lifted into typed compositional derivations -- not claiming that LLMs implement CCG internally, but that their outputs admit a principled, incremental, and auditable CCG reconstruction. Two consequences follow. First, through the Curry-Howard correspondence the lifting extends beyond natural language to the formal languages LLMs also produce -- programming languages such as Solidity, description-logic and query languages such as OWL and SQL -- with the type system varying and the architecture held fixed. Second, the lifting supports two layers of checking: a compositional layer that catches structural failures directly, and a content layer that checks the lifted structure against external knowledge sources, enabling the earliest possible flagging of hallucinated content. The account thereby requires of a producer not cognition but a prefix-driven generative profile. We close with a sketch of synchronous LLM-CCG coupling as one direction the framework opens.

神经符号语法解析可信生成组合范畴语法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。