arXiv:2510.19988cs.CLcs.AI2025-10

用大模型补全语义,用符号系统保证推理可靠,提升因果陈述理解的准确性。

LLM-Augmented Symbolic NLU System for More Reliable Continuous Causal Statement Interpretation

  • 大模型负责文本简化与知识补全,符号系统生成可推理的结构化表示
  • 在常识科学文本中,混合方法比纯符号系统显著提升因果关系提取效果
  • 适合需要高可靠推理的场景,如教育、医疗等安全敏感领域

尽管大型语言模型(LLMs)应用广泛,但其基于概率推断的特性使其易产生幻觉和输出不一致。相比之下,符号化自然语言理解(NLU)系统依赖于精心构建的词典、语义资源和语法语义规则,能生成可解释的关联表示,支持精确推理与增量可调试学习。然而,符号系统覆盖范围有限,且需稀缺的知识表示与语言学技能进行扩展维护。本文提出一种混合方法:利用LLMs进行重述与文本简化以增强覆盖范围,并作为信息源自动填补知识空白;同时借助符号NLU生成可用于推理与增量学习的结构化表示。我们在从常识科学文本中提取并解释数量与因果规律的任务上评估该方法,对比了符号化与纯LLM的流水线。结果表明,混合方法显著优于纯符号系统。

原文摘要 · Abstract (English)

Despite the broad applicability of large language models (LLMs), their reliance on probabilistic inference makes them vulnerable to errors such as hallucination in generated facts and inconsistent output structure in natural language understanding (NLU) tasks. By contrast, symbolic NLU systems provide interpretable understanding grounded in curated lexicons, semantic resources, and syntactic & semantic interpretation rules. They produce relational representations that can be used for accurate reasoning and planning, as well as incremental debuggable learning. However, symbolic NLU systems tend to be more limited in coverage than LLMs and require scarce knowledge representation and linguistics skills to extend and maintain. This paper explores a hybrid approach that integrates the broad-coverage language processing of LLMs with the symbolic NLU capabilities of producing structured relational representations to hopefully get the best of both approaches. We use LLMs for rephrasing and text simplification, to provide broad coverage, and as a source of information to fill in knowledge gaps more automatically. We use symbolic NLU to produce representations that can be used for reasoning and for incremental learning. We evaluate this approach on the task of extracting and interpreting quantities and causal laws from commonsense science texts, along with symbolic- and LLM-only pipelines. Our results suggest that our hybrid method works significantly better than the symbolic-only pipeline.

符号系统因果推理混合模型可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。