用逻辑与图结构结合,让语言模型的判断过程可解释且更准确。
Verified Language Processing with Hybrid Explainability: A Technical Report
- 融合逻辑与图结构生成可读的语义表示,提升可解释性。
- 在三类数据集上超越现有模型,尤其在逻辑推理任务中表现优异。
- 适合需要高可信度决策的场景,如法律、医疗文本分析。
数字信息量和多样性激增,推动自然语言处理技术在数据解读与检索中的广泛应用。尽管向量与图嵌入常用于相似性任务,但当前最先进的流程缺乏可保证的可解释性,无法准确判断全文相似性。此外,利用逻辑提示的生成式分类器虽经训练识别逻辑蕴含与无关性,却难以区分蕴含、无关与不一致。本文提出一种新型混合可解释性流水线,结合图结构与一阶逻辑,通过蒙塔古语法生成机器与人类均可读的语义表示。初步结果表明该方法能有效捕捉全文相似性。据我们所知,这是首个能明确区分蕴含、不一致与无关性的文本分类方法。我们使用三个独立标注的数据集评估其在句法等价性、逻辑连接词及时空推理上的表现,并与预训练的句子蕴含检测模型对比。结果显示,该方法优于当前最优模型,说明仅靠大规模语料训练难以实现自然语言理解的泛化。本工作为从海量文本中实现更透明、可靠的智能检索迈出了关键一步。
原文摘要 · Abstract (English)
The volume and diversity of digital information have led to a growing reliance on Machine Learning techniques, such as Natural Language Processing, for interpreting and accessing appropriate data. While vector and graph embeddings represent data for similarity tasks, current state-of-the-art pipelines lack guaranteed explainability, failing to determine similarity for given full texts accurately. These considerations can also be applied to classifiers exploiting generative language models with logical prompts, which fail to correctly distinguish between logical implication, indifference, and inconsistency, despite being explicitly trained to recognise the first two classes. We present a novel pipeline designed for hybrid explainability to address this. Our methodology combines graphs and logic to produce First-Order Logic representations, creating machine- and human-readable representations through Montague Grammar. Preliminary results indicate the effectiveness of this approach in accurately capturing full text similarity. To the best of our knowledge, this is the first approach to differentiate between implication, inconsistency, and indifference for text classification tasks. To address the limitations of existing approaches, we use three self-contained datasets annotated for the former classification task to determine the suitability of these approaches in capturing sentence structure equivalence, logical connectives, and spatiotemporal reasoning. We also use these data to compare the proposed method with language models pre-trained for detecting sentence entailment. The results show that the proposed method outperforms state-of-the-art models, indicating that natural language understanding cannot be easily generalised by training over extensive document corpora. This work offers a step toward more transparent and reliable Information Retrieval from extensive textual data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。