跨文档跨语言自然语言推理新方法,提升多语种长文本理解能力
Cross-Document Cross-Lingual NLI via RST-Enhanced Graph Fusion and Interpretability Prediction
- 用RST增强的图融合建模跨文档语义关系
- 在26语言数据集上超越传统模型与大模型表现
- 提供基于篇章单元的可解释性分析,适合需可信AI的研究者
自然语言推理(NLI)是自然语言处理的核心任务。尽管句级、文档级及跨语言NLI已有发展,跨文档跨语言自然语言推理(CDCL-NLI)仍基本未被探索。本文提出新范式CDCL-NLI,将NLI扩展至多文档、多语言场景。为此构建高质量数据集,包含25,410个实例,覆盖26种语言。针对此前方法的不足,提出融合RST增强图神经网络与可解释性感知预测的新方法:利用Rhetorical Structure Theory(RST)在异构图中建模跨文档上下文,基于词汇链实现结构感知的跨语言语义对齐;为提升可解释性,设计基于EDU(Elementary Discourse Unit)的可提取解释框架。大量实验表明,本方法显著优于传统NLI模型及大语言模型。研究推动了多文档多语言语境理解、幻觉消除与可解释性推理的发展。代码与数据已公开于https://github.com/Leonardo123-ui/CDCL_NLI。
原文摘要 · Abstract (English)
Natural Language Inference (NLI) is a fundamental task in natural language processing. While NLI has developed many sub-directions such as sentence-level NLI, document-level NLI and cross-lingual NLI, Cross-Document Cross-Lingual NLI (CDCL-NLI) remains largely unexplored. In this paper, we propose a novel paradigm: CDCL-NLI, which extends traditional NLI capabilities to multi-document, multilingual scenarios. To support this task, we construct a high-quality CDCL-NLI dataset including 25,410 instances and spanning 26 languages. To address the limitations of previous methods on CDCL-NLI task, we further propose an innovative method that integrates RST-enhanced graph fusion with interpretability-aware prediction. Our approach leverages RST (Rhetorical Structure Theory) within heterogeneous graph neural networks for cross-document context modeling, and employs a structure-aware semantic alignment based on lexical chains for cross-lingual understanding. For NLI interpretability, we develop an EDU (Elementary Discourse Unit)-level attribution framework that produces extractive explanations. Extensive experiments demonstrate our approach's superior performance, achieving significant improvements over both conventional NLI models as well as large language models. Our work sheds light on the study of NLI and will bring research interest on cross-document cross-lingual context understanding, hallucination elimination and interpretability inference. Our code and datasets are available at "https://github.com/Leonardo123-ui/CDCL_NLI" for peer review.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。