通过分层交互推理提升文本蕴含关系判断能力
Boosting Neural Language Inference via Cascaded Interactive Reasoning
- 设计分层交互网络,逐级融合跨句子语义信息
- 在多个基准数据集上超越现有模型,提升显著
- 适合需要深度语义推理的自然语言理解任务
自然语言蕴含(NLI)旨在判断前提与假设之间的逻辑关系(蕴含、矛盾或中立)。该任务因语言表达多样、语义复杂及上下文细微差异而极具挑战。尽管基于Transformer的预训练语言模型(PLMs)在NLI上取得显著进展,但主流方法仅依赖最后一层表示,可能忽略中间层蕴含的丰富信息,限制了对复杂语义关系的建模能力。为此,本文提出分层交互推理网络(CIRN),一种支持多层级特征提取的新型架构。CIRN在交互空间中持续整合跨句子信息,模拟逐步推理过程,从表层匹配推进到深层逻辑关联发现。通过系统挖掘不同表征层次的潜在语义关系,实现对输入对更深入的理解。在多个标准NLI基准数据集上的全面评估表明,CIRN相比先进基线模型表现更优,验证了利用多层次交互特征进行复杂关系推理的有效性。
原文摘要 · Abstract (English)
Natural Language Inference (NLI) focuses on ascertaining the logical relationship (entailment, contradiction, or neutral) between a given premise and hypothesis. This task presents significant challenges due to inherent linguistic features such as diverse phrasing, semantic complexity, and contextual nuances. While Pre-trained Language Models (PLMs) built upon the Transformer architecture have yielded substantial advancements in NLI, prevailing methods predominantly utilize representations from the terminal layer. This reliance on final-layer outputs may overlook valuable information encoded in intermediate layers, potentially limiting the capacity to model intricate semantic interactions effectively. Addressing this gap, we introduce the Cascaded Interactive Reasoning Network (CIRN), a novel architecture designed for deeper semantic comprehension in NLI. CIRN implements a hierarchical feature extraction strategy across multiple network depths, operating within an interactive space where cross-sentence information is continuously integrated. This mechanism aims to mimic a process of progressive reasoning, transitioning from surface-level feature matching to uncovering more profound logical and semantic connections between the premise and hypothesis. By systematically mining latent semantic relationships at various representational levels, CIRN facilitates a more thorough understanding of the input pair. Comprehensive evaluations conducted on several standard NLI benchmark datasets reveal consistent performance gains achieved by CIRN over competitive baseline approaches, demonstrating the efficacy of leveraging multi-level interactive features for complex relational reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。