arXiv:2504.05855cs.CLcs.AI2025-04被引 2

用预训练模型融合语法与语义,提升指代消解准确率

Enhancing Coreference Resolution with Pretrained Language Models: Bridging the Gap Between Syntax and Semantics

  • 结合句法分析与语义角色标注,捕捉指代关系细微差别
  • 在多个数据集上超越传统系统,显著提升消歧准确率
  • 适合需要精准指代理解的NLP任务,如机器阅读理解

大型语言模型在自然语言处理任务中取得显著进展,包括指代消解。然而,传统方法因未能有效整合句法与语义信息,常难以区分指代关系。本研究提出一种创新框架,利用预训练语言模型增强指代消解性能。通过结合句法解析与语义角色标注,精确捕捉指代关系的细微差异。采用最先进的预训练模型获取上下文嵌入,并应用注意力机制进行微调,显著提升指代任务表现。在多个数据集上的实验结果表明,该方法优于传统指代消解系统,在消歧方面实现显著准确率提升。该成果不仅改善了指代消解效果,也对依赖精确指代理解的其他自然语言处理任务产生积极影响。

原文摘要 · Abstract (English)

Large language models have made significant advancements in various natural language processing tasks, including coreference resolution. However, traditional methods often fall short in effectively distinguishing referential relationships due to a lack of integration between syntactic and semantic information. This study introduces an innovative framework aimed at enhancing coreference resolution by utilizing pretrained language models. Our approach combines syntax parsing with semantic role labeling to accurately capture finer distinctions in referential relationships. By employing state-of-the-art pretrained models to gather contextual embeddings and applying an attention mechanism for fine-tuning, we improve the performance of coreference tasks. Experimental results across diverse datasets show that our method surpasses conventional coreference resolution systems, achieving notable accuracy in disambiguating references. This development not only improves coreference resolution outcomes but also positively impacts other natural language processing tasks that depend on precise referential understanding.

指代消解预训练模型语法语义融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。