用大模型深度参与全流程,提升实体链接准确率与泛化能力。
Harnessing Deep LLM Participation for Robust Entity Linking
- 将大模型贯穿实体链接全阶段,实现端到端增强
- 平均F1提升2.6%,跨域数据上提升达4%
- 自验证机制利用全局上下文纠错,适合高精度场景
实体链接(EL)是将文本中的实体提及映射到知识库条目的基础任务。近期大语言模型(LLM)在提升EL性能方面展现出巨大潜力。已有研究通过改进实体消歧和输入表示来提升准确率与鲁棒性,但通常仅在局部阶段使用LLM,未能充分整合其能力。本文提出DeepEL框架,将LLM融入实体链接的每个环节。我们发现孤立消歧不足以达到最优效果,因此设计一种新型自验证机制,利用全局上下文信息让LLM自我修正预测,更好地识别同一句子中实体间的关联。在十个基准数据集上的大量实验证明,DeepEL显著优于现有最先进方法,在整体F1上平均提升2.6%,跨域数据上提升高达4%。结果表明,深度集成大模型能有效推动实体链接技术的发展。
原文摘要 · Abstract (English)
Entity Linking (EL), the task of mapping textual entity mentions to their corresponding entries in knowledge bases, constitutes a fundamental component of natural language understanding. Recent advancements in Large Language Models (LLMs) have demonstrated remarkable potential for enhancing EL performance. Prior research has leveraged LLMs to improve entity disambiguation and input representation, yielding significant gains in accuracy and robustness. However, these approaches typically apply LLMs to isolated stages of the EL task, failing to fully integrate their capabilities throughout the entire process. In this work, we introduce DeepEL, a comprehensive framework that incorporates LLMs into every stage of the entity linking task. Furthermore, we identify that disambiguating entities in isolation is insufficient for optimal performance. To address this limitation, we propose a novel self-validation mechanism that utilizes global contextual information, enabling LLMs to rectify their own predictions and better recognize cohesive relationships among entities within the same sentence. Extensive empirical evaluation across ten benchmark datasets demonstrates that DeepEL substantially outperforms existing state-of-the-art methods, achieving an average improvement of 2.6\% in overall F1 score and a remarkable 4% gain on out-of-domain datasets. These results underscore the efficacy of deep LLM integration in advancing the state-of-the-art in entity linking.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。