arXiv:2601.08500cs.CL2026-01Conference of the …被引 2

用大模型+小模型协同,无监督实现多语种历史实体链接

It's All About the Confidence: An Unsupervised Approach for Multilingual Historical Entity Linking using Large Language Models

  • 小模型判难易,只对难例调用大模型,节省算力
  • 在六种欧洲语言上超越现有方法,无需微调
  • 适合低资源历史文本处理,可直接部署使用

尽管大型语言模型(LLM)推动了自然语言处理的发展,但历史文本的实体链接仍面临语言差异、输入噪声和语义演变等挑战。现有方法要么需要大量训练数据,要么依赖特定领域规则,难以扩展。本文提出 MHEL-LLaMo(多语种历史实体链接结合大语言模型),一种无监督集成方法,融合小型语言模型(SLM)与大语言模型。该系统采用多语种双编码器(BELA)进行候选检索,通过提示链技术指令微调的 LLM 实现无实体识别(NIL)预测与候选选择。利用 SLM 的置信度区分简单与复杂样本,仅对困难样本启用 LLM,降低计算开销并避免简单场景下的幻觉。我们在六个欧洲语言(英语、芬兰语、法语、德语、意大利语、瑞典语)的四个历史基准上评估,涵盖19至20世纪文本。结果表明,MHEL-LLaMo 在无需微调的情况下优于现有最佳模型,为低资源历史实体链接提供了可扩展解决方案。代码已开源。

原文摘要 · Abstract (English)

Despite the recent advancements in NLP with the advent of Large Language Models (LLMs), Entity Linking (EL) for historical texts remains challenging due to linguistic variation, noisy inputs, and evolving semantic conventions. Existing solutions either require substantial training data or rely on domain-specific rules that limit scalability. In this paper, we present MHEL-LLaMo (Multilingual Historical Entity Linking with Large Language MOdels), an unsupervised ensemble approach combining a Small Language Model (SLM) and an LLM. MHEL-LLaMo leverages a multilingual bi-encoder (BELA) for candidate retrieval and an instruction-tuned LLM for NIL prediction and candidate selection via prompt chaining. Our system uses SLM's confidence scores to discriminate between easy and hard samples, applying an LLM only for hard cases. This strategy reduces computational costs while preventing hallucinations on straightforward cases. We evaluate MHEL-LLaMo on four established benchmarks in six European languages (English, Finnish, French, German, Italian and Swedish) from the 19th and 20th centuries. Results demonstrate that MHEL-LLaMo outperforms state-of-the-art models without requiring fine-tuning, offering a scalable solution for low-resource historical EL. The implementation of MHEL-LLaMo is available on Github.

实体链接历史文本大模型无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。