arXiv:2505.23038cs.CL2025-05被引 3

用多个小模型集成提升命名实体识别效果,成本更低更安全。

EL4NER: Ensemble Learning for Named Entity Recognition via Multiple Small-Parameter Large Language Models

  • 用多个小参数大模型做集成学习,分阶段融合结果
  • 在多个数据集上达到SOTA,参数量远低于大模型
  • 适合资源有限但需高精度实体识别的场景

基于大语言模型(LLM)的上下文学习(ICL)技术在命名实体识别(NER)任务中因其低计算开销、少人工标注需求和强泛化能力而备受关注。然而,多数ICL方法依赖大参数模型:开源模型部署与推理耗能高,闭源模型则存在高API成本、数据隐私风险及阻碍社区协作问题。为此,我们提出面向命名实体识别的集成学习方法EL4NER,通过聚合多个开源小参数大模型的ICL输出,在降低部署与推理成本的同时提升整体性能。该方法包含三个核心组件:首先设计基于任务分解的流水线,支持深度多阶段集成学习;其次提出一种新的细粒度句子相似度算法,优化针对NER任务的示范样本检索机制;最后引入自验证机制,缓解集成过程中的噪声干扰。我们在多个跨领域主流NER数据集上评估了EL4NER,实验结果表明,其在参数量显著更低的情况下超越多数闭源大模型方法,并在部分数据集上达到当前ICL方法的最优表现。结果验证了EL4NER的参数高效性,证明了在ICL范式下使用开源小参数模型进行NER的可行性。

原文摘要 · Abstract (English)

In-Context Learning (ICL) technique based on Large Language Models (LLMs) has gained prominence in Named Entity Recognition (NER) tasks for its lower computing resource consumption, less manual labeling overhead, and stronger generalizability. Nevertheless, most ICL-based NER methods depend on large-parameter LLMs: the open-source models demand substantial computational resources for deployment and inference, while the closed-source ones incur high API costs, raise data-privacy concerns, and hinder community collaboration. To address this question, we propose an Ensemble Learning Method for Named Entity Recognition (EL4NER), which aims at aggregating the ICL outputs of multiple open-source, small-parameter LLMs to enhance overall performance in NER tasks at less deployment and inference cost. Specifically, our method comprises three key components. First, we design a task decomposition-based pipeline that facilitates deep, multi-stage ensemble learning. Second, we introduce a novel span-level sentence similarity algorithm to establish an ICL demonstration retrieval mechanism better suited for NER tasks. Third, we incorporate a self-validation mechanism to mitigate the noise introduced during the ensemble process. We evaluated EL4NER on multiple widely adopted NER datasets from diverse domains. Our experimental results indicate that EL4NER surpasses most closed-source, large-parameter LLM-based methods at a lower parameter cost and even attains state-of-the-art (SOTA) performance among ICL-based methods on certain datasets. These results show the parameter efficiency of EL4NER and underscore the feasibility of employing open-source, small-parameter LLMs within the ICL paradigm for NER tasks.

命名实体识别集成学习小模型ICL

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。