arXiv:2606.29407cs.CLcs.AI2026-06

用正负样本结合纠错标签提升少样本信息抽取效果

LC-ICL: Label-Guided Contrastive In-Context Learning for Robust Information Extraction

论文配图:LC-ICL: Label-Guided Contrastive In-Context Learning for Robust Information Extraction
图 1 · 摘自论文原文
  • 引入带错误原因标签的负样本增强上下文学习
  • 在多个数据集上显著优于传统少样本方法
  • 适合需要高鲁棒性的信息抽取应用场景

近年来,大型语言模型(LLMs)在信息抽取(IE)领域受到广泛关注,尤其在命名实体识别(NER)和关系抽取(RE)任务中。尽管已有研究探索使用少样本上下文学习(ICL)进行信息抽取,但大多仅依赖正确示例,忽视了错误示例的价值。本文提出LC-ICL,一种新型少样本技术,通过同时利用正确与错误样本构建示范,其中错误样本附带错误原因标签,揭示错误特征,使模型理解失败原因并避免重复犯错。该方法挖掘硬负样本及其最近邻正样本中的上下文信息,基于LLM构建示范。实验表明,LC-ICL在多个数据集上均显著优于现有方法,在多种任务中实现性能提升,展现了良好的通用性。

原文摘要 · Abstract (English)

There has been increasing interest in exploring the capabilities of advanced large language models (LLMs) in the field of information extraction (IE), specifically focusing on tasks related to named entity recognition (NER) and relation extraction (RE).Although researchers are exploring the use of few-shot information extraction through in-context learning with LLMs, they tend to focus only on using correct or positive examples for demonstration, neglecting the potential value of incorporating incorrect or negative examples into the learning process.In this paper, we present LC-ICL a novel few-shot technique that leverages both correct and incorrect sample constructions to create in-context learning demonstrations. This approach enhances the ability of LLMs to extract entities and relations by combining positive samples with negative samples annotated by error-cause labels. These labels expose more detailed error features in erroneous examples, enabling the model to understand why similar predictions fail and avoid repeating such errors during inference.Specifically, our proposed method taps into the inherent contextual information and valuable information in hard negative samples and the nearest positive neighbors to the test and then applies the in-context learning demonstrations based on LLMs. Our experiments on various datasets indicate that LC-ICL outperforms previous few-shot in-context learning methods, delivering substantial enhancements in performance across a broad spectrum of related tasks. These improvements are noteworthy, showcasing the versatility of our approach in diverse scenarios.

信息抽取少样本学习对比学习错误分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。