让大模型像人一样推理,提升实体识别的准确性和泛化能力
A Reasoning Paradigm for Named Entity Recognition
- 引入显式推理链,替代隐式模式匹配
- 零样本下F1比GPT-4高12.3个百分点,达顶尖水平
- 适合需要可解释性与强泛化的信息抽取场景
生成式大模型通常通过指令微调提升命名实体识别(NER)性能,擅长基于语义模式匹配生成实体,但缺乏明确且可验证的推理机制。这种“认知捷径”导致表现不佳且泛化能力脆弱,尤其在零样本和低资源场景下,从有限上下文线索中推理至关重要。为此,提出一种面向NER的显式推理框架,将抽取范式从隐式匹配转向显式推理。该框架包含三个阶段:思维链(CoT)生成、CoT微调与推理增强。首先构建标注有面向NER的思维链数据集,包含任务相关的推理过程;随后用于微调模型,使其在得出最终答案前生成连贯的推理理由;最后通过综合奖励信号优化推理过程,确保提取结果具有显式可验证性。实验表明,ReasoningNER展现出出色的认知能力,在零样本设置下达到当前最优性能,其F1分数较GPT-4高出12.3个百分点。分析结果也证明其在面向推理的信息抽取研究中具有巨大潜力。代码已开源于https://github.com/HuiResearch/ReasoningIE。
原文摘要 · Abstract (English)
Generative LLMs typically improve Named Entity Recognition (NER) performance through instruction tuning. They excel at generating entities by semantic pattern matching but lack an explicit, verifiable reasoning mechanism. This "cognitive shortcutting" leads to suboptimal performance and brittle generalization, especially in zero-shot and lowresource scenarios where reasoning from limited contextual cues is crucial. To address this issue, a reasoning framework is proposed for NER, which shifts the extraction paradigm from implicit pattern matching to explicit reasoning. This framework consists of three stages: Chain of Thought (CoT) generation, CoT tuning, and reasoning enhancement. First, a dataset annotated with NER-oriented CoTs is generated, which contain task-relevant reasoning chains. Then, they are used to tune the NER model to generate coherent rationales before deriving the final answer. Finally, a reasoning enhancement stage is implemented to optimize the reasoning process using a comprehensive reward signal. This stage ensures explicit and verifiable extractions. Experiments show that ReasoningNER demonstrates impressive cognitive ability in the NER task, achieving competitive performance. In zero-shot settings, it achieves state-of-the-art (SOTA) performance, outperforming GPT-4 by 12.3 percentage points on the F1 score. Analytical results also demonstrate its great potential to advance research in reasoningoriented information extraction. Our codes are available at https://github.com/HuiResearch/ReasoningIE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。