arXiv:2503.02628cs.CLcs.AI2025-03EMNLP被引 12

用大模型协作标注和分块抽取,实现超大规模事件类型提取。

Towards Event Extraction with Massive Types: LLM-based Collaborative Annotation and Partitioning Extraction

  • 多大模型协作标注,先精炼触发词再补全角色,提升标注效率。
  • 构建含3465种事件类型、6297个角色的超大数据集,规模创纪录。
  • 分块抽取方法在零样本下性能超主流大模型12.9点,适合复杂场景。

构建能处理海量事件类型的通用抽取系统是事件抽取(EE)长期目标。挑战来自两方面:一是缺乏高效有效的标注方法;二是缺乏能应对海量类型的强大抽取方法。针对第一挑战,提出基于大语言模型(LLMs)的协作标注方法。通过多个LLM协同,先优化远程监督获取的触发词标注,再进行论元标注,最后通过投票整合各模型偏好。由此构建了迄今最大的EE数据集EEMT,包含超过20万样本、3,465种事件类型和6,297个角色类型。针对第二挑战,提出基于大模型的分块抽取方法LLM-PEE。为克服大模型上下文长度限制,该方法先召回候选事件类型,再将其拆分为多个子任务供模型分块处理。在有监督设置下,LLM-PEE在事件检测上比当前最优方法提升5.4,在论元抽取上提升6.1;在零样本设置下,相较主流大模型最高提升12.9,展现强大泛化能力。

原文摘要 · Abstract (English)

Developing a general-purpose extraction system that can extract events with massive types is a long-standing target in Event Extraction (EE). In doing so, the challenge comes from two aspects: 1) The absence of an efficient and effective annotation method. 2) The absence of a powerful extraction method can handle massive types. For the first challenge, we propose a collaborative annotation method based on Large Language Models (LLMs). Through collaboration among multiple LLMs, it first refines annotations of trigger words from distant supervision and then carries out argument annotation. Next, a voting phase consolidates the annotation preferences across different LLMs. Finally, we create the EEMT dataset, the largest EE dataset to date, featuring over 200,000 samples, 3,465 event types, and 6,297 role types. For the second challenge, we propose an LLM-based Partitioning EE method called LLM-PEE. To overcome the limited context length of LLMs, LLM-PEE first recalls candidate event types and then splits them into multiple partitions for LLMs to extract events. The results in the supervised setting show that LLM-PEE outperforms the state-of-the-art methods by 5.4 in event detection and 6.1 in argument extraction. In the zero-shot setting, LLM-PEE achieves up to 12.9 improvement compared to mainstream LLMs, demonstrating its strong generalization capabilities.

事件抽取大模型数据集零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。