用协作式智能体框架提升零样本文档事件参数提取效果
Learning to Generate and Extract: A Multi-Agent Collaboration Framework For Zero-shot Document-level Event Arguments Extraction
- 设计生成与评估双智能体,模拟人类“提出-评估-修正”流程
- 在RAMS和WikiEvents上实现更高质量合成数据与更高准确率
- 适合研究零样本事件抽取、多智能体协同的学者参考
文档级事件参数抽取(DEAE)对知识获取至关重要,旨在从文档中提取事件参与者。在零样本设置下,现有方法依赖大模型生成合成数据以应对标注数据稀缺问题。然而,仅使用事件类型提示难以准确捕捉未见事件的上下文与结构关系,且缺乏质量评估机制导致合成数据可靠性不足。为此,本文提出一种多智能体协作框架(ZS-DEAE),模拟人类“提出-评估-修正”的认知过程。框架包含生成智能体与评估智能体:前者利用已见事件知识为未见事件生成数据,后者从合成数据中提取参数并评估其与上下文语义一致性。评估结果转化为奖励信号,并引入事件结构约束优化奖励设计,通过强化学习迭代优化双智能体。在基于RAMS和WikiEvents构建的三个零样本场景中,该方法在合成数据质量与参数抽取性能上均取得提升,且生成数据可有效增强其他DEAE模型的零样本表现。
原文摘要 · Abstract (English)
Document-level event argument extraction (DEAE) is essential for knowledge acquisition, aiming to extract participants of events from documents . In the zero-shot setting, existing methods employ LLMs to generate synthetic data to address the challenge posed by the scarcity of annotated data. However, relying solely on Event-type-only prompts makes it difficult for the generated content to accurately capture the contextual and structural relationships of unseen events. Moreover, ensuring the reliability and usability of synthetic data remains a significant challenge due to the absence of quality evaluation mechanisms. To this end, we introduce a multi-agent collaboration framework for zero-shot document-level event argument extraction (ZS-DEAE), which simulates the human collaborative cognitive process of "Propose-Evaluate-Revise." Specifically, the framework comprises a generation agent and an evaluation agent. The generation agent synthesizes data for unseen events by leveraging knowledge from seen events, while the evaluation agent extracts arguments from the synthetic data and assesses their semantic consistency with the context. The evaluation results are subsequently converted into reward signals, with event structure constraints incorporated into the reward design to enable iterative optimization of both agents via reinforcement learning.In three zero-shot scenarios constructed from the RAMS and WikiEvents datasets, our method achieves improvements both in data generation quality and argument extraction performance, while the generated data also effectively enhances the zero-shot performance of other DEAE models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。