SNaRe生成高质量低资源事件检测数据,有效减少标签噪声与领域偏移。
SNaRe: Domain-aware Data Generation for Low-Resource Event Detection
- 分三步生成:先筛选领域触发词,再生成对齐语句,最后修正标注
- 零样本/少样本下平均提升3-7%的F1值,多语言生成最高提升20%
- 适合医学、法律等专业领域事件检测研究者使用
事件检测(ED)是从自然语言中识别事件提及的关键任务,对生物医学、法律、流行病学等专业领域的推理至关重要。数据生成已被证明能拓展其应用范围,无需昂贵的人工标注。然而,现有生成方法在专业领域面临标签噪声和领域漂移问题,即生成句子与目标领域分布不一致。为此,我们提出SNaRe,一个由三个组件构成的领域感知合成数据生成框架:Scout从无标注目标领域数据中提取触发词,利用语料级统计构建高质量领域特定触发词列表以缓解领域漂移;Narrator基于这些触发词生成与领域对齐的高质量句子;Refiner识别额外事件提及,确保标注质量。在三个不同领域的事件检测数据集上的实验表明,SNaRe优于最佳基线,在零样本/少样本设置下平均F1提升3-7%,多语言生成下提升4-20%。通过生成触发词命中率分析和人工评估,证实SNaRe具有更强的标注质量和更小的领域漂移。
原文摘要 · Abstract (English)
Event Detection (ED) -- the task of identifying event mentions from natural language text -- is critical for enabling reasoning in highly specialized domains such as biomedicine, law, and epidemiology. Data generation has proven to be effective in broadening its utility to wider applications without requiring expensive expert annotations. However, when existing generation approaches are applied to specialized domains, they struggle with label noise, where annotations are incorrect, and domain drift, characterized by a distributional mismatch between generated sentences and the target domain. To address these issues, we introduce SNaRe, a domain-aware synthetic data generation framework composed of three components: Scout, Narrator, and Refiner. Scout extracts triggers from unlabeled target domain data and curates a high-quality domain-specific trigger list using corpus-level statistics to mitigate domain drift. Narrator, conditioned on these triggers, generates high-quality domain-aligned sentences, and Refiner identifies additional event mentions, ensuring high annotation quality. Experimentation on three diverse domain ED datasets reveals how SNaRe outperforms the best baseline, achieving average F1 gains of 3-7% in the zero-shot/few-shot settings and 4-20% F1 improvement for multilingual generation. Analyzing the generated trigger hit rate and human evaluation substantiates SNaRe's stronger annotation quality and reduced domain drift.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。