arXiv:2601.11932cs.CL2026-01Conference of the …被引 1

用上下文感知编码器和LoRA提升长尾事件检测效果

Event Detection with a Context-Aware Encoder and LoRA for Improved Performance on Long-Tailed Classes

  • 引入双向上下文编码增强模型理解能力
  • LoRA微调使长尾类别宏平均F1显著提升
  • 强调宏观指标,更公平评估长尾事件性能

当前事件检测研究存在两个反复出现的局限:一是仅解码器架构的单向性限制了对丰富双向上下文的理解;二是文献普遍依赖微观F1,其偏向多数类而高估性能。本文转而关注宏观F1,更真实反映模型在长尾事件类型上的表现。实验表明,加入句子上下文的信息可显著优于标准解码器基线。使用低秩适应(LoRA)进行微调进一步大幅提升了宏观F1,尤其在解码器模型中效果显著,证明LoRA是提升大模型在长尾事件类别上表现的有效工具。

原文摘要 · Abstract (English)

The current state of event detection research has two notable re-occurring limitations that we investigate in this study. First, the unidirectional nature of decoder-only LLMs presents a fundamental architectural bottleneck for natural language understanding tasks that depend on rich, bidirectional context. Second, we confront the conventional reliance on Micro-F1 scores in event detection literature, which systematically inflates performance by favoring majority classes. Instead, we focus on Macro-F1 as a more representative measure of a model's ability across the long-tail of event types. Our experiments demonstrate that models enhanced with sentence context achieve superior performance over canonical decoder-only baselines. Using Low-Rank Adaptation (LoRA) during finetuning provides a substantial boost in Macro-F1 scores in particular, especially for the decoder-only models, showing that LoRA can be an effective tool to enhance LLMs' performance on long-tailed event classes.

事件检测LoRA长尾学习大模型微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。