arXiv:2509.24547cs.LGcs.CL2025-09

用专家路由机制解决小样本持续事件检测的遗忘问题

LEAF: A Robust Expert-Based Framework for Few-Shot Continual Event Detection

  • 采用低秩专家架构,按语义动态选择最适配的专家
  • 对比学习+知识蒸馏,在少样本下保持性能稳定
  • 适合需要长期学习新事件类型的实时系统

小样本持续事件检测面临数据稀缺与任务间灾难性遗忘的双重挑战。现有方法因全量微调共享主模型导致知识干扰严重,且依赖数据增强易引入语义扭曲。为此,我们提出LEAF框架,将低秩适配(LoRA)参数化的专家混合结构融入主模型,通过语义感知的专家选择机制,实现专家专业化与知识干扰最小化。为提升少样本下的泛化能力,引入基于标签描述的对比学习目标,捕捉事件类型的高层语义信息。同时,采用知识蒸馏策略防止记忆缓冲区过拟合,从历史模型迁移知识。在多个FCED基准上的实验表明,LEAF始终达到领先性能。

原文摘要 · Abstract (English)

Few-shot Continual Event Detection (FCED) poses the dual challenges of learning from limited data and mitigating catastrophic forgetting across sequential tasks. Existing approaches often suffer from severe forgetting due to the full fine-tuning of a shared base model, which leads to knowledge interference between tasks. Moreover, they frequently rely on data augmentation strategies that can introduce unnatural or semantically distorted inputs. To address these limitations, we propose LEAF, a novel and robust expert-based framework for FCED. LEAF integrates a specialized mixture of experts architecture into the base model, where each expert is parameterized with low-rank adaptation (LoRA) matrices. A semantic-aware expert selection mechanism dynamically routes instances to the most relevant experts, enabling expert specialization and reducing knowledge interference. To improve generalization in limited-data settings, LEAF incorporates a contrastive learning objective guided by label descriptions, which capture high-level semantic information about event types. Furthermore, to prevent overfitting on the memory buffer, our framework employs a knowledge distillation strategy that transfers knowledge from previous models to the current one. Extensive experiments on multiple FCED benchmarks demonstrate that LEAF consistently achieves state-of-the-art performance.

事件检测持续学习专家网络少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。