跨语言少样本实体识别新框架,融合主题上下文提升准确性
FewTopNER: Integrating Few-Shot Learning with Topic Modeling and Named Entity Recognition in a Multilingual Framework
- 用多语言编码器+主题建模,动态融合全局语义与实体信息
- 在5种语言上提升2.5-4.0个百分点的F1值,主题一致性也更强
- 适合低资源语言场景下的实体识别任务,尤其关注跨语言应用
我们提出FewTopNER,一个将少样本命名实体识别(NER)与主题感知上下文建模结合的新框架,以应对跨语言和低资源场景的挑战。该框架基于XLM-RoBERTa构建共享多语言编码器,并引入语言特异性校准机制,生成鲁棒的上下文嵌入。架构包含基于BiLSTM与条件随机场的原型式实体识别分支,以及通过混合概率与神经方法提取文档级语义特征的主题建模分支。跨任务桥接模块实现实体与主题表示间的双向注意力与特征融合,显著提升实体消歧能力。在英语、法语、西班牙语、德语和意大利语多语言基准上的实证评估显示,FewTopNER显著优于现有先进少样本NER模型:F1分数提升2.5-4.0个百分点,主题一致性(以归一化点互信息衡量)亦有提升。消融实验进一步验证了共享编码器与跨任务融合机制的关键作用。结果表明,融入主题感知上下文对少样本NER有效,FewTopNER在低资源跨语言应用中具有显著潜力。
原文摘要 · Abstract (English)
We introduce FewTopNER, a novel framework that integrates few-shot named entity recognition (NER) with topic-aware contextual modeling to address the challenges of cross-lingual and low-resource scenarios. FewTopNER leverages a shared multilingual encoder based on XLM-RoBERTa, augmented with language-specific calibration mechanisms, to generate robust contextual embeddings. The architecture comprises a prototype-based entity recognition branch, employing BiLSTM and Conditional Random Fields for sequence labeling, and a topic modeling branch that extracts document-level semantic features through hybrid probabilistic and neural methods. A cross-task bridge facilitates dynamic bidirectional attention and feature fusion between entity and topic representations, thereby enhancing entity disambiguation by incorporating global semantic context. Empirical evaluations on multilingual benchmarks across English, French, Spanish, German, and Italian demonstrate that FewTopNER significantly outperforms existing state-of-the-art few-shot NER models. In particular, the framework achieves improvements of 2.5-4.0 percentage points in F1 score and exhibits enhanced topic coherence, as measured by normalized pointwise mutual information. Ablation studies further confirm the critical contributions of the shared encoder and cross-task integration mechanisms to the overall performance. These results underscore the efficacy of incorporating topic-aware context into few-shot NER and highlight the potential of FewTopNER for robust cross-lingual applications in low-resource settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。