通过融合时间信息提升历史文本命名实体识别效果
A Study of Temporal Fusion Strategies for Named Entity Recognition in Historical Texts

- 采用早/晚融合策略将时间信息注入Transformer模型
- 晚融合在早期和噪声较多时期表现更稳定,提升识别鲁棒性
- 适用于需要处理历史文本时序变化的研究者或NLP工程师
时间演变给历史文本中的命名实体识别(NER)带来独特挑战,因实体的表面形式和显著性随时间变化。尽管语言模型在多项NLP任务中取得进展,其在历时语境下推理时间性的能力仍有限。本文系统研究了如何通过轻量级融合策略将时间元数据结构化嵌入NER模型。实验对比了绝对与相对时间表示,采用交叉注意力、适配器、拼接等早/晚融合机制,注入基于Transformer的架构。在法语和德语历史数据集上的评估表明,晚融合策略在早期及噪声较大的时期展现出更强的鲁棒性和时序泛化能力。
原文摘要 · Abstract (English)
Temporal variation poses a unique challenge for named entity recognition (NER) in historical texts, where entities drift in surface form and salience across time. While language models (LMs) have made progress in various NLP tasks, their ability to reason about temporality, especially in diachronic contexts, remains limited or at least, questionable. In this paper, we systematically study how temporal metadata can be structurally embedded into NER models using a range of lightweight fusion strategies. We experiment with both absolute and relative temporal representations, injected into Transformer-based architectures via early or late fusion mechanisms such as cross-attention, adapters, and concatenation. Our evaluations on French and German historical datasets reveal that late fusion strategies yield more robust and temporally generalisable performance, particularly in early and noisy periods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。