发现用户生成内容实体识别失效主因是信息密度低,提出增强语义密度的优化模块。
A Mechanism and Optimization Study on the Impact of Information Density on User-Generated Content Named Entity Recognition

- 揭示信息密度低是导致社交媒体实体识别失效的根本原因
- 提出WOM模块,在不改架构下提升信息密度,最高增益4.5% F1
- 适合关注社交文本、低资源场景下命名实体识别的研究者
在干净高资源语料上训练的命名实体识别(NER)模型,部署到噪声大、稀疏的用户生成内容(UGC)时性能急剧下降。以往研究多针对具体问题如新词、别名漂移、非标准拼写等进行定制微调,但难以泛化,因忽略了UGC固有的结构稀疏性。本研究通过分层控制混杂因素的重采样实验(控制实体罕见度与标注一致性),发现表面噪声症状的根源是信息密度(ID)低。提出注意力谱分析(ASA)量化信息密度降低导致“注意力钝化”,进而损害识别性能。基于此机制,设计窗口感知优化模块(WOM),利用大模型实现选择性回译,定向提升语义密度,无需修改模型结构。在标准UGC数据集WNUT2017、Twitter-NER、WNUT2016上测试,最多提升4.5%绝对F1,展现强鲁棒性,并在WNUT2017上达到新SOTA。
原文摘要 · Abstract (English)
Named Entity Recognition (NER) models trained on clean, high-resource corpora exhibit catastrophic performance collapse when deployed on noisy, sparse User-Generated Content (UGC), such as social media. Prior research has predominantly focused on point-wise symptom remediation -- employing customized fine-tuning to address issues like neologisms, alias drift, non-standard orthography, long-tail entities, and class imbalance. However, these improvements often fail to generalize because they overlook the structural sparsity inherent in UGC. This study reveals that surface-level noise symptoms share a unified root cause: low Information Density (ID). Through hierarchical confounding-controlled resampling experiments (specifically controlling for entity rarity and annotation consistency), this paper identifies ID as an independent key factor. We introduce Attention Spectrum Analysis (ASA) to quantify how reduced ID causally leads to ``attention blunting,'' ultimately degrading NER performance. Informed by these mechanistic insights, we propose the Window-Aware Optimization Module (WOM), an LLM-empowered, model-agnostic framework. WOM identifies information-sparse regions and utilizes selective back-translation to directionally enhance semantic density without altering model architecture. Deployed atop mainstream architectures on standard UGC datasets (WNUT2017, Twitter-NER, WNUT2016), WOM yields up to 4.5\% absolute F1 improvement, demonstrating robustness and achieving new state-of-the-art (SOTA) results on WNUT2017.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。