从实体视角剖析NLP技术发展,揭示模型与数据的演进规律。
Revealing the Technology Development of Natural Language Processing: A Scientific Entity-Centric Perspective
- 以方法、数据集等实体为核心,构建NLP技术演化分析框架。
- 预训练模型如BERT、Transformer成主流,维基百科和BLEU指标持续影响力上升。
- 新技术涌现速度前所未有,研究者采纳速度显著加快,适合领域追踪者参考。
现有技术发展研究多基于主题视角,但主题粒度粗,难以精准表征技术。随着自动实体识别技术的发展,可大规模提取自然语言处理(NLP)论文中的技术相关实体。本文采用半自动方法提取并归一化方法、数据集、指标、工具等实体,基于共现网络计算实体的z-score以衡量其影响力,并分析21世纪初以来NLP技术的发展趋势。结果表明:第一,每篇论文平均实体数量持续增长,研究者知识负担加重,但预训练语言模型为技术创新注入新活力;第二,在179个高影响力实体中,方法类占主导,其中BERT与Transformer等模型近年成为主流,而维基百科数据集与BLEU指标长期影响力持续上升;第三,近年来新兴高影响力技术的出现频率和研究者接受速度均达到前所未有的水平。本研究为特定领域技术发展分析提供了新视角。
原文摘要 · Abstract (English)
Most studies on technology development have been conducted from a thematic perspective, but the topics are coarse-grained and insufficient to accurately represent technology. The development of automatic entity recognition techniques makes it possible to extract technology-related entities on a large scale. Thus, we perform a more accurate analysis of technology development from an entity-centric perspective. To begin with, we extract technology-related entities such as methods, datasets, metrics, and tools in articles on Natural Language Processing (NLP), and we apply a semi-automatic approach to normalize the entities. Subsequently, we calculate the z-scores of entities based on their co-occurrence networks to measure their impact. We then analyze the development trends of new technologies in the NLP domain since the beginning of the 21st century. The findings of this paper include three aspects: Firstly, the continued increase in the average number of entities per paper implies a growing burden on researchers to acquire relevant technical background knowledge. However, the emergence of pre-trained language models has injected new vitality into the technological innovation of the NLP domain. Secondly, Methods dominate among the 179 high-impact entities. An analysis of the z-score trend about the top 10 entities reveals that pre-trained language models, exemplified by BERT and Transformer, have become mainstream in recent years. Unlike the trend of the other eight method entities, the impact of Wikipedia dataset and BLEU metric has continued to rise in the long term. Thirdly, in recent years, there has been a remarkable surge in popularity for new high-impact technologies than ever before, and their acceptance by researchers has accelerated at an unprecedented speed. Our study provides a new perspective on analyzing technology development in a specific domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。