arXiv:2606.29859cs.CLcs.AI2026-06被引 4

分析NLP论文中算法被提及的动机,揭示研究者如何使用和演进算法。

Exploring Motivations for Algorithm Mention in the Domain of Natural Language Processing: A Deep Learning Approach

  • 基于深度学习构建句级动机识别框架,结合数据增强提升分类效果。
  • 超过一半的算法提及用于直接使用,改进动机最少,且动机类型随时间减少。
  • 发现机器学习算法更常被用于使用,语法类算法多用于描述,适合算法演化研究者。

随着数据密集型科学的发展,算法在科研中日益重要。学术论文中提及算法的目的各异,如描述、使用、比较或改进方法。识别这些目的有助于揭示算法间的关系并评估其作用。本文以自然语言处理(NLP)为例,提出一种句级框架,用于识别、分析和追踪算法提及动机的演变。通过人工标注与机器学习从全文中提取算法实体与相关句子,再利用预训练模型与数据增强进行动机分类,并分析其分布与时间变化。结果表明,经数据增强训练的深度学习模型在动机分类上优于传统机器学习模型。在NLP论文中,超过一半的算法相关句子表达直接使用,而改进是最少的动机;动机多样性随时间增加。具体而言,语法类算法更常被用于描述,机器学习算法更常被用于使用。随着时间推移,使用动机逐渐取代描述动机,且单个算法关联的动机类型显著下降。本研究揭示了作者在学术写作中提及算法的方式,为未来算法关系识别与影响评估研究提供基础。

原文摘要 · Abstract (English)

With the rise of data-intensive science, algorithms have become central to scientific research. In academic papers, algorithms are mentioned for different purposes, such as describing, using, comparing, or improving methods for specific research tasks. Identifying these purposes can reveal relationships among algorithms and help assess their roles and value. Taking natural language processing (NLP) as an example, this study proposes a sentence-level framework for identifying, analyzing, and tracing the evolution of motivations for mentioning algorithms. We first identify algorithm entities and algorithm-related sentences from full-text papers through manual annotation and machine learning. We then classify mention motivations using pretrained models and data augmentation, and analyze their distribution and temporal evolution. The results show that deep learning models trained with augmented data outperform traditional machine learning models in motivation classification. In NLP papers, more than half of algorithm-related sentences express direct use, whereas improvement is the least frequent motivation. The diversity of motivations has increased over time. For specific algorithm categories, grammar-based algorithms are more often mentioned for description, while machine learning algorithms are more often mentioned for use. Over time, use motivations have gradually replaced description motivations across different algorithms, and the number of motivation types associated with individual algorithms has declined significantly. This study reveals how authors mention algorithm entities in academic writing and provides a basis for future research on algorithm relationship identification and algorithm impact evaluation.

NLP算法动机深度学习文本分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。