arXiv:2509.12955cs.CLcs.DL2025-09

从论文全文自动提取科研流程,让研究可复现、可分析。

Automated Generation of Research Workflows from Academic Papers: A Full-text Mining Framework

  • 用科学文本模型识别流程段落,准确率达97.7%
  • 生成流程描述词并分类,分类精度达95.8%
  • 自动生成可视化流程图,揭示二十年方法演变

自动化生成科研流程对提升研究可复现性、推动「AI for Science」范式至关重要。现有方法多仅提取零散步骤,无法捕捉完整流程。为此,我们提出端到端框架,通过挖掘全文生成结构化科研流程。以自然语言处理(NLP)领域为例,采用段落为中心的方法,先用SciBERT结合正负样本学习识别流程描述段落,F1得分0.9772;再用Flan-T5配合提示学习生成流程短语,ROUGE-1、ROUGE-2、ROUGE-L分别为0.4543、0.2877、0.4427;最后利用少量示例的ChatGPT将短语分类至数据准备、处理、分析三阶段,分类精确率0.958。通过映射短语与原文位置,最终生成可读的可视化流程图。该方法用于分析一个NLP语料库,揭示了近二十年关键方法演进:数据分析受重视程度上升,特征工程逐步被消融实验取代。本工作提供可验证的技术框架,并引入过程导向视角,助力科学范式演化实证研究。代码与数据见:https://github.com/ZH-heng/research_workflow。

原文摘要 · Abstract (English)

The automated generation of research workflows is essential for improving the reproducibility of research and accelerating the paradigm of "AI for Science". However, existing methods typically extract merely fragmented procedural components and thus fail to capture complete research workflows. To address this gap, we propose an end-to-end framework that generates comprehensive, structured research workflows by mining full-text academic papers. As a case study in the Natural Language Processing (NLP) domain, our paragraph-centric approach first employs Positive-Unlabeled (PU) Learning with SciBERT to identify workflow-descriptive paragraphs, achieving an F1-score of 0.9772. Subsequently, we utilize Flan-T5 with prompt learning to generate workflow phrases from these paragraphs, yielding ROUGE-1, ROUGE-2, and ROUGE-L scores of 0.4543, 0.2877, and 0.4427, respectively. These phrases are then systematically categorized into data preparation, data processing, and data analysis stages using ChatGPT with few-shot learning, achieving a classification precision of 0.958. By mapping categorized phrases to their document locations in the documents, we finally generate readable visual flowcharts of the entire research workflows. This approach facilitates the analysis of workflows derived from an NLP corpus and reveals key methodological shifts over the past two decades, including the increasing emphasis on data analysis and the transition from feature engineering to ablation studies. Our work offers a validated technical framework for automated workflow generation, along with a novel, process-oriented perspective for the empirical investigation of evolving scientific paradigms. Source code and data are available at: https://github.com/ZH-heng/research_workflow.

科研自动化流程生成NLP可复现性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。