自动链接论文与代码中的生信工具,提升科研流程可复现性
Supporting Workflow Reproducibility by Linking Bioinformatics Tools across Papers and Executable Code
- 通过命名实体识别和词嵌入相似度匹配,连接论文描述与代码中的工具
- 在Nextflow工作流上实现66%的联合准确率,单个步骤F1达77-90
- 适用于需要复现或重用生信分析流程的研究者,尤其关注透明性
生物数据的快速增长加剧了对透明、可复现且记录完善的计算流程的需求。将代码中的流程步骤与其在论文中的描述清晰关联,有助于理解流程、支持复现并促进再利用。这需要将工作流代码中的生信工具与论文中提及的工具进行匹配。我们提出CoPaLink,一种集成三部分的自动化方法:科学文本中的工具命名实体识别、代码中的工具命名实体识别,以及基于词嵌入相似度的实体消歧。我们在使用Sentence-BERT的Nextflow工作流上评估,各项任务的F1值为77-90,联合准确率为66。CoPaLink利用经标注的科学论文和可执行代码语料库,弥合叙述描述与实现之间的差距。代码与数据集(CPL-Article、CPL-Code、CPL-Gold-Entity-Resolution)均已公开。
原文摘要 · Abstract (English)
Motivation: The rapid growth of biological data has intensified the need for transparent, reproducible, and well-documented computational workflows. The ability to clearly connect the steps of a workflow in the code with their description in a paper would improve workflow comprehension, support reproducibility, and facilitate reuse. This task requires the linking of bioinformatics tools in workflow code with their mentions in a published workflow description. Results: We present CoPaLink, an automated approach that integrates three components: named entity recognition (NER) for identifying tool mentions in scientific text, NER for tool mentions in workflow code, and entity resolution based on word embedding similarity. We propose approaches for all three steps, achieving a high individual F1-measure (77 - 90) and a joint accuracy of 66 when evaluated on Nextflow workflows using Sentence-BERT. CoPaLink leverages corpora of scientific articles and workflow executable code with curated tool annotations to bridge the gap between narrative descriptions and workflow implementations. Availability: The code is available at https://gitlab.liris.cnrs.fr/sharefair/copalink-experiments and https://gitlab.liris.cnrs.fr/sharefair/copalink. The corpora are also available: CPL-Article (https://doi.org/10.5281/zenodo.20746904), CPL-Code (https://doi.org/10.5281/zenodo.20746970) and CPL-Gold-Entity-Resolution (https://doi.org/10.5281/zenodo.20746994).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。