用AI自动从论文生成可复现的生物计算文档
Enhancing Scientific Reproducibility Through Automated BioCompute Object Creation Using Retrieval-Augmented Generation from Publications
- 用检索增强生成技术从论文和代码中提取信息
- 自动生成符合标准的生物计算对象,减少人工耗时
- 适合需要提升科研可复现性的生物信息学者
计算能力的指数增长改变了生物信息学研究的复杂性和规模,亟需标准化文档以保障透明性、可复现性和监管合规。IEEE生物计算对象(BCO)标准虽提供解决方案,但因创建文档成本高,尤其对旧研究难以推广。本文提出一种新方法,利用检索增强生成(RAG)与大语言模型(LLMs)自动化生成BCO。开发了BCO助手工具,通过RAG从论文及代码库中提取相关信息,缓解大模型幻觉与长上下文理解难题。实现采用双阶段检索与重排序优化,针对各BCO领域设计精准提示词。讨论了工具架构、可扩展性及评估方法,包括自动与人工评估。结果显示该工具能显著降低回溯性文档编制的时间与工作量,同时确保标准合规性。该方法为人工智能辅助科学文档与知识提取开辟新路径,有助于提升科研可复现性。工具与文档已公开:https://biocompute-objects.github.io/bco-rag/
原文摘要 · Abstract (English)
The exponential growth in computational power and accessibility has transformed the complexity and scale of bioinformatics research, necessitating standardized documentation for transparency, reproducibility, and regulatory compliance. The IEEE BioCompute Object (BCO) standard addresses this need but faces adoption challenges due to the overhead of creating compliant documentation, especially for legacy research. This paper presents a novel approach to automate the creation of BCOs from scientific papers using Retrieval-Augmented Generation (RAG) and Large Language Models (LLMs). We describe the development of the BCO assistant tool that leverages RAG to extract relevant information from source papers and associated code repositories, addressing key challenges such as LLM hallucination and long-context understanding. The implementation incorporates optimized retrieval processes, including a two-pass retrieval with re-ranking, and employs carefully engineered prompts for each BCO domain. We discuss the tool's architecture, extensibility, and evaluation methods, including automated and manual assessment approaches. The BCO assistant demonstrates the potential to significantly reduce the time and effort required for retroactive documentation of bioinformatics research while maintaining compliance with the standard. This approach opens avenues for AI-assisted scientific documentation and knowledge extraction from publications thereby enhancing scientific reproducibility. The BCO assistant tool and documentation is available at https://biocompute-objects.github.io/bco-rag/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。