arXiv:2501.16255cs.CL2025-01被引 18

专为医学文献挖掘设计的AI模型,提升研究效率与准确性

A foundation model for human-AI collaboration in medical literature mining

  • 基于63万条指令数据训练,专注医学文献筛选与信息提取
  • 专家使用该模型时召回率提升至0.81,效率提高22.6%
  • 适合临床研究人员、系统综述团队快速处理海量文献

系统性文献回顾对循证医学至关重要,但当前AI在医学文献挖掘中的应用受限于训练和评估范围不足。本文提出LEADS,一个针对医学文献检索、筛选和数据提取的AI基础模型。该模型在633,759条指令数据上训练,数据来自21,335篇系统综述、453,625项临床试验文献及27,015个临床试验注册信息。实验显示,LEADS在六项任务中均优于四个顶尖通用大语言模型。16位来自14家机构的临床专家参与测试,使用LEADS后研究筛选召回率达0.81(独立工作为0.77),节省22.6%时间;数据提取准确率达0.85(无辅助为0.80),节省26.9%时间。结果表明,专用医学文献基础模型可显著提升专家工作质量与效率。

原文摘要 · Abstract (English)

Systematic literature review is essential for evidence-based medicine, requiring comprehensive analysis of clinical trial publications. However, the application of artificial intelligence (AI) models for medical literature mining has been limited by insufficient training and evaluation across broad therapeutic areas and diverse tasks. Here, we present LEADS, an AI foundation model for study search, screening, and data extraction from medical literature. The model is trained on 633,759 instruction data points in LEADSInstruct, curated from 21,335 systematic reviews, 453,625 clinical trial publications, and 27,015 clinical trial registries. We showed that LEADS demonstrates consistent improvements over four cutting-edge generic large language models (LLMs) on six tasks. Furthermore, LEADS enhances expert workflows by providing supportive references following expert requests, streamlining processes while maintaining high-quality results. A study with 16 clinicians and medical researchers from 14 different institutions revealed that experts collaborating with LEADS achieved a recall of 0.81 compared to 0.77 experts working alone in study selection, with a time savings of 22.6%. In data extraction tasks, experts using LEADS achieved an accuracy of 0.85 versus 0.80 without using LEADS, alongside a 26.9% time savings. These findings highlight the potential of specialized medical literature foundation models to outperform generic models, delivering significant quality and efficiency benefits when integrated into expert workflows for medical literature mining.

医学AI文献挖掘大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。