用大模型分析药物相互作用,准确率超传统方法。
LLMs for Drug-Drug Interaction Prediction: A Comprehensive Comparison
- 将分子结构等信息转为文本输入大模型进行预测
- 微调后模型敏感度达0.978,准确率0.919
- 适合药企和临床研究者用于新药组合风险评估
现代治疗方案中药物组合数量激增,亟需可靠的药物相互作用(DDI)预测方法。尽管大语言模型(LLMs)已在多个领域取得突破,其在制药研究中的潜力仍待挖掘。本研究首次将最新DrugBank数据中的分子结构(SMILES)、靶向生物体及基因互作数据作为原始文本输入,全面评估18种不同规模的LLMs(参数量从1.5B到72B),包括GPT-4、Claude、Gemini等专有模型与Phi-3.5、Qwen、Gemma、Deepseek等开源模型。先评估其零样本预测能力,再对选定模型(GPT-4、Phi-3.5 2.7B、Qwen-2.5 3B、Gemma-2 9B、Deepseek R1 distilled Qwen 1.5B)进行微调。在13个外部DDI数据集上验证,性能优于传统方法如l2正则化逻辑回归。微调后模型表现优异,其中Phi-3.5 2.7B在平衡数据集(50%正例,50%负例)上达到敏感度0.978、准确率0.919,显著优于零样本预测与现有先进机器学习方法。分析表明,LLMs能有效捕捉复杂分子互作模式,尤其擅长识别共靶基因的药物对,具备实际应用价值。
原文摘要 · Abstract (English)
The increasing volume of drug combinations in modern therapeutic regimens needs reliable methods for predicting drug-drug interactions (DDIs). While Large Language Models (LLMs) have revolutionized various domains, their potential in pharmaceutical research, particularly in DDI prediction, remains largely unexplored. This study thoroughly investigates LLMs' capabilities in predicting DDIs by uniquely processing molecular structures (SMILES), target organisms, and gene interaction data as raw text input from the latest DrugBank dataset. We evaluated 18 different LLMs, including proprietary models (GPT-4, Claude, Gemini) and open-source variants (from 1.5B to 72B parameters), first assessing their zero-shot capabilities in DDI prediction. We then fine-tuned selected models (GPT-4, Phi-3.5 2.7B, Qwen-2.5 3B, Gemma-2 9B, and Deepseek R1 distilled Qwen 1.5B) to optimize their performance. Our comprehensive evaluation framework included validation across 13 external DDI datasets, comparing against traditional approaches such as l2-regularized logistic regression. Fine-tuned LLMs demonstrated superior performance, with Phi-3.5 2.7B achieving a sensitivity of 0.978 in DDI prediction, with an accuracy of 0.919 on balanced datasets (50% positive, 50% negative cases). This result represents an improvement over both zero-shot predictions and state-of-the-art machine-learning methods used for DDI prediction. Our analysis reveals that LLMs can effectively capture complex molecular interaction patterns and cases where drug pairs target common genes, making them valuable tools for practical applications in pharmaceutical research and clinical settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。