用图神经网络和大模型结合提升药物筛选精度
Combining GCN Structural Learning with LLM Chemical Knowledge for Enhanced Virtual Screening
- 将图卷积与大模型化学知识嵌入融合,分层拼接提升性能
- 在标准数据集上达88.8%的F1分数,优于现有方法
- 适合需要高精度分子筛选的研究者使用
虚拟筛选在现代药物发现中至关重要,用于识别有潜力的候选分子。传统机器学习方法如支持向量机(SVM)和XGBoost依赖预定义分子表示,常导致信息丢失和偏差。深度学习方法,尤其是图卷积网络(GCN),通过直接作用于分子图提供更丰富且无偏的表示。同时,大语言模型(LLM)凭借注意力机制从大规模数据中捕捉复杂化学模式,展现出卓越性能。本文提出一种混合架构,将GCN与LLM生成的嵌入结合,融合局部结构学习与全局化学知识。LLM嵌入可预先计算并存储于分子特征库中,避免训练和推理时重复运行LLM,保持计算效率。实验表明,在每个GCN层后拼接LLM嵌入(而非仅在最后一层)显著提升性能,实现更深的上下文整合。该模型在测试中达到88.8%的F1分数,优于独立的GCN(87.9%)、XGBoost(85.5%)和SVM(85.4%)基线。
原文摘要 · Abstract (English)
Virtual screening plays a critical role in modern drug discovery by enabling the identification of promising candidate molecules for experimental validation. Traditional machine learning methods such, as Support Vector Machines (SVM) and XGBoost, rely on predefined molecular representations, often leading to information loss and potential bias. In contrast, deep learning approaches-particularly Graph Convolutional Networks (GCNs)-offer a more expressive and unbiased alternative by operating directly on molecular graphs. Meanwhile, Large Language Models (LLMs) have recently demonstrated state-of-the-art performance in drug design, thanks to their capacity to capture complex chemical patterns from large-scale data via attention mechanisms. In this paper, we propose a hybrid architecture that integrates GCNs with LLM-derived embeddings to combine localized structural learning with global chemical knowledge. The LLM embeddings can be precomputed and stored in a molecular feature library, removing the need to rerun the LLM during training or inference and thus maintaining computational efficiency. We found that concatenating the LLM embeddings after each GCN layer-rather than only at the final layer-significantly improves performance, enabling deeper integration of global context throughout the network. The resulting model achieves superior results, with an F1-score of (88.8\%), outperforming standalone GCN (87.9%), XGBoost (85.5%), and SVM (85.4%) baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。