arXiv:2502.11001q-bio.BMcs.AI2025-02ICLR被引 4

用对比学习融合三类分子数据,提升抗生素候选分子预测效率。

CL-MFAP: A Contrastive Learning-Based Multimodal Foundation Model for Molecular Property Prediction and Antibiotic Screening

  • 基于对比学习,联合训练三种分子编码器处理SMILES、图结构和指纹数据。
  • 在160万化合物上预训练,抗生素属性预测性能超越基线模型。
  • 适合药物发现研究者,尤其关注抗菌药物筛选与多模态模型应用。

由于耐药性问题日益严重,发现具有抗生素潜力的新化合物对应对全球健康挑战至关重要。传统药物开发成本高且效率低。为此,研究人员转向机器学习以加速新型抗生素的预测与研发。尽管基础模型在抗生素发现中展现潜力,但现有方法尚未充分挖掘多模态分子数据的效能。近期研究表明,利用多模态数据的对比学习框架在表征学习中表现优异。基于此,我们提出CL-MFAP——一种基于对比学习的多模态基础模型,专门用于识别具有潜在抗生素性质的小分子。该模型使用来自ChEMBL数据集的160万具有类药物特性的生物活性分子,联合预训练三个编码器:(1)基于Transformer并采用旋转位置编码的SMILES序列编码器;(2)引入新型双层路由注意力机制的Transformer图结构编码器;(3)基于多层感知机的Morgan指纹编码器。通过对比学习实现跨模态对齐。CL-MFAP在抗生素属性预测任务中表现优于基线模型,并在微调后对特定抗生素相关任务展现出更优性能。

原文摘要 · Abstract (English)

Due to the rise in antimicrobial resistance, identifying novel compounds with antibiotic potential is crucial for combatting this global health issue. However, traditional drug development methods are costly and inefficient. Recognizing the pressing need for more effective solutions, researchers have turned to machine learning techniques to streamline the prediction and development of novel antibiotic compounds. While foundation models have shown promise in antibiotic discovery, current mainstream efforts still fall short of fully leveraging the potential of multimodal molecular data. Recent studies suggest that contrastive learning frameworks utilizing multimodal data exhibit excellent performance in representation learning across various domains. Building upon this, we introduce CL-MFAP, an unsupervised contrastive learning (CL)-based multimodal foundation (MF) model specifically tailored for discovering small molecules with potential antibiotic properties (AP) using three types of molecular data. This model employs 1.6 million bioactive molecules with drug-like properties from the ChEMBL dataset to jointly pretrain three encoders: (1) a transformer-based encoder with rotary position embedding for processing SMILES strings; (2) another transformer-based encoder, incorporating a novel bi-level routing attention mechanism to handle molecular graph representations; and (3) a Morgan fingerprint encoder using a multilayer perceptron, to achieve the contrastive learning purpose. The CL-MFAP outperforms baseline models in antibiotic property prediction by effectively utilizing different molecular modalities and demonstrates superior domain-specific performance when fine-tuned for antibiotic-related property prediction tasks.

分子预测对比学习抗生素筛选多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。