通过结构感知机制提升分子多模态表示,增强药物发现中的模型泛化能力。
Multi-Modal Molecular Representation Learning via Structure Awareness
- 构建超图建模分子间高阶关联,融合多模态信息生成统一嵌入。
- 在MoleculeNet上平均提升ROC-AUC 1.8%~9.6%,超越现有基线方法。
- 适合分子表征学习、药物发现领域的研究人员参考使用。
准确提取分子表示是药物发现的关键步骤。近年来,基于图像及2D/3D拓扑的多模态分子表示学习方法逐渐成为主流。然而,现有方法常直接融合不同模态信息,忽视模态间交互,未能充分捕捉分子间的复杂高阶关系与不变特征。为此,我们提出一种基于结构感知的多模态自监督分子表示预训练框架(MMSA),旨在通过利用分子间的不变知识增强分子图表示。该框架包含两个核心模块:多模态分子表示学习模块和结构感知模块。前者协同处理同一分子的不同模态信息,克服模态差异,生成统一分子嵌入;后者通过构建超图结构建模分子间的高阶相关性,并引入记忆机制,将典型分子表示对齐内存库中的锚点,整合不变知识,从而提升模型泛化能力。大量实验表明,MMSA在MoleculeNet基准上达到当前最优性能,平均ROC-AUC相较基线方法提升1.8%至9.6%。
原文摘要 · Abstract (English)
Accurate extraction of molecular representations is a critical step in the drug discovery process. In recent years, significant progress has been made in molecular representation learning methods, among which multi-modal molecular representation methods based on images, and 2D/3D topologies have become increasingly mainstream. However, existing these multi-modal approaches often directly fuse information from different modalities, overlooking the potential of intermodal interactions and failing to adequately capture the complex higher-order relationships and invariant features between molecules. To overcome these challenges, we propose a structure-awareness-based multi-modal self-supervised molecular representation pre-training framework (MMSA) designed to enhance molecular graph representations by leveraging invariant knowledge between molecules. The framework consists of two main modules: the multi-modal molecular representation learning module and the structure-awareness module. The multi-modal molecular representation learning module collaboratively processes information from different modalities of the same molecule to overcome intermodal differences and generate a unified molecular embedding. Subsequently, the structure-awareness module enhances the molecular representation by constructing a hypergraph structure to model higher-order correlations between molecules. This module also introduces a memory mechanism for storing typical molecular representations, aligning them with memory anchors in the memory bank to integrate invariant knowledge, thereby improving the model generalization ability. Extensive experiments have demonstrated the effectiveness of MMSA, which achieves state-of-the-art performance on the MoleculeNet benchmark, with average ROC-AUC improvements ranging from 1.8% to 9.6% over baseline methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。