用多视角图融合提升蛋白质表示学习效果
MMPG: MoE-based Adaptive Multi-Perspective Graph Fusion for Protein Representation Learning
- 从物理、化学、几何三方面构建蛋白图,捕捉不同交互特性
- 通过专家混合机制动态融合各视角信息,实现多层次特征整合
- 在四个下游任务中表现领先,适合蛋白质结构功能研究者
图神经网络(GNN)已被广泛用于蛋白质表示学习(PRL),因为残基相互作用网络可自然建模为图。现有基于GNN的PRL方法通常依赖单一视角的图构建策略,仅捕捉残基相互作用的部分属性,导致蛋白质表示不完整。为此,我们提出MMPG框架,从物理、化学和几何三个视角构建蛋白图,并通过混合专家(MoE)自适应融合,以实现蛋白质表示学习。MMPG构建了三种不同视角的图来表征残基相互作用的不同属性。为捕获视角特异性特征及其协同效应,我们设计了一个MoE模块,该模块动态将不同视角路由至专用专家,其中专家学习内在特征及跨视角交互。我们定量验证了MoE能自动使专家专注于建模从单个表示到成对跨视角协同,再到所有视角全局共识的多层次交互。通过整合这些多层级信息,MMPG生成更优的蛋白质表示,在四个不同的下游蛋白任务上取得先进性能。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) have been widely adopted for Protein Representation Learning (PRL), as residue interaction networks can be naturally represented as graphs. Current GNN-based PRL methods typically rely on single-perspective graph construction strategies, which capture partial properties of residue interactions, resulting in incomplete protein representations. To address this limitation, we propose MMPG, a framework that constructs protein graphs from multiple perspectives and adaptively fuses them via Mixture of Experts (MoE) for PRL. MMPG constructs graphs from physical, chemical, and geometric perspectives to characterize different properties of residue interactions. To capture both perspective-specific features and their synergies, we develop an MoE module, which dynamically routes perspectives to specialized experts, where experts learn intrinsic features and cross-perspective interactions. We quantitatively verify that MoE automatically specializes experts in modeling distinct levels of interaction from individual representations, to pairwise inter-perspective synergies, and ultimately to a global consensus across all perspectives. Through integrating this multi-level information, MMPG produces superior protein representations and achieves advanced performance on four different downstream protein tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。