arXiv:2509.22468cs.LGcs.AI2025-09中稿 · ICML

不依赖对比学习,用3D构象融合2D拓扑,提升分子表征效果

Learning the Neighborhood: Contrast-Free Multimodal Self-Supervised Molecular Graph Pretraining

  • 用固定半径的局部图(ego-net)建模分子多构象下的邻域关系
  • 在GEOM数据集预训练后,在MoleculeNet上超越现有自监督方法
  • 无需负样本或位置编码,适合跨化学领域迁移应用

高质量分子表征对性质预测和分子设计至关重要,但大规模标注数据仍稀缺。现有自监督预训练方法常依赖手工增强或复杂生成目标,且仅使用2D拓扑信息,忽视了宝贵的3D结构信息。为此,我们提出C-FREE(Contrast-Free Representation learning on Ego-nets),一种将2D图与多构象3D集合结合的简单框架。C-FREE通过在不同构象中预测子图嵌入与其互补邻域的关系来学习分子表示,采用固定半径的局部图作为建模单元,并在混合图神经网络-变压器骨干网络中整合几何与拓扑信息,无需负样本、位置编码或昂贵预处理。在包含丰富3D构象多样性的GEOM数据集上预训练后,C-FREE在MoleculeNet上取得当前最优性能,优于对比式、生成式及其他多模态自监督方法。在不同规模与分子类型的下游数据集上微调进一步验证了其良好的迁移能力,凸显3D信息对分子表示的重要性。

原文摘要 · Abstract (English)

High-quality molecular representations are essential for property prediction and molecular design, yet large labeled datasets remain scarce. While self-supervised pretraining on molecular graphs has shown promise, many existing approaches either depend on hand-crafted augmentations or complex generative objectives, and often rely solely on 2D topology, leaving valuable 3D structural information underutilized. To address this gap, we introduce C-FREE (Contrast-Free Representation learning on Ego-nets), a simple framework that integrates 2D graphs with ensembles of 3D conformers. C-FREE learns molecular representations by predicting subgraph embeddings from their complementary neighborhoods in the latent space, using fixed-radius ego-nets as modeling units across different conformers. This design allows us to integrate both geometric and topological information within a hybrid Graph Neural Network (GNN)-Transformer backbone, without negatives, positional encodings, or expensive pre-processing. Pretraining on the GEOM dataset, which provides rich 3D conformational diversity, C-FREE achieves state-of-the-art results on MoleculeNet, surpassing contrastive, generative, and other multimodal self-supervised methods. Fine-tuning across datasets with diverse sizes and molecule types further demonstrates that pretraining transfers effectively to new chemical domains, highlighting the importance of 3D-informed molecular representations.

分子表征自监督学习3D结构图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。