Monroe分子基础模型提升小样本药物活性预测能力
Monroe: A Molecular Foundation Model for In-Context Probabilistic Inference

- 基于8100万分子预训练,改进立体化学图表示与训练损失
- 在活性悬崖任务中显著优于现有模型,跨任务泛化能力强
- 适配新推理框架后可提升其他模型性能,适合药物发现场景
药物活性预测常因实验成本高、数据稀缺而受限。本文提出Monroe,一种新型分子基础模型,通过在超过8100万分子的PM6量子化学数据集上预训练,提升模型对化学知识的通用表达能力。其创新包括:改进立体化学的图结构表示;引入构象去噪与嵌入解相关损失;优化多任务学习策略;并采用先验数据拟合的TabPFN模型进行下游上下文内概率推理。在标准Polaris基准测试中,Monroe表现持平或超越现有模型;在专为评估分子发现潜力设计的活性悬崖基准上,性能显著领先。消融实验和迁移实验表明,该下游推理策略可使MiniMol和CheMeleon模型性能大幅提升,产生新版本MiniMol_PFN与CheMeleon_PFN,证明方法具有广泛适用性。代码已开源。
原文摘要 · Abstract (English)
Bioassay activity prediction is often data-limited because drug-discovery datasets rely on time-consuming and expensive wet-lab experiments for data generation and evaluation. This challenge has inspired recent research into molecular foundation models (MFMs), which aim to encode general-purpose chemical knowledge into molecular representations that generalize well in data-constrained scenarios. This paper presents Monroe, a new MFM with several innovations over the existing state of the art: increased scale allowing pre-training on over 81 million molecules from the PM6 quantum chemistry dataset; improved graph representation of stereochemistry; improved training losses including conformer denoising and embedding decorrelation; improved multi-task learning; and the use of a prior-data-fitted model (TabPFN) for downstream in-context prediction. Our evaluations use a principled pairwise comparison framework that measures statistically significant performance differences. Across established Polaris benchmarks, Monroe matches or exceeds existing MFMs, while on activity cliff benchmarks, designed to assess utility for molecular discovery, it achieves significant improvements over prior methods. Finally, ablation and transfer experiments show that PFN-based downstream predictors also substantially improve two leading existing models, MiniMol and CheMeleon, yielding new state-of-the-art variants we call MiniMol_PFN and CheMeleon_PFN, suggesting that our downstream adaptation strategy generalizes beyond Monroe. Source code is at github.com/blazejba/monroe.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。