arXiv:2606.11508cs.LGq-bio.QM2026-06

用概率对比预训练提升多任务药物代谢属性预测精度

Probabilistic Contrastive Pretraining for Multi-task ADME Property Prediction

论文配图:Probabilistic Contrastive Pretraining for Multi-task ADME Property Prediction
图 1 · 摘自论文原文
  • 将分子图与化学自监督任务融合到统一概率框架中
  • 在三个数据集上平均提升9.0%预测性能,最高达9.9%
  • 适合需要跨任务建模的药物研发人员使用

准确预测吸收、分布、代谢和排泄(ADME)属性对药物发现至关重要,但因终点数据噪声大、相互依赖且样本有限而具挑战性。我们提出一种结合化学特异性自监督与对比互信息学习(cMIM)的分子图-变压器预训练框架。该方法将分子图编码为潜在变量,从图生成的潜在代码重建SMILES字符串,并以领域特定的自监督化学任务增强对比目标。不同于传统辅助任务独立加权的方式,我们将重构、对比判别与化学任务监督统一为单个概率潜变量目标中的等权重对数似然因子。微调时采用多任务GNN读出架构,每个任务配备专用MLP头,在保留共享表征的同时缓解负迁移,改善异质非线性任务关系建模。在Biogen、ExpansionRX和ChEMBL-MT数据集上,所提出的Contrastive KERMT预训练相比KERMT基线分别提升7.6%、9.9%和9.5%(显著改进端点的平均值)。将相邻的ADME分子加入预训练语料库进一步提升迁移效果,对比组件也增强了化学上合理的潜在邻域结构。

原文摘要 · Abstract (English)

Accurate prediction of absorption, distribution, metabolism, and excretion (ADME) properties is critical to drug discovery, but remains challenging because ADME endpoints are noisy, interdependent, and often data-limited. We propose a molecular graph-transformer pretraining framework that combines chemistry-specific self-supervision with contrastive mutual information machine learning (cMIM). Our method encodes molecular graphs into latent variables, reconstructs SMILES strings from the graph-derived latent codes, and augments the contrastive objective with domain-specific self-supervised chemistry tasks. Rather than treating these tasks as auxiliary regularizers with separately tuned loss weights, we formulate reconstruction, contrastive discrimination, and chemistry-specific supervision as unit-weighted log-probability factors in a single probabilistic latent-variable objective. For fine-tuning, we propose a multi-task GNN readout architecture with task-specific multilayer perceptron heads, preserving shared representation learning while mitigating negative transfer and improving the modeling of heterogeneous, nonlinear task relationships. Across Biogen, ExpansionRX, and ChEMBL-MT, the resulting Contrastive KERMT pretraining improves over the KERMT baseline by 7.6%, 9.9%, and 9.5% respectively (averaged over significantly-improved endpoints). Adding ADME-adjacent molecules to the pretraining corpus further improves transfer, and the contrastive component sharpens chemically meaningful latent neighborhoods.

ADME预测图神经网络对比学习多任务学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。