多模态模型预测小分子热物理性质,保证物理一致性且数据需求少。
MultiPUFFIN: A Multimodal Domain-Constrained Foundation Model for Molecular Property Prediction of Small Molecules
- 融合SMILES、2D图、3D构象与实验条件,用跨模态注意力建模
- 在50万未标注分子上预训练,仅用2000倍少标签数据超越ChemBERTa-2
- 支持9种性质预测,输出符合热力学规律,适合化工与药物研发
MultiPUFFIN 是一个面向小分子热物理性质预测的领域约束型多模态基础模型,填补了化学工程、药物发现和材料科学中的关键空白。现有分子基础模型虽在百万级分子上预训练以学习通用表征,但其标准MLP输出层缺乏物理约束,导致蒸气压预测违背温度单调性,黏度曲线不满足过程模拟器所需的函数形式。已有领域约束方法仅限单一性质与小数据集,而多模态基础模型多聚焦生物活性而非热物理性质。MultiPUFFIN 通过双向跨模态注意力与门控融合,整合SMILES序列、2D分子图、3D构象几何,并辅以实验条件与分子描述符的辅助编码器。其主干在50万个未标注的PubChem分子上,采用三种互补的自监督目标进行预训练。一个含五个条件调节器(温度、pH、压力、多晶型、测量方法)的条件感知精炼堆栈,将每项性质路由至四头竞赛机制,选出最优的热力学一致头。该模型在九项性质上的平均测试R²达0.784,尽管仅使用约2000倍少的标注分子,仍优于微调后的ChemBERTa-2。
原文摘要 · Abstract (English)
MultiPUFFIN is a domain-informed multimodal foundation model for predicting thermophysical properties of small molecules, addressing a critical gap in chemical engineering, drug discovery, and materials science. Existing molecular foundation models pretrain on millions of molecules to learn general-purpose representations, but their standard MLP output layers impose no physical constraints, vapor pressure predictions may violate monotonic temperature dependence, and viscosity curves may lack the functional form required by process simulators. Domain-informed approaches that guarantee thermodynamic consistency have remained limited to single properties and small datasets, whereas multimodal foundation models have focused on biological activity rather than thermophysical properties. MultiPUFFIN fills this gap by fusing SMILES sequences, 2D molecular graphs, and 3D conformer geometries through bidirectional cross-modal attention and gated fusion, supplemented by auxiliary encoders for experimental conditions and molecular descriptors. The backbone is pretrained on 500,000 unlabelled PubChem molecules using three complementary self-supervised objectives. A condition-aware refinement stack of five conditioners (temperature, pH, pressure, polymorph, and measurement method) routes each property to a four-head tournament that selects the best-performing thermodynamically informed head for that property. MultiPUFFIN achieves a mean test R2 of 0.784 and outperforms fine-tuned ChemBERTa-2 on all nine properties despite training on roughly 2,000x fewer labeled molecules.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。