mCLM用功能模块化分子构建可合成的药物分子,提升功能与可制造性。
mCLM: A Modular Chemical Language Model that Generates Functional and Makeable Molecules
- 将分子按功能块而非原子分词,匹配自动化合成技术
- 30亿参数模型在药物属性与合成可达性上优于7个主流方法
- 能多目标推理并修复临床失败药物,适合药物研发团队使用
尽管大型语言模型(LLMs)具备化学知识理解能力,但其生成的分子往往功能不佳或难以合成,且不兼容自动化合成流程。为更好发现功能性小分子,需让模型学习一种更有效的分子语言,兼具性质预测能力与合成兼容性。现有分子LLM基于原子表示,限制了性能。本文提出mCLM,一种模块化化学语言模型,采用双语架构,同时理解自然语言的功能描述与分子功能块。该模型在生成阶段即考虑可合成性,系统性提升分子功能。在已批准药物数据集上,mCLM显著改善化学功能;仅30亿参数,合成可达性优于7个领先生成式AI方法。在122个分布外药物测试中,仅使用兼容自动化模块合成的构建块,mCLM在属性得分和合成可达性上均超越所有基线。模型还能多目标推理,并迭代自优化,用于挽救临床试验中失败的候选药物(“坠落天使”)。
原文摘要 · Abstract (English)
Despite their ability to understand chemical knowledge, large language models (LLMs) remain limited in their capacity to propose novel molecules with desired functions (e.g., drug-like properties). In addition, the molecules that LLMs propose can often be challenging to make, and are almost never compatible with automated synthesis approaches. To better enable the discovery of functional small molecules, LLMs need to learn a new molecular language that is more effective in predicting properties and inherently synced with automated synthesis technology. Current molecule LLMs are limited by representing molecules based on atoms. In this paper, we argue that just like tokenizing texts into meaning-bearing (sub-)word tokens instead of characters, molecules should be tokenized at the level of functional building blocks, i.e., parts of molecules that bring unique functions and serve as effective building blocks for real-world automated laboratory synthesis. This motivates us to propose mCLM, a modular Chemical-Language Model that comprises a bilingual language model that understands both natural language descriptions of functions and molecular blocks. mCLM front-loads synthesizability considerations while improving the predicted functions of molecules in a principled manner. Experiments on FDA-approved drugs showed that mCLM is capable of significantly improving chemical functions. mCLM, with only 3B parameters, also achieves improvements in synthetic accessibility relative to 7 other leading generative AI methods including GPT-5. When tested on 122 out-of-distribution medicines using only building blocks/tokens that are compatible with automated modular synthesis, mCLM outperforms all baselines in property scores and synthetic accessibility. mCLM can also reason on multiple functions and iteratively self-improve to rescue drug candidates that failed late in clinical trials ("fallen angels").
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。