用图注意力网络生成分子,既保证化学合理性又支持结构约束设计。
GraphXForm: Graph transformer for computer-aided molecular design
- 以图结构表示分子,通过Transformer逐步添加原子键来生成新分子。
- 在药物与溶剂设计任务中,生成分子的性能优于现有方法。
- 可灵活加入特定结构限制或基于已有分子起始优化,适合精准分子设计。
生成式深度学习在药物发现、材料科学和化学工程中的分子设计中日益重要。当前主流方法通常在分子字符串表示上预训练神经网络,并通过强化学习微调以实现特定目标。然而,基于字符串的模型难以保证化学有效性,也难以强制包含特定子结构等结构约束。本文提出将图结构分子表示与Transformer架构结合,利用图结构天然确保化学合理性,并借助Transformer建模原子间的长程依赖关系。我们的方法通过迭代添加原子与键的方式修改分子图,既保障化学有效性,又便于引入结构约束。我们提出了GraphXForm——一种仅使用解码器的图变压器架构,在已有化合物上进行预训练,随后采用融合深度交叉熵方法与自改进学习的新训练算法进行微调。我们在多个药物设计任务中评估了GraphXForm,结果表明其在目标得分上优于现有先进方法。此外,我们将GraphXForm应用于液-液萃取中的两种溶剂设计任务,再次超越其他方法,同时能灵活施加结构约束或从已有分子结构出发进行设计。
原文摘要 · Abstract (English)
Generative deep learning has become pivotal in molecular design for drug discovery, materials science, and chemical engineering. A widely used paradigm is to pretrain neural networks on string representations of molecules and fine-tune them using reinforcement learning on specific objectives. However, string-based models face challenges in ensuring chemical validity and enforcing structural constraints like the presence of specific substructures. We propose to instead combine graph-based molecular representations, which can naturally ensure chemical validity, with transformer architectures, which are highly expressive and capable of modeling long-range dependencies between atoms. Our approach iteratively modifies a molecular graph by adding atoms and bonds, which ensures chemical validity and facilitates the incorporation of structural constraints. We present GraphXForm, a decoder-only graph transformer architecture, which is pretrained on existing compounds and then fine-tuned using a new training algorithm that combines elements of the deep cross-entropy method and self-improvement learning. We evaluate GraphXForm on various drug design tasks, demonstrating superior objective scores compared to state-of-the-art molecular design approaches. Furthermore, we apply GraphXForm to two solvent design tasks for liquid-liquid extraction, again outperforming alternative methods while flexibly enforcing structural constraints or initiating design from existing molecular structures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。