用强化学习优化生成分子,让模型更稳定、更符合药物设计需求。
A Reinforcement Learning-Driven Transformer GAN for Molecular Generation
- 采用先解码后编码的Transformer结构,提升分子生成质量。
- 结合强化学习与蒙特卡洛树搜索,使生成分子化学性质更优。
- 在QM9和ZINC数据集上表现优异,适合药物研发场景使用。
生成具有特定化学性质的分子在化学合成和药物发现中至关重要。尽管人工智能和深度学习推动了数据驱动的分子生成,但简化分子输入线性系统(SMILES)表示的敏感性以及生成对抗网络(GAN)在离散数据上的应用困难仍带来挑战。本文提出RL-MolGAN,一种基于Transformer的离散GAN框架,采用先解码后编码结构,可从头设计和骨架引导方式生成类药分子。通过引入强化学习(RL)和蒙特卡洛树搜索(MCTS),提升训练稳定性并优化分子化学性质。进一步扩展出的RL-MolWGAN结合了Wasserstein距离与小批量判别,增强模型稳定性。在两个常用分子数据集QM9和ZINC上的实验表明,该模型能生成高质量、多样化且具备理想化学性质的分子结构。
原文摘要 · Abstract (English)
Generating molecules with desired chemical properties presents a critical challenge in fields such as chemical synthesis and drug discovery. Recent advancements in artificial intelligence (AI) and deep learning have significantly contributed to data-driven molecular generation. However, challenges persist due to the inherent sensitivity of simplified molecular input line entry system (SMILES) representations and the difficulties in applying generative adversarial networks (GANs) to discrete data. This study introduces RL-MolGAN, a novel Transformer-based discrete GAN framework designed to address these challenges. Unlike traditional Transformer architectures, RL-MolGAN utilizes a first-decoder-then-encoder structure, facilitating the generation of drug-like molecules from both $de~novo$ and scaffold-based designs. In addition, RL-MolGAN integrates reinforcement learning (RL) and Monte Carlo tree search (MCTS) techniques to enhance the stability of GAN training and optimize the chemical properties of the generated molecules. To further improve the model's performance, RL-MolWGAN, an extension of RL-MolGAN, incorporates Wasserstein distance and mini-batch discrimination, which together enhance the stability of the GAN. Experimental results on two widely used molecular datasets, QM9 and ZINC, validate the effectiveness of our models in generating high-quality molecular structures with diverse and desirable chemical properties.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。