用强化学习提升扩散模型生成3D分子的多目标优化能力
Uncertainty-Aware Multi-Objective Reinforcement Learning-Guided Diffusion Models for 3D De Novo Molecular Design
- 引入不确定性感知的强化学习动态调整奖励函数
- 在多个数据集上显著提升分子质量和多属性优化效果
- 适合药物设计与分子工程领域研究者参考
从头设计具有理想性质的三维分子仍是药物发现与分子工程中的核心挑战。尽管扩散模型在生成高质量3D分子结构方面表现突出,但难以有效控制真实应用场景中复杂的多目标约束。本文提出一种不确定性感知的强化学习框架,引导3D分子扩散模型在多个性质目标间优化的同时提升生成分子的整体质量。方法利用带有预测不确定性的代理模型动态构建奖励函数,实现多目标间的平衡。我们在三个基准数据集和多种扩散模型架构上进行了全面评估,结果一致优于基线模型,在分子质量和属性优化方面均有显著提升。此外,对顶级生成候选物进行分子动力学模拟和ADMET分析,显示其具备良好的类药性与结合稳定性,与已知表皮生长因子受体(EGFR)抑制剂相当。结果表明,强化学习引导的生成扩散模型在自动化分子设计中具有巨大潜力。
原文摘要 · Abstract (English)
Designing de novo 3D molecules with desirable properties remains a fundamental challenge in drug discovery and molecular engineering. While diffusion models have demonstrated remarkable capabilities in generating high-quality 3D molecular structures, they often struggle to effectively control complex multi-objective constraints critical for real-world applications. In this study, we propose an uncertainty-aware Reinforcement Learning (RL) framework to guide the optimization of 3D molecular diffusion models toward multiple property objectives while enhancing the overall quality of the generated molecules. Our method leverages surrogate models with predictive uncertainty estimation to dynamically shape reward functions, facilitating balance across multiple optimization objectives. We comprehensively evaluate our framework across three benchmark datasets and multiple diffusion model architectures, consistently outperforming baselines for molecular quality and property optimization. Additionally, Molecular Dynamics (MD) simulations and ADMET profiling of top generated candidates indicate promising drug-like behavior and binding stability, comparable to known Epidermal Growth Factor Receptor (EGFR) inhibitors. Our results demonstrate the strong potential of RL-guided generative diffusion models for advancing automated molecular design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。