提出自适应优化框架AIM,解决分子多属性设计中的梯度冲突问题。
AIM: Adaptive Intervention for Deep Multi-task Learning of Molecular Properties
- 通过动态策略调节梯度更新,缓解任务间冲突
- 在数据稀缺时显著提升性能,QM9与靶向降解剂基准上效果更优
- 学习到的策略矩阵可分析任务间关系,兼具可解释性
同时优化多个常存在冲突的分子属性是新药研发的关键瓶颈。尽管多任务学习前景广阔,但在药物发现中常见的数据稀缺场景下,其性能常受破坏性梯度干扰影响。为此,我们提出AIM,一种学习动态策略以调解梯度冲突的优化框架。该策略与主网络联合训练,采用由密集可微正则项构成的新目标函数,引导策略生成几何稳定且动态高效的更新,优先推进最困难的任务。实验表明,AIM在QM9和靶向蛋白降解剂基准的子集上显著优于多任务基线,尤其在数据稀缺条件下优势明显。除性能提升外,AIM的核心贡献在于可解释性:学习到的策略矩阵可作为分析任务间关系的诊断工具。这一数据高效性与诊断洞察力的结合,凸显自适应优化器在加速科学发现中的潜力,助力构建更鲁棒、更具洞察力的多属性分子设计模型。
原文摘要 · Abstract (English)
Simultaneously optimizing multiple, frequently conflicting, molecular properties is a key bottleneck in the development of novel therapeutics. Although a promising approach, the efficacy of multi-task learning is often compromised by destructive gradient interference, especially in the data-scarce regimes common to drug discovery. To address this, we propose AIM, an optimization framework that learns a dynamic policy to mediate gradient conflicts. The policy is trained jointly with the main network using a novel augmented objective composed of dense, differentiable regularizers. This objective guides the policy to produce updates that are geometrically stable and dynamically efficient, prioritizing progress on the most challenging tasks. We demonstrate that AIM achieves statistically significant improvements over multi-task baselines on subsets of the QM9 and targeted protein degraders benchmarks, with its advantage being most pronounced in data-scarce regimes. Beyond performance, AIM's key contribution is its interpretability; the learned policy matrix serves as a diagnostic tool for analyzing inter-task relationships. This combination of data-efficient performance and diagnostic insight highlights the potential of adaptive optimizers to accelerate scientific discovery by creating more robust and insightful models for multi-property molecular design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。