arXiv:2605.30610cs.LG2026-05被引 3

提出CFO算法,让分子生成模型自动平衡性能与可合成性。

Constrained Flow Optimization via Sequential Fine Tuning for Molecular Design

论文配图:Constrained Flow Optimization via Sequential Fine Tuning for Molecular Design
图 1 · 摘自论文原文
  • 通过序列微调将约束优化问题转化为可扩展的训练流程
  • 在分子设计任务中同时提升结合亲和力与可合成率
  • 适合需要可靠约束满足的药物分子生成场景

将生成式基础模型(如扩散模型、流模型)用于优化给定奖励函数(如结合亲和力),同时满足约束(如分子可合成性),是推动其在真实科学发现(如分子设计、蛋白质工程)中应用的关键。尽管已有研究通过强化学习和控制方案实现了可扩展的奖励引导微调,但如何算法化地可靠、可预测地权衡奖励最大化与约束满足仍是一个开放问题。为此,我们首先提出一个严格的约束生成优化框架,将适配问题置于优化视角下,并将约束生成作为子问题重构。随后,我们引入约束流优化(CFO),该算法通过已有的可扩展方法,将原始问题转化为序列微调,自动且可证明地平衡奖励最大化与约束满足。我们为基于CFO的约束生成优化与约束生成提供了收敛性保证。最终,在合成数据集和分子设计任务上的实验表明,CFO在持续提升奖励的同时,确保了高约束满足率,展示了其在约束生成优化中的实际价值。

原文摘要 · Abstract (English)

Adapting generative foundation models, in particular diffusion and flow models, to optimize given reward functions (e.g., binding affinity) while satisfying constraints (e.g., molecular synthesizability) is fundamental for their adoption in real-world scientific discovery applications such as molecular design or protein engineering. While recent works have introduced scalable methods for reward-guided fine-tuning of such models via reinforcement learning and control schemes, it remains an open problem how to algorithmically trade-off reward maximization and constraint satisfaction in a reliable and predictable manner. Motivated by this challenge, we first present a rigorous framework for Constrained Generative Optimization, which brings an optimization viewpoint to the introduced adaptation problem and retrieves the relevant task of constrained generation as a sub-case. Then, we introduce Constrained Flow Optimization (CFO), an algorithm that automatically and provably balances reward maximization and constraint satisfaction by reducing the original problem to sequential fine-tuning via established, scalable methods. We provide convergence guarantees for constrained generative optimization and constrained generation via CFO. Ultimately, we present an experimental evaluation of CFO on both synthetic, yet illustrative, settings, and a molecular design task. Across these evaluations, CFO achieves consistent increases in reward while ensuring high constraint satisfaction, showcasing its practical utility for constrained generative optimization.

分子生成约束优化流模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。