arXiv:2506.01158cs.LGcs.AI2025-06被引 6

用回归方法训练流模型,让分子构象生成更快更稳。

Efficient Regression-Based Training of Normalizing Flows for Boltzmann Generators

  • 用l2回归替代传统最大似然,避免训练不稳和计算开销。
  • 在丙氨酸二肽等分子系统上,采样速度和稳定性优于传统方法。
  • 适合需要快速似然评估的分子模拟场景,如玻尔兹曼生成器。

无模拟训练框架推动了连续空间生成模型的发展,催生了大规模扩散和流匹配模型。然而,这些现代生成模型推理成本高,在需快速似然评估的科学应用(如分子构象的玻尔兹曼生成器)中受限。本文重新审视经典归一化流在玻尔兹曼生成器中的应用,其虽支持高效采样与似然计算,但最大似然训练常不稳定且计算困难。为此提出回归训练归一化流(RegFlow),一种新颖且可扩展的回归训练目标,以简单ℓ₂回归替代传统最大似然,避免数值不稳和计算挑战。具体地,RegFlow将先验样本通过流映射至由最优传输耦合或预训练连续归一化流(CNF)生成的目标。为增强数值稳定性,引入新的前向-后向自洽损失,实现简便。实验表明,RegFlow可训练此前最大似然无法处理的多种架构,且在丙氨酸二肽、三肽、四肽的笛卡尔坐标平衡采样中,性能、计算成本与稳定性均优于最大似然训练,展现了在分子系统中的潜力。

原文摘要 · Abstract (English)

Simulation-free training frameworks have been at the forefront of the generative modelling revolution in continuous spaces, leading to large-scale diffusion and flow matching models. However, such modern generative models suffer from expensive inference, inhibiting their use in numerous scientific applications like Boltzmann Generators (BGs) for molecular conformations that require fast likelihood evaluation. In this paper, we revisit classical normalizing flows in the context of BGs that offer efficient sampling and likelihoods, but whose training via maximum likelihood is often unstable and computationally challenging. We propose Regression Training of Normalizing Flows (RegFlow), a novel and scalable regression-based training objective that bypasses the numerical instability and computational challenge of conventional maximum likelihood training in favour of a simple $\ell_2$-regression objective. Specifically, RegFlow maps prior samples under our flow to targets computed using optimal transport couplings or a pre-trained continuous normalizing flow (CNF). To enhance numerical stability, RegFlow employs effective regularization strategies such as a new forward-backward self-consistency loss that enjoys painless implementation. Empirically, we demonstrate that RegFlow unlocks a broader class of architectures that were previously intractable to train for BGs with maximum likelihood. We also show RegFlow exceeds the performance, computational cost, and stability of maximum likelihood training in equilibrium sampling in Cartesian coordinates of alanine dipeptide, tripeptide, and tetrapeptide, showcasing its potential in molecular systems.

生成模型分子模拟归一化流回归训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。