arXiv:2502.18462cs.LGcs.AI2025-02ICML被引 40

用Transformer高效生成分子平衡态样本,突破长肽链采样难题。

Scalable Equilibrium Sampling with Sequential Boltzmann Generators

  • 基于Transformer的可逆非等变流模型,直接在原子坐标上运行。
  • 结合退火朗之万动力学实现采样优化,三至六肽首次实现精确平衡采样。
  • 适合需要高精度分子构象采样的计算化学与药物设计研究者。

在统计物理中,大规模分子状态的热力学平衡采样是一个长期挑战。玻尔兹曼生成器通过将归一化流与重要性采样结合,在目标分布下生成不相关样本。本文提出序列玻尔兹曼生成器(SBG),核心贡献包括:1)一种基于Transformer的高效归一化流,直接作用于全原子笛卡尔坐标;与以往等变连续流不同,采用完全可逆的非等变架构,在采样和似然评估中均具备更高效率。2)利用连续时间序列蒙特卡洛方法,在推理阶段对流模型生成的样本进行缩放,通过退火朗之万动力学将其逐步引导至目标分布。该方法在肽类系统上所有指标均达到当前最优表现,首次实现了三肽、四肽和六肽在笛卡尔坐标下的精确平衡采样,而此前这些系统对传统玻尔兹曼生成器而言是不可行的。

原文摘要 · Abstract (English)

Scalable sampling of molecular states in thermodynamic equilibrium is a long-standing challenge in statistical physics. Boltzmann generators tackle this problem by pairing normalizing flows with importance sampling to obtain uncorrelated samples under the target distribution. In this paper, we extend the Boltzmann generator framework with two key contributions, denoting our framework Sequential Boltzmann generators (SBG). The first is a highly efficient Transformer-based normalizing flow operating directly on all-atom Cartesian coordinates. In contrast to the equivariant continuous flows of prior methods, we leverage exactly invertible non-equivariant architectures which are highly efficient during both sample generation and likelihood evaluation. This efficiency unlocks more sophisticated inference strategies beyond standard importance sampling. In particular, we perform inference-time scaling of flow samples using a continuous-time variant of sequential Monte Carlo, in which flow samples are transported towards the target distribution with annealed Langevin dynamics. SBG achieves state-of-the-art performance w.r.t. all metrics on peptide systems, demonstrating the first equilibrium sampling in Cartesian coordinates of tri-, tetra- and hexa-peptides that were thus far intractable for prior Boltzmann generators.

分子模拟生成模型扩散模型蛋白质结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。