arXiv:2606.27361cs.LGcs.AI2026-06被引 1

用自回归框架提升分子系统采样效率,尤其擅长大肽链模拟。

Autoregressive Boltzmann Generators

论文配图:Autoregressive Boltzmann Generators
图 1 · 摘自论文原文
  • 采用自回归结构替代传统生成流,突破拓扑限制并支持逐步干预。
  • 在10残基小肽上性能显著优于流模型,8残基系统零样本能量误差降超60%。
  • 推出1.32亿参数可迁移模型Robin,适合分子构象生成与能量预测任务。

在热力学平衡下高效采样分子系统是统计物理中的核心挑战。该挑战催生了玻尔兹曼生成器(BGs),通过结合生成模型与精确似然函数及重要性采样校正,实现无关联的快速采样。然而,现有BGs主要依赖归一化流(NFs),其或因严格可逆性约束导致表达能力有限(离散时间),或因计算昂贵的似然函数而效率低下(连续时间)。本文提出自回归玻尔兹曼生成器(ArBG)——一种新型自回归建模框架,摆脱了基于流的BG范式。ArBG避免了流模型的拓扑限制,支持推理时序列干预,并借助类大语言模型架构实现更强可扩展性。实证表明,ArBG在所有基准测试中均显著优于流模型,尤其在较大肽类系统如10残基的Chignolin中表现突出。此外,我们引入Robin——一个1.32亿参数的可迁移模型,基于ArBG框架训练,在8残基系统上的零样本能量误差(E-W₂)降低超过60%,超越此前最优结果。代码见:https://github.com/danyalrehman/autobg。

原文摘要 · Abstract (English)

Efficient sampling of molecular systems at thermodynamic equilibrium is a hallmark challenge in statistical physics. This challenge has driven the development of Boltzmann Generators (BGs), which allow rapid generation of uncorrelated equilibrium samples by combining a generative model with exact likelihoods and an importance sampling correction. However, modern BGs predominantly rely on normalizing flows (NFs), which either suffer from limited expressivity due to strict invertibility constraints (discrete time) or computationally expensive likelihoods (continuous time). In this paper, we propose Autoregressive Boltzmann Generators (ArBG) -- a novel autoregressive modelling framework -- that overcomes these limitations by departing from the flow-based BG paradigm. ArBG circumvents the topological constraints of flows and enables sequential inference-time interventions, while offering enhanced scalability by leveraging architectures effective in Large Language Models. We empirically demonstrate that ArBG leads to significant improvements over flow-based models across all benchmarks, but particularly in larger peptide systems such as the 10-residue Chignolin. Furthermore, we introduce Robin, a 132 million parameter transferable model trained with the ArBG framework which improves over the previous state-of-the-art, reducing the zero-shot energy error, E-W$_2$, on 8-residue systems by over 60$\%$. The code can be found at the following link: https://github.com/danyalrehman/autobg.

分子生成自回归模型能量预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。