用离散潜在变量加速分子生成,兼具高精度与高效能。
Graph VQ-Transformer (GVT): Fast and Accurate Molecular Generation via High-Fidelity Discrete Latents
- 将分子图压缩为高保真离散序列,提升生成效率。
- 在ZINC250k等数据集上超越主流扩散模型,FCD指标更优。
- 适配大语言模型,为分子设计提供新范式。
从头生成具有理想性质的分子是一项关键挑战,扩散模型计算成本高,自回归模型则易受错误传播影响。本文提出图向量量化变分自编码器(Graph VQ-Transformer, GVT),一种两阶段生成框架,兼具高准确率与高效率。核心是新型图向量量化变分自编码器(VQ-VAE),将分子图压缩为高保真离散潜在序列。通过结合图注意力网络、标准逆Cuthill-McKee(RCM)节点排序和旋转位置编码(RoPE),该VQ-VAE实现接近完美的重构率。随后在这些离散潜在序列上训练自回归Transformer,将分子生成转化为结构化序列建模问题。该映射使分子设计可借助大规模序列建模技术,特别是与大语言模型(LLMs)产生协同效应。大量实验表明,GVT在ZINC250k、MOSES和GuacaMol等主要基准上达到或超过当前最优性能,尤其在分布相似性指标如FCD和KL散度上显著优于领先扩散模型。凭借卓越性能、效率及架构创新,GVT不仅为扩散模型提供有力替代方案,更确立了新的基准,推动离散潜在空间分子生成研究发展。
原文摘要 · Abstract (English)
The de novo generation of molecules with desirable properties is a critical challenge, where diffusion models are computationally intensive and autoregressive models struggle with error propagation. In this work, we introduce the Graph VQ-Transformer (GVT), a two-stage generative framework that achieves both high accuracy and efficiency. The core of our approach is a novel Graph Vector Quantized Variational Autoencoder (VQ-VAE) that compresses molecular graphs into high-fidelity discrete latent sequences. By synergistically combining a Graph Transformer with canonical Reverse Cuthill-McKee (RCM) node ordering and Rotary Positional Embeddings (RoPE), our VQ-VAE achieves near-perfect reconstruction rates. An autoregressive Transformer is then trained on these discrete latents, effectively converting graph generation into a well-structured sequence modeling problem. Crucially, this mapping of complex graphs to high-fidelity discrete sequences bridges molecular design with the powerful paradigm of large-scale sequence modeling, unlocking potential synergies with Large Language Models (LLMs). Extensive experiments show that GVT achieves state-of-the-art or highly competitive performance across major benchmarks like ZINC250k, MOSES, and GuacaMol, and notably outperforms leading diffusion models on key distribution similarity metrics such as FCD and KL Divergence. With its superior performance, efficiency, and architectural novelty, GVT not only presents a compelling alternative to diffusion models but also establishes a strong new baseline for the field, paving the way for future research in discrete latent-space molecular generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。