用球坐标量化3D分子结构,让语言模型轻松生成分子
Tokenizing 3D Molecule Structure with Quantized Spherical Coordinates
- 用球坐标提取局部原子位置,构建3D分子线性表示
- 通过向量量化自编码器将连续坐标转为离散令牌
- 适合分子生成与性质预测,提升速度和稳定性
将语言模型(LM)应用于分子结构生成已广泛用于SMILES和SELFIES等线性表示。但扩展到3D分子结构生成面临两大挑战:(1) 难以设计满足SE(3)不变性的3D线性表示;(2) 将连续坐标离散化以适配需要离散输入的LM。为此,我们提出Mol-StrucTok,一种新型3D分子结构分词方法。其核心创新包括:(1) 通过球坐标系提取局部原子坐标,构建基于现有2D表示的3D线性形式,兼容多种分子表示方案;(2) 使用向量量化变分自编码器(VQ-VAE)对坐标进行分词,将其作为生成描述符,并引入邻近键长和键角作为理解描述符。基于此框架,我们训练了一个GPT-2风格模型用于3D分子生成。结果表明,该方法生成速度快、化学稳定性强,优于以往方法。进一步将学习到的离散表示用于Graphormer模型在QM9数据集上的性质预测,各项分子属性均取得一致提升,验证了方法的通用性与鲁棒性。
原文摘要 · Abstract (English)
The application of language models (LMs) to molecular structure generation using line notations such as SMILES and SELFIES has been well-established in the field of cheminformatics. However, extending these models to generate 3D molecular structures presents significant challenges. Two primary obstacles emerge: (1) the difficulty in designing a 3D line notation that ensures SE(3)-invariant atomic coordinates, and (2) the non-trivial task of tokenizing continuous coordinates for use in LMs, which inherently require discrete inputs. To address these challenges, we propose Mol-StrucTok, a novel method for tokenizing 3D molecular structures. Our approach comprises two key innovations: (1) We design a line notation for 3D molecules by extracting local atomic coordinates in a spherical coordinate system. This notation builds upon existing 2D line notations and remains agnostic to their specific forms, ensuring compatibility with various molecular representation schemes. (2) We employ a Vector Quantized Variational Autoencoder (VQ-VAE) to tokenize these coordinates, treating them as generation descriptors. To further enhance the representation, we incorporate neighborhood bond lengths and bond angles as understanding descriptors. Leveraging this tokenization framework, we train a GPT-2 style model for 3D molecular generation tasks. Results demonstrate strong performance with significantly faster generation speeds and competitive chemical stability compared to previous methods. Further, by integrating our learned discrete representations into Graphormer model for property prediction on QM9 dataset, Mol-StrucTok reveals consistent improvements across various molecular properties, underscoring the versatility and robustness of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。