arXiv:2605.16823cs.LG2026-05被引 1

用向量量化给原子环境打语义标签,提升分子表示学习效果

VQ-Atom: Semantic Discretization of Local Atomic Environments for Molecular Representation Learning

论文配图:VQ-Atom: Semantic Discretization of Local Atomic Environments for Molecular Representation Learning
图 1 · 摘自论文原文
  • 基于局部化学环境的向量量化生成原子级离散标记
  • 在KIBA数据集上达到0.79的AUROC,优于SMILES和连续表示
  • 标记可复用,使下游训练速度提升约3倍,适合分子建模研究者

大语言模型的成功源于大规模预训练与有意义的离散标记。在分子机器学习中,SMILES广泛用作标记表示,但其本质是分子图的线性化格式,而非化学语义的分解。我们提出VQ-Atom,一种基于向量量化、根据局部化学环境为原子分配离散标记的语义标记框架。与SMILES标记不同,VQ-Atom标记编码图局部化学上下文,且与分子结构对齐。在使用KIBA数据集进行蛋白冷启动药物-靶点相互作用预测时,VQ-Atom显著提升全局排名性能,达到0.79的AUROC,明显优于基于SMILES和连续分子表示的方法,且在相同下游架构下表现更优。此外,通过将每原子连续特征替换为可复用的离散标记,VQ-Atom使下游训练速度提升约3倍。结果表明,分子标记并非仅是预处理步骤,而是核心设计选择。良好的结构化标记能编码丰富化学语义,减轻下游学习负担。VQ-Atom可被视为定义了一种分子语言,其中标记对应化学上有意义的原子环境,提示标记设计可能成为继架构、目标与优化之外的机器学习新研究维度。

原文摘要 · Abstract (English)

Large language models succeed by combining large-scale pretraining with meaningful discrete tokens. In molecular machine learning, SMILES is widely used as a token representation, but it is primarily a linearization format for molecular graphs rather than a semantic decomposition of chemistry. We propose VQ-Atom, a semantic tokenization framework that assigns discrete atom-level tokens based on local chemical environments via vector quantization. Unlike SMILES tokens, VQ-Atom tokens encode graph-local chemical context and are aligned with molecular structure. On protein-cold drug--target interaction prediction using the KIBA dataset, VQ-Atom substantially improves global ranking performance, achieving AUROC of 0.79 while substantially outperforming both SMILES-based and continuous molecular representations under an identical downstream architecture. Furthermore, VQ-Atom enables approximately 3 times faster downstream training than continuous atom-level representations by replacing per-atom continuous features with reusable discrete tokens. These results suggest that molecular tokenization is not merely a preprocessing step, but a central design choice. In particular, well-structured tokens can encode substantial chemical semantics, reducing the burden on downstream learning. VQ-Atom can be interpreted as defining a molecular language, where tokens correspond to chemically meaningful atomic environments, suggesting that token design may constitute an additional axis of machine learning research alongside architecture, objectives, and optimization.

分子表示向量量化原子环境标记设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。