arXiv:2512.11881cond-mat.softcs.AI2025-12

提出基于SMILES的聚合物图结构表示,提升语言模型对聚合物的表征能力。

Understanding Structural Representation in Foundation Models for Polymers

  • 用SMILES构建聚合物图结构,捕捉拓扑与连接性特征
  • 在28个数据集上表现优异,部分达顶尖水平
  • 揭示SMILES模型对无效输入也有强泛化能力,适合模型评估研究

从训练数据稀缺到缺乏标准化基准,聚合物基础模型的发展面临多重挑战。核心问题在于聚合物的结构表示。本文提出一种基于SMILES的聚合物图表示方法,可有效刻画关键结构特征与连接关系,优于其他SMILES表示方式。该模型在28个不同基准数据集上表现卓越。控制实验表明,所有SMILES表示均具强鲁棒性,包括化学或语义无效的变体,也能达到甚至超过当前最优性能。错误分析与注意力图进一步证实,基于SMILES的语言模型会跨整个序列空间进行插值预测,而不仅限于有效输入。本工作强调了控制实验的重要性,可避免人为假设干扰合理设计化学基础模型及其结构表示。

原文摘要 · Abstract (English)

From the relative scarcity of training data to the lack of standardized benchmarks, the development of foundation models for polymers face significant and multi-faceted challenges. At the core, many of these issues are tied directly to the structural representation of polymers and here, we present a new foundation model using a SMILES-based polymer graph representation. This approach allows representation of critical polymer architectural features and connectivity that are not available in other SMILES-based representations. The developed polymer foundation model exhibited excellent performance on 28 different benchmark datasets. Critical evaluation of the developed representation against other variations in control experiments reveals this approach to be a highly performant method of representing polymers in language-based foundation models. These control experiments also reveal a strong invariance of all SMILES representations, with many variations achieving state-of-the-art or near state-of-the-art performance, including those which are chemically or semantically invalid. Examination of error sources and attention maps for the evaluated representations corroborate the findings of the control experiments, showing that chemistry language models based on SMILES interpolate over all sequence space for prediction tasks, not only those of semantically valid inputs. Overall, this work highlights the importance of control experiments as a check on human-imposed assumptions that can limit rational design of both chemistry foundation models and their underlying structural representations.

聚合物基础模型结构表示SMILES

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。