arXiv:2601.16312cs.CLcs.AI2026-01

用12.5万条聚合物设计任务训练大模型,提升推理能力。

Teaching and Evaluating LLMs to Reason About Polymer Design Related Tasks

  • 构建含1300万数据点的聚合物知识库,生成结构化思维链数据
  • 70亿到320亿参数模型在测试集上超越同类模型,媲美闭源前沿模型
  • 适合从事材料科学与AI交叉研究的科研人员参考

人工智能在科学领域的应用已展现出巨大潜力,尤其是在聚合物设计方面。然而,当前大语言模型在该领域表现不佳,主要因为缺乏聚合物专有知识,且已有对齐模型覆盖范围有限。为此,我们提出PolyBench,一个包含超过12.5万条聚合物设计相关任务的大规模训练与测试基准数据集,基于从实验和合成数据源获取的超过1300万条数据点,确保聚合物及其性质的广泛覆盖。为有效对齐,我们引入一种知识增强的推理蒸馏方法,通过结构化思维链(CoT)扩充数据集。此外,任务按由简至繁的分析推理问题组织,支持泛化测试与诊断探针。实验表明,70亿至320亿参数的小中型语言模型(SLMs)在PolyBench上训练后,优于同规模模型,并在外部聚合物基准上表现出性能提升,同时保持与闭源前沿模型的竞争性。数据集与代码已开源:https://github.com/StonyBrookNLP/PolyBench。

原文摘要 · Abstract (English)

Research in AI4Science has shown promise in many science applications, including polymer design. However, current LLMs are ineffective in this problem space because: (i) most models lack polymer-specific knowledge, and (ii) existing aligned models have limited coverage of knowledge and capabilities relevant to polymer design. Addressing this, we introduce PolyBench, a large-scale training and test benchmark dataset of more than 125K polymer design-related tasks, leveraging a knowledge base of more than 13 million data points obtained from experimental and synthetic data sources to ensure broad coverage of polymers and their properties. For effective alignment using PolyBench, we introduce a knowledge-augmented reasoning distillation method that augments this dataset with structured CoT. Furthermore, tasks in PolyBench are organized from simple to complex analytical reasoning problems, enabling generalization tests and diagnostic probes across the problem space. Experiments show that small- and mid- sized language models (SLMs) with 7B to 32BB parameters, trained on PolyBench, outperform similar-sized models and remain competitive with closed-source frontier LLMs on PolyBench's test dataset, while demonstrating performance gains on external polymer benchmarks. Dataset and associated code available at https://github.com/StonyBrookNLP/PolyBench.

聚合物设计知识蒸馏材料AI推理能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。