arXiv:2510.23040cs.LGcond-mat.mtrl-sci2025-10NeurIPS被引 14

用大模型和扩散模型结合,生成更稳定新颖的晶体材料。

LLM Meets Diffusion: A Hybrid Framework for Crystal Material Generation

  • 先用微调大模型预测原子类型与结构,再用扩散模型优化位置和晶格。
  • 在结构与成分有效性上平衡更好,生成材料更稳定且更创新。
  • 支持用户指定条件生成,适合材料设计研究人员使用。

生成建模的最新进展在设计新型周期性晶体结构方面展现出巨大潜力。现有方法通常依赖大型语言模型(LLM)或等变去噪模型,二者各具优势:LLM擅长处理离散的原子种类,但在原子坐标和晶格参数等连续特征上表现不佳;而去噪模型能有效建模连续变量,却难以生成准确的原子组成。为此,我们提出 CrysLLMGen,一种将 LLM 与扩散模型结合的混合框架,以融合两者优势进行晶体材料生成。采样时,先用微调后的 LLM 生成原子类型、原子坐标和晶格结构的中间表示;随后保留预测的原子类型,将坐标与晶格输入预训练的等变扩散模型进行精修。该框架在多个基准任务与数据集上超越现有最先进模型。CrysLLMGen 不仅在结构与成分有效性上实现良好平衡,还生成了比纯 LLM 或去噪模型更具稳定性和新颖性的材料。此外,该框架具备强大的条件生成能力,可有效生成满足用户自定义约束的材料。代码已开源:https://github.com/kdmsit/crysllmgen。

原文摘要 · Abstract (English)

Recent advances in generative modeling have shown significant promise in designing novel periodic crystal structures. Existing approaches typically rely on either large language models (LLMs) or equivariant denoising models, each with complementary strengths: LLMs excel at handling discrete atomic types but often struggle with continuous features such as atomic positions and lattice parameters, while denoising models are effective at modeling continuous variables but encounter difficulties in generating accurate atomic compositions. To bridge this gap, we propose CrysLLMGen, a hybrid framework that integrates an LLM with a diffusion model to leverage their complementary strengths for crystal material generation. During sampling, CrysLLMGen first employs a fine-tuned LLM to produce an intermediate representation of atom types, atomic coordinates, and lattice structure. While retaining the predicted atom types, it passes the atomic coordinates and lattice structure to a pre-trained equivariant diffusion model for refinement. Our framework outperforms state-of-the-art generative models across several benchmark tasks and datasets. Specifically, CrysLLMGen not only achieves a balanced performance in terms of structural and compositional validity but also generates more stable and novel materials compared to LLM-based and denoisingbased models Furthermore, CrysLLMGen exhibits strong conditional generation capabilities, effectively producing materials that satisfy user-defined constraints. Code is available at https://github.com/kdmsit/crysllmgen

晶体生成混合模型扩散模型材料设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。