用自然语言生成稳定晶体结构,让科研人员一键设计新材料。
Generative Hierarchical Materials Search
- 分层生成:先用语言模型提炼化学信息,再用扩散模型生成具体结构。
- 生成结构更符合需求且能量更低,优于直接用语言模型生成。
- 可从零开始生成尖晶石、双钙钛矿等常见结构,适合材料设计初学者。
大规模训练的生成模型现已能生成文本、视频,最近还扩展到科学数据如晶体结构。在材料科学中,特别是晶体结构生成任务中,领域专家提供的高层次指令对系统生成可应用于后续研究的候选结构至关重要。本文将端到端的语言到结构生成建模为多目标优化问题,提出生成式分层材料搜索(GenMS),实现可控晶体结构生成。GenMS包含三个组件:(1) 语言模型接收自然语言输入,生成晶体的中间文本信息(如化学式);(2) 扩散模型根据中间信息生成低维连续值晶体结构;(3) 图神经网络从生成结构预测性质(如形成能)。推理时,三者协同进行前向树搜索,探索可能结构空间。实验表明,与直接使用语言模型生成结构相比,GenMS在满足用户需求和生成低能结构方面均表现更优。我们验证了仅凭自然语言输入,GenMS即可生成双钙钛矿、尖晶石等常见晶体结构,未来有望成为复杂结构生成的基础。
原文摘要 · Abstract (English)
Generative models trained at scale can now produce text, video, and more recently, scientific data such as crystal structures. In applications of generative approaches to materials science, and in particular to crystal structures, the guidance from the domain expert in the form of high-level instructions can be essential for an automated system to output candidate crystals that are viable for downstream research. In this work, we formulate end-to-end language-to-structure generation as a multi-objective optimization problem, and propose Generative Hierarchical Materials Search (GenMS) for controllable generation of crystal structures. GenMS consists of (1) a language model that takes high-level natural language as input and generates intermediate textual information about a crystal (e.g., chemical formulae), and (2) a diffusion model that takes intermediate information as input and generates low-level continuous value crystal structures. GenMS additionally uses a graph neural network to predict properties (e.g., formation energy) from the generated crystal structures. During inference, GenMS leverages all three components to conduct a forward tree search over the space of possible structures. Experiments show that GenMS outperforms other alternatives of directly using language models to generate structures both in satisfying user request and in generating low-energy structures. We confirm that GenMS is able to generate common crystal structures such as double perovskites, or spinels, solely from natural language input, and hence can form the foundation for more complex structure generation in near future.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。