arXiv:2507.00024cs.LGcond-mat.mtrl-sci2025-07被引 2

用强化学习+专家知识,从少量数据中高效设计高性能合金

AIMatDesign: Knowledge-Augmented Reinforcement Learning for Inverse Materials Design under Data Scarcity

  • 通过差分算法扩充数据,构建可信经验池加速训练
  • 用大模型自动修正预测偏差,提升奖励信号与状态价值一致性
  • 融合专家规则设计奖励函数,适合材料研发人员闭环探索

随着对新型材料需求的增长,基于机器学习的逆向设计方法在高维材料成分空间与有限实验数据之间面临挑战。现有方法存在两大局限:(I) 机器学习模型在高维空间中可靠性不足,导致设计过程产生预测偏差;(II) 难以有效融入领域专家知识,限制了知识引导的逆向设计能力。为此,我们提出AIMatDesign,一种增强型强化学习框架。该框架利用基于差分的算法扩充实验数据,构建可信经验池,加速模型收敛。为提升模型可靠性,采用由大语言模型(LLMs)指导的自动化精炼策略,动态修正预测不一致,强化奖励信号与状态价值函数的一致性。此外,引入基于知识的奖励函数,利用专家领域规则提升训练稳定性和效率。实验表明,AIMatDesign在发现效率、收敛速度和成功率上显著优于传统机器学习与强化学习方法。所提出的代表性Zr基合金经实验合成后,获得屈服强度达1.7GPa、延伸率10.2%的优异非晶合金(BMG),与预测高度吻合。同时,框架准确捕捉了屈服强度随成分变化的趋势,展现了其可靠性与闭环材料发现潜力。

原文摘要 · Abstract (English)

With the growing demand for novel materials, machine learning-driven inverse design methods face significant challenges in reconciling the high-dimensional materials composition space with limited experimental data. Existing approaches suffer from two major limitations: (I) machine learning models often lack reliability in high-dimensional spaces, leading to prediction biases during the design process; (II) these models fail to effectively incorporate domain expert knowledge, limiting their capacity to support knowledge-guided inverse design. To address these challenges, we introduce AIMatDesign, a reinforcement learning framework that addresses these limitations by augmenting experimental data using difference-based algorithms to build a trusted experience pool, accelerating model convergence. To enhance model reliability, an automated refinement strategy guided by large language models (LLMs) dynamically corrects prediction inconsistencies, reinforcing alignment between reward signals and state value functions. Additionally, a knowledge-based reward function leverages expert domain rules to improve stability and efficiency during training. Our experiments demonstrate that AIMatDesign significantly surpasses traditional machine learning and reinforcement learning methods in discovery efficiency, convergence speed, and success rates. Among the numerous candidates proposed by AIMatDesign, experimental synthesis of representative Zr-based alloys yielded a top-performing BMG with 1.7GPa yield strength and 10.2\% elongation, closely matching predictions. Moreover, the framework accurately captured the trend of yield strength variation with composition, demonstrating its reliability and potential for closed-loop materials discovery.

逆向设计强化学习材料发现知识增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。