用物理约束筛选推理路径,提升材料发现模型的准确性与可靠性。
Aligning Reasoning LLMs for Materials Discovery with Physics-aware Rejection Sampling
- 通过物理感知拒绝采样筛选推理轨迹,确保结果符合基本物理规律。
- 在相同计算预算下,错误率降低32%,物理违规率下降41%。
- 适合需要高可靠性的材料设计闭环系统开发者使用。
将自动化实验与算法决策结合的AI驱动材料发现,依赖于过程感知的配方到性能预测模型,要求其具备高精度、良好校准性及物理可接受性。本文将此问题视为大语言模型的推理任务。为赋予语言模型推理能力,我们从教师模型中收集推理轨迹并用于训练学生模型。然而,多数训练流程采用二值正确性或学习偏好信号选择轨迹,难以反映物理合理性。为此提出物理感知拒绝采样(PaRS),一种训练时的轨迹选择机制,优先选择与基础物理一致且数值接近目标的轨迹,并引入轻量级终止策略控制计算成本。我们在大尺寸学生模型上实现该框架,该模型基于大教师模型生成的轨迹进行微调,并在匹配的令牌预算下与多种拒绝采样基线对比评估。结果表明,本方法在准确性和校准性方面均优于基线,物理违规率显著降低,采样成本也更低。这些成果说明,结合适度领域感知约束与轨迹级选择,是实现高效、可靠的推理型模型用于过程感知性质预测和闭环材料设计的可行路径。
原文摘要 · Abstract (English)
AI-driven materials discovery that couples automated experimentation with algorithmic decision-making requires process aware recipe to property predictors that are accurate, calibrated, and physically admissible. We approach this as a reasoning problem with large reasoning models (LRMs). To instill reasoning capability into language models, we curate reasoning traces from a teacher model to train a student model. However, most training pipelines select reasoning traces using binary correctness or learned preference signals that poorly reflect physical admissibility. We introduce Physics-aware Rejection Sampling (PaRS), a training-time trace selection scheme that favors traces consistent with fundamental physics and numerically close to targets, with lightweight halting to control compute. We instantiate our framework with a large student model fine-tuned on traces synthesized by a larger teacher model, and evaluate under matched token budgets against various rejection sampling baselines. Our method improves accuracy and calibration, reduces physics-violation rates, and lowers sampling cost relative to baselines. These results indicate that modest, domain-aware constraints combined with trace-level selection provide a practical path toward reliable, efficient LRMs for process-aware property prediction and closed-loop materials design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。