arXiv:2504.06265cs.LGcs.AI2025-04被引 7

用语言模型做实验优化,让AI更可靠地发现高效反应条件。

Large language models as uncertainty-calibrated optimizers for experimental discovery

  • 用不确定度感知目标训练语言模型,使其能基于自然语言进行决策。
  • 在50轮实验中将高产反应发现率从24%提升至43%,接近翻倍。
  • 适用于化学、材料等多领域,降低对专业特征工程的依赖。

科学发现越来越依赖高效的实验优化以应对时间与资源限制下的庞大设计空间。传统方法通常需要大量领域知识和特征工程。尽管大语言模型具备广泛科学知识,可规避特征工程限制,但缺乏高风险决策所需的校准不确定性估计。因此,现有优化方法迫使研究者在领域知识与可靠性之间做出权衡,缺乏兼顾二者的系统性方法。本文提出通过传统优化方法的不确定性感知目标训练语言模型,使其成为可信赖的、由自然语言引导的优化器。通过在不确定性的实验结果中训练,我们把模型的过度自信转化为精确的校准机制。应用于经典的Buchwald-Hartwig偶联反应(药物合成核心),我们的方法在50次实验内、从10个失败条件出发,将高产率反应的发现率从24%提升至43%。在涵盖有机合成、材料科学、催化、工艺化学和分子设计的19个不同优化问题中,该方法平均排名第一,确立了基于不确定性引导的可靠语言模型优化新范式。该方法可加速发现进程,通过自然语言接口替代复杂的领域特征工程,推动人工智能指导实验的实用化。研究强调,通过严谨的不确定性量化实现可靠性,是释放AI实验潜力的关键。

原文摘要 · Abstract (English)

Scientific discovery increasingly depends on efficient experimental optimization to navigate vast design spaces under time and resource constraints. Traditional approaches often require extensive domain expertise and feature engineering. While large language models, with their vast scientific knowledge, circumvent the feature engineering limitations, they lack the calibrated uncertainty estimates required for high-stakes decision making. Hence, current optimization methods force a choice between domain knowledge and reliability, with no principled approach that affords both. In this work, we show that training language models through the uncertainty-aware objectives of traditional optimization methods enables their use as reliable optimizers guided by natural language. By teaching LLMs from experimental outcomes under uncertainty, we transform their overconfidence from a fundamental limitation into a precise calibration mechanism. Applied to Buchwald-Hartwig reactions, a cornerstone of pharmaceutical synthesis, our method nearly doubles the discovery rate of high-yielding reaction conditions, from 24% to 43% in 50 experimental iterations starting from 10 unsuccessful conditions. Across 19 diverse optimization problems spanning organic synthesis, materials science and catalysis, process chemistry, and molecular design, our approach ranks first on average, establishing a new paradigm for reliable, uncertainty-guided optimization with LLMs. Our approach can accelerate discovery by lowering the barrier to using powerful optimization methods, replacing the need for domain-specific feature engineering with more accessible natural language interfaces. These findings highlight that ensuring reliability through principled uncertainty quantification is critical for realizing the full potential of AI-guided experimentation.

实验优化语言模型不确定性量化科学发现

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。