arXiv:2605.17976cs.AImath.OC2026-05被引 6

用大模型指导贝叶斯优化,6轮就找到最佳电解液配方

Unleashing LLMs in Bayesian Optimization: Preference-Guided Framework for Scientific Discovery

论文配图:Unleashing LLMs in Bayesian Optimization: Preference-Guided Framework for Scientific Discovery
图 1 · 摘自论文原文
  • 让大模型持续提供语义偏好,动态调整优化方向
  • 在6轮内达90%最优值,比传统方法快40%以上
  • 适合需要快速实验的物理、化学、材料等科学领域

科学发现受限于昂贵实验和资源不足,亟需高效的AI优化方法。贝叶斯优化虽能平衡探索与利用,但在高维场景下冷启动慢、扩展性差。为此,我们提出首个基于大模型偏好的贝叶斯优化框架LGBO,将大模型的语义推理持续融入优化循环。不同于仅用于初始或候选生成的现有方法,LGBO通过区域提升的偏好机制,在每轮迭代中稳定可控地调整代理模型均值。理论上,最坏情况下性能不劣于标准贝叶斯优化;当偏好与目标一致时,收敛速度显著提升。实证上,LGBO在物理、化学、生物和材料科学的多个干实验基准中表现优异。尤其在铁铬电池电解液的湿实验中,仅用6轮即达到90%最优值,而标准贝叶斯优化和现有基线均需超过10轮。结果表明,LGBO为大模型融入科学优化流程提供了可行路径。

原文摘要 · Abstract (English)

Scientific discovery is increasingly constrained by costly experiments and limited resources, underscoring the need for efficient optimization in AI for science. Bayesian Optimization (BO), though widely adopted for balancing exploration and exploitation, often exhibits slow cold-start performance and poor scalability in high-dimensional settings, limiting its applicability in real-world scientific problems. To overcome these challenges, we propose LLM-Guided Bayesian Optimization (LGBO), the first LLM preference-guided BO framework that continuously integrates the semantic reasoning of large language models (LLMs) into the optimization loop. Unlike prior works that use LLMs only for warm-start initialization or candidate generation, LGBO introduces a region-lifted preference mechanism that embeds LLM-driven preferences into every iteration, shifting the surrogate mean in a stable and controllable way. Theoretically, we prove that LGBO does not perform significantly worse than standard BO in the worst case, while achieving significantly faster convergence when preferences align with the objective. Empirically, LGBO consistently outperforms existing methods across diverse dry benchmarks in physics, chemistry, biology, and materials science. Most notably, in a new wet-lab optimization of Fe-Cr battery electrolytes, LGBO attains \textbf{90\% of the best observed value within 6 iterations}, whereas standard BO and existing LLM-augmented baselines require more than 10. Together, these results suggest that LGBO offers a promising direction for integrating LLMs into scientific optimization workflows.

贝叶斯优化大模型应用科学发现

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。