用大模型指导贝叶斯优化,加速复杂实验搜索
Language-Based Bayesian Optimization Research Assistant (BORA)
- 融合大模型与贝叶斯优化,智能推荐搜索区域
- 在15维合成任务和4个真实实验中显著提升性能
- 适合需要高效探索的科研人员和实验设计者
许多重要科学问题涉及多变量优化,伴随耗时费力的实验测量。这类高维非凸优化常如大海捞针,易陷入局部最优。将优化器与人类领域知识结合可引导搜索至潜在高产区域,但易受确认偏误影响,且专家难以追踪快速扩展的文献。本文提出一种混合优化框架,利用大语言模型(LLM)以智能、经济的方式融合随机推理与基于领域知识的洞察,指导贝叶斯优化(BO)探索更优区域。方法通过实时评论优化进展,解释策略依据,增强用户参与度。我们在最多含15个独立变量的合成基准上验证了有效性,并在4项真实实验任务中证明,上下文感知建议可显著提升优化表现。
原文摘要 · Abstract (English)
Many important scientific problems involve multivariate optimization coupled with slow and laborious experimental measurements. These complex, high-dimensional searches can be defined by non-convex optimization landscapes that resemble needle-in-a-haystack surfaces, leading to entrapment in local minima. Contextualizing optimizers with human domain knowledge is a powerful approach to guide searches to localized fruitful regions. However, this approach is susceptible to human confirmation bias and it is also challenging for domain experts to keep track of the rapidly expanding scientific literature. Here, we propose the use of Large Language Models (LLMs) for contextualizing Bayesian optimization (BO) via a hybrid optimization framework that intelligently and economically blends stochastic inference with domain knowledge-based insights from the LLM, which is used to suggest new, better-performing areas of the search space for exploration. Our method fosters user engagement by offering real-time commentary on the optimization progress, explaining the reasoning behind the search strategies. We validate the effectiveness of our approach on synthetic benchmarks with up to 15 independent variables and demonstrate the ability of LLMs to reason in four real-world experimental tasks where context-aware suggestions boost optimization performance substantially.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。