研究高维材料优化中噪声对贝叶斯优化的影响,揭示不同问题结构下的性能差异。
Multi-Variable Batch Bayesian Optimization in Materials Research: Synthetic Data Analysis of Noise Sensitivity and Problem Landscape Effects
- 用合成数据模拟六变量批量贝叶斯优化,控制噪声水平测试多种策略
- 针尖藏草堆问题受噪声严重影响,而平滑问题更易陷入局部最优
- 强调先验知识和噪声估计对实验设计的重要性,适合材料优化研究者
贝叶斯优化(BO)在材料科学实验优化中日益重要。为模拟实际材料研究中的高维变量与含噪结果,我们对六个设计变量进行批量BO仿真,设置多种噪声水平。考察两类典型材料科学问题:针尖藏草堆场景(Ackley函数),可能出现在分子优化中;以及具有全局与局部最优的平滑景观(Hartmann函数),常见于材料成分优化。通过学习曲线、性能指标与可视化分析,评估噪声、批量选取方法、采集函数选择及探索超参数对优化结果的影响。发现噪声对针尖藏草堆问题影响显著,而随着噪声增加,Hartmann问题陷入局部最优的概率上升。因此,设计材料研究中的BO时,需掌握问题结构与噪声水平。合成数据研究可提供已知真实值与可控噪声,用于独立评估采集策略、目标指标与超参数,为真实实验系统过渡提供支持。本研究结果与方法有助于推动高维优化场景下贝叶斯优化在材料实验中的应用。
原文摘要 · Abstract (English)
Bayesian Optimization (BO) machine learning method is increasingly used to guide experimental optimization tasks in materials science. To emulate the large number of input variables and noise-containing results in experimental materials research, we perform batch BO simulation of six design variables with a range of noise levels. Two test cases relevant for materials science problems are examined: a needle-in-a-haystack case (Ackley function) that may be encountered in, e.g., molecule optimizations, and a smooth landscape with a local optimum in addition to the global optimum (Hartmann function) that may be encountered in, e.g., material composition optimization. We show learning curves, performance metrics, and visualization to effectively track the optimization progression and evaluate how the optimization outcomes are affected by noise, batch-picking method, choice of acquisition function, and exploration hyperparameter values. We find that the effects of noise depend on the problem landscape: noise degrades the optimization results of a needle-in-a-haystack search (Ackley) dramatically more. However, with increasing noise, we observe an increasing probability of landing on the local optimum in Hartmann. Therefore, prior knowledge of the problem domain structure and noise level is essential when designing BO for materials research experiments. Synthetic data studies -- with known ground truth and controlled noise levels -- enable us to isolate and evaluate the impact of different batch BO components, {\it e.g.}, acquisition policy, objective metrics, and hyperparameter values, before transitioning to the inherent uncertainties of real experimental systems. The results and methodology of this study will facilitate a greater utilization of BO in guiding experimental materials research, specifically in settings with a large number of design variables to optimize.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。