arXiv:2412.04882cs.LGstat.ML2024-12

提出非贪婪优化方法,让高效模型也能前瞻决策。

Nonmyopic Global Optimisation via Approximate Dynamic Programming

  • 用近似动态规划构建前瞻型查询策略
  • 在多个任务上比传统方法更快收敛
  • 适合高维、昂贵函数优化场景

针对无梯度信息的高成本黑箱函数全局优化问题,本文提出基于逆距离加权(IDW)和径向基函数(RBF)的非贪婪优化方法。传统方法多采用贝叶斯优化与高斯过程,但其在高维下计算开销大;虽有轻量替代方案,但均具贪婪性,仅关注即时收益而忽略长期影响。本文引入近似动态规划框架,包括滚动优化与多步情景优化,使确定性代理模型具备前瞻性决策能力。通过预测代理模型演化,联合优化未来多步查询点,在不依赖概率建模的前提下实现探索与利用的平衡。在合成函数、超参数调优、约束优化及数据驱动预测控制等任务上的实验表明,该方法显著优于经典贪婪策略,收敛更快且更稳健。

原文摘要 · Abstract (English)

Global optimisation to optimise expensive-to-evaluate black-box functions without gradient information. Bayesian optimisation, one of the most well-known techniques, typically employs Gaussian processes as surrogate models, leveraging their probabilistic nature to balance exploration and exploitation. However, these processes become computationally prohibitive in high-dimensional spaces. Recent alternatives, based on inverse distance weighting (IDW) and radial basis functions (RBFs), offer competitive, computationally lighter solutions. Despite their efficiency, both traditional global and Bayesian optimisation strategies suffer from the myopic nature of their acquisition functions, which focus on immediate improvement neglecting future implications of the sequential decision making process. Nonmyopic acquisition functions devised for the Bayesian setting have shown promise in improving long-term performance. Yet, their combination with deterministic surrogate models remains unexplored. In this work, we introduce novel nonmyopic acquisition strategies tailored to IDW and RBF based on approximate dynamic programming paradigms, including rollout and multi-step scenario-based optimisation schemes, to enable lookahead acquisition. These methods optimise a sequence of query points over a horizon by predicting the evolution of the surrogate model, inherently managing the exploration-exploitation trade-off via optimisation techniques. The proposed approach represents a significant advance in extending nonmyopic acquisition principles, previously confined to Bayesian optimisation, to deterministic models. Empirical results on synthetic and hyperparameter tuning benchmark problems, a constrained problem, as well as on a data-driven predictive control application, demonstrate that these nonmyopic methods outperform conventional myopic approaches, leading to faster and more robust convergence.

优化算法非贪婪高效建模动态规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。