用粒子协同优化解决昂贵多目标优化中的伪局部最优问题。
Improving Pareto Set Learning for Expensive Multi-objective Optimization via Stein Variational Hypernetworks
- 引入核函数驱动粒子交互,平滑解空间避免碎片化
- 在多个基准上显著提升帕累托集学习质量
- 适合需要高效探索的高成本真实场景优化
昂贵多目标优化(EMOPs)在现实场景中常见,其目标函数评估代价高昂,涉及大量计算或物理实验。现有帕累托集学习方法常依赖高斯过程等代理模型近似目标函数,但此类模型易出现碎片化,导致已探索解之间存在大量小的不确定区域。当使用下置信界(LCB)等采集函数时,这些不确定区域可能形成伪局部最优,阻碍全局最优解的搜索。为此,本文提出一种新方法SVH-PSL,将斯坦因变分梯度下降(SVGD)与超网络(Hypernetworks)结合,通过粒子间核函数交互,集体移动粒子以平滑解空间。该机制维持多样性,促进对未探索区域的探索,防止粒子聚集于伪局部最优,推动收敛至全局最优解。本方法旨在建立折衷参考向量与其对应真实帕累托解之间的稳健关系,克服现有方法局限。在合成与真实世界多目标优化基准上的大量实验表明,SVH-PSL显著提升了所学帕累托集的质量,为昂贵多目标优化提供了有前景的解决方案。
原文摘要 · Abstract (English)
Expensive multi-objective optimization problems (EMOPs) are common in real-world scenarios where evaluating objective functions is costly and involves extensive computations or physical experiments. Current Pareto set learning methods for such problems often rely on surrogate models like Gaussian processes to approximate the objective functions. These surrogate models can become fragmented, resulting in numerous small uncertain regions between explored solutions. When using acquisition functions such as the Lower Confidence Bound (LCB), these uncertain regions can turn into pseudo-local optima, complicating the search for globally optimal solutions. To address these challenges, we propose a novel approach called SVH-PSL, which integrates Stein Variational Gradient Descent (SVGD) with Hypernetworks for efficient Pareto set learning. Our method addresses the issues of fragmented surrogate models and pseudo-local optima by collectively moving particles in a manner that smooths out the solution space. The particles interact with each other through a kernel function, which helps maintain diversity and encourages the exploration of underexplored regions. This kernel-based interaction prevents particles from clustering around pseudo-local optima and promotes convergence towards globally optimal solutions. Our approach aims to establish robust relationships between trade-off reference vectors and their corresponding true Pareto solutions, overcoming the limitations of existing methods. Through extensive experiments across both synthetic and real-world MOO benchmarks, we demonstrate that SVH-PSL significantly improves the quality of the learned Pareto set, offering a promising solution for expensive multi-objective optimization problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。