用扩散模型学习求解器迭代过程,高效生成高质量且多样的优化初始点。
GLENS: Global Search via Learning from Solver Iterates with Diffusion Models

- 利用求解器中间迭代数据作为免费增强,训练扩散模型捕捉局部几何结构。
- 在多个测试问题上生成的初始点使求解器收敛速度显著提升,覆盖多样局部最优。
- 适合需要快速找到多种可行解的机器人导航、工程优化等场景。
针对多模态非凸连续优化中生成大量高质量初始猜测的问题,目标是让这些猜测能快速收敛并覆盖多个不同局部极小值。现有数据驱动方法仅使用求解器最终收敛解,忽略了解附近的信息,限制了训练数据量。本文提出GLENS(通过学习求解器迭代实现全局搜索),利用中间迭代过程作为免费数据增强。该方法包含两部分:1)基于扩散模型学习以问题参数为条件的最优解邻域结构;2)学习优化方向,在扩散采样中引导样本逼近邻近最优解。在修改后的非凸基准问题和双机器人避障导航任务上的实验表明,GLENS能生成高质量且保持多模态分布的初始猜测,显著加快不同问题设置与求解器下的收敛速度。同时分析了关键超参数对性能的影响。
原文摘要 · Abstract (English)
We consider the problem of generating a large collection of initial guesses for local minima of multimodal non-convex continuous optimization problems. The goal is for these initial guesses to be high-quality (i.e., a numerical solver converges quickly) and diverse (i.e., represent many different local minima). Identifying multiple locally optimal solutions enables flexible downstream decision-making, but typically requires expensive global search. Existing data-driven methods predict initial guesses using only the final converged optima from offline solver runs, which discards information about the local neighborhoods of solutions and limits the available training data. We propose GLENS (Global Search via Learning from Solver Iterates), a data-efficient global search method that leverages intermediate solver iterates as free data augmentation. GLENS consists of two components: a neighborhood structure model that uses diffusion models to learn the local geometry around optima conditioned on problem parameters, and a solver behavior model that learns refinement directions to further guide samples towards nearby optima during diffusion sampling. Experiments on modified non-convex benchmark problems and a two-robot obstacle-avoidance navigation problem show that GLENS generates high-quality initial guesses while preserving the multimodal distribution of diverse local optima. The resulting initial guesses lead to faster solver convergence across different problem settings and solvers. We also analyze how key hyperparameter choices affect the performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。