arXiv:2605.09209math.OCcs.AI2026-05被引 1

解决下层解集为流形的双层优化问题,提出可微性条件与高效求解方法。

Select-then-differentiate: Solving Bilevel Optimization with Manifold Lower-level Solution Sets

论文配图:Select-then-differentiate: Solving Bilevel Optimization with Manifold Lower-level Solution Sets
图 1 · 摘自论文原文
  • 通过显式选择最优下层解并计算伪逆梯度,扩展经典单解结果。
  • 证明在局部非退化条件下,上层目标函数具有局部光滑性。
  • 适用于大规模模型权重重分配等实际任务,性能优于现有方法。

研究当下层问题存在非孤立解流形时的乐观双层优化问题。由于上层目标需在多个下层解中选择,超目标函数可能不可微。在局部Polyak--Łojasiewicz(PŁ)条件下,我们证明可微性不依赖于下层解集为单点:仅需乐观选择的唯一性即可。由此导出一个基于伪逆的显式超梯度公式,推广了经典单解情形的结果。进一步刻画了超目标函数的正则性:所选最小值沿解流形非退化时具局部光滑性;而选择不唯一或非退化失败,则会导致多处不可微点或破坏所有正Hölder正则性。受此理论启发,提出HG-MS方法——结合显式乐观选择与高效的伪逆超梯度计算。尽管乐观选择在解流形上为非凸,但证明其收敛至乐观目标的驻点,复杂度由解流形的内在维数决定,而非其嵌入维数。实验上,测试了HG-MS在匹配预算的LLM源权重重分配中的实用变体,在GSM8K/MATH上表现最佳,且在MT-Bench指令遵循任务中达到竞争性或最优结果。

原文摘要 · Abstract (English)

We study optimistic bilevel optimization when the lower-level problem has a non-isolated manifold of minimizers. In this setting, the hyper-objective may be non-differentiable because the upper-level criterion must choose among multiple lower-level solutions. Under a local Polyak--Łojasiewicz (PŁ) condition, we show that differentiability does not require the lower-level solution set to be a singleton: uniqueness of the optimistic selection is sufficient. This yields an explicit pseudoinverse-based hyper-gradient formula extending the classical singleton-minimizer result. We further characterize the regularity of the hyper-objective: non-degeneracy of the selected minimizer along the solution manifold yields local smoothness, while failure of uniqueness can create many non-differentiable points and failure of non-degeneracy can destroy all positive Hölder regularity of the hyper-gradient. Motivated by this theory, we propose HG-MS, a select-then-differentiate method combining explicit optimistic selection with efficient pseudoinverse-based hyper-gradient computation. Despite the nonconvex nature of optimistic selection over the lower-level solution manifold, we show that HG-MS converges to a stationary point of the optimistic objective with complexity governed by the intrinsic dimension of the solution manifold rather than its ambient dimension. Empirically, we test a practical variant of HG-MS for matched-budget LLM source reweighting. This variant preserves the select-then-differentiate principle and obtains the best GSM8K/MATH scores across the tested backbones, along with competitive or best MT-Bench instruction-following results.

双层优化超梯度流形LLM优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。