arXiv:2510.05241cs.LGmath.OC2025-10被引 2

将学习与优化统一建模,解决参数未知时的协同求解问题。

Simultaneous Learning and Optimization via Misspecified Saddle Point Problems

  • 提出双算法融合学习与优化,显式建模参数动态变化。
  • 收敛率达 $\mathcal{O}(\log K / K)$,自适应步长提升性能。
  • 适用于参数不唯一的情况,适合金融、控制等实际场景。

我们研究一类参数未知的误设鞍点问题,其中优化目标依赖于需从数据中同时学习的未知参数。不同于以往假设参数已知或预估计的做法,本框架将学习与优化统一建模,支持更灵活的问题形式。针对该设定,我们基于Hamedani & Aybat (2021)的加速原始对偶(APD)方法提出两种算法:首先分析直接将动态参数估计代入更新的朴素扩展;随后设计一种学习感知型APD变体,通过调整动量项显式考虑参数演化。两者均实现$\mathcal{O}(\log K / K)$的可证明收敛率,学习感知方法具有更紧的$\mathcal{O}(1)$常数,并可通过回溯策略实现自适应步长。进一步地,我们将框架拓展至学习问题存在多个最优解的情形,所提结构化算法在该设定下达到$\mathcal{O}(1/\sqrt{K})$的收敛率。实验评估表明,在误设投资组合优化任务中,本方法相比现有最优算法表现更优。

原文摘要 · Abstract (English)

We study a class of misspecified saddle point (SP) problems, where the optimization objective depends on an unknown parameter that must be learned concurrently from data. Unlike existing studies that assume parameters are fully known or pre-estimated, our framework integrates optimization and learning into a unified formulation, enabling a more flexible problem class. To address this setting, we propose two algorithms based on the accelerated primal-dual (APD) by Hamedani & Aybat 2021. In particular, we first analyze the naive extension of the APD method by directly substituting the evolving parameter estimates into the primal-dual updates; then, we design a new learning-aware variant of the APD method that explicitly accounts for parameter dynamics by adjusting the momentum updates. Both methods achieve a provable convergence rate of $\mathcal{O}(\log K / K)$, while the learning-aware approach attains a tighter $\mathcal{O}(1)$ constant and further benefits from an adaptive step-size selection enabled by a backtracking strategy. Furthermore, we extend the framework to problems where the learning problem admits multiple optimal solutions, showing that our modified algorithm for a structured setting achieves an $\mathcal{O}(1/\sqrt{K})$ rate. To demonstrate practical impact, we evaluate our methods on a misspecified portfolio optimization problem and show superior empirical performance compared to state-of-the-art algorithms.

优化学习鞍点问题自适应算法金融应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。