arXiv:2602.06264cs.LG2026-02被引 3

提出更简单高效的算法,实现线性交换遗憾的最优界。

Swap Regret Minimization Through Response-Based Approachability

  • 基于响应式可接近性框架,设计新算法。
  • 在预处理凸集上实现O(d√T)的遗憾边界。
  • 适用于博弈均衡与在线学习,理论与实践兼顾。

我们研究在线优化中不同形式交换遗憾的最小化问题,这类遗憾与博弈中的相关均衡密切相关,并能保证对策略性对手的不可操纵性。此前针对ℝᵈ中一般凸集的线性交换遗憾最小化,仅有Daskalakis等(STOC '25)提出的高效算法,但其遗憾界为Ω(d⁴√T),且每轮需调用计算量大的椭球法。本文提出一种更简洁、计算高效的算法,在通过John椭球预处理的凸集上,实现O(d√T)的线性交换遗憾。该算法利用了Bernstein和Shimkin(JMLR '15)提出的响应式可接近性框架——此前在交换遗憾研究中被忽视——并同时最小化轮廓交换遗憾,后者已被证明可保证不可操纵性。此外,我们建立了匹配的信息论下界:当T足够大时,任何学习者期望线性交换遗憾至少为Ω(d√T),即使集合中心对称。这表明经典的Gordon、Greenwald和Marks(ICML '08)算法在最小化线性交换遗憾上是存在意义的最优,尽管计算效率不高。最后,我们将方法扩展至多项式维度的交换偏离集,统一并强化了近期关于均衡计算与在线学习的结果。

原文摘要 · Abstract (English)

We consider the problem of minimizing different notions of swap regret in online optimization. These forms of regret are tightly connected to correlated equilibrium concepts in games, and have been more recently shown to guarantee non-manipulability against strategic adversaries. The only computationally efficient algorithm for minimizing linear swap regret over a general convex set in $\mathbb{R}^d$ was developed recently by Daskalakis, Farina, Fishelson, Pipis, and Schneider (STOC '25). However, it incurs a highly suboptimal regret bound of $Ω(d^4 \sqrt{T})$ and also relies on computationally intensive calls to the ellipsoid algorithm at each iteration. In this paper, we develop a significantly simpler, computationally efficient algorithm that guarantees $O(d \sqrt{T})$ linear swap regret for a general convex set that has been preconditioned via the John ellipsoid. Our algorithm leverages the powerful response-based approachability framework of Bernstein and Shimkin (JMLR~'15) -- previously overlooked in the line of work on swap regret minimization -- and simultaneously minimizes profile swap regret, which was recently shown to guarantee non-manipulability. Moreover, we establish a matching information-theoretic lower bound: any learner must incur in expectation $Ω(d \sqrt{T})$ linear swap regret for large enough $T$, even when the set is centrally symmetric. This also shows that the classic algorithm of Gordon, Greenwald, and Marks (ICML '08) is existentially optimal for minimizing linear swap regret, although it is computationally inefficient. Finally, we extend our approach to minimize regret with respect to the set of swap deviations with polynomial dimension, unifying and strengthening recent results in equilibrium computation and online learning.

在线学习交换遗憾博弈论算法优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。