证明了对称双人2策略博弈中指数加权动态的最后迭代收敛性。
Last-iterate Convergence for Symmetric, General-sum, $2 \times 2$ Games Under The Exponential Weights Dynamic
- 基于指数加权动态,通过初等分析证明收敛性。
- 在特定条件下收敛速率为指数级,且对任意步长成立。
- 适用于银行间贷款竞争等现实对称博弈场景。
我们对常数步长下的离散时间指数加权动态在所有一般和对称的2×2正常形式博弈中进行了全面分析,即每名玩家有2个纯策略,收益向量为 (A, Aᵀ)(A为第一玩家的2×2收益矩阵)。此类对称博弈常见于具有相同效用函数的‘对称’代理之间的现实互动,如伯特兰德竞争和多智能体表现性预测,尽管结构简单却表现出丰富的均衡多样性。令人意外的是,我们通过基本分析表明,该指数加权动态在适当选择步长下,无论初始条件如何,均能在最后迭代中实现收敛。对于某些博弈或初始条件,进一步证明其收敛速度为指数级,且对任意步长成立。通过大量模拟和应用验证理论,特别是在多智能体表现性预测中,我们提出了银行与客户群体间的新型“抵押贷款竞争”博弈,并证实其符合本框架。
原文摘要 · Abstract (English)
We conduct a comprehensive analysis of the discrete-time exponential-weights dynamic with a constant step size on all general-sum and symmetric $2 \times 2$ normal-form games, i.e. games with $2$ pure strategies per player, and where the ensuing payoff tuple is of the form $(A,A^\top)$ (where $A$ is the $2 \times 2$ payoff matrix corresponding to the first player). Such symmetric games commonly arise in real-world interactions between 'symmetric" agents who have identically defined utility functions -- such as Bertrand competition and multi-agent performative prediction, and display a rich multiplicity of equilibria despite the seemingly simple setting. Somewhat surprisingly, we show through a first-principles analysis that the exponential weights dynamic, which is popular in online learning, converges in the last iterate for such games regardless of initialization with an appropriately chosen step size. For certain games and/or initializations, we further show that the convergence rate is in fact exponential and holds for any step size. We illustrate our theory with extensive simulations and applications to the aforementioned game-theoretic interactions. In the case of multi-agent performative prediction, we formulate a new "mortgage competition" game between lenders (i.e. banks) who interact with a population of customers, and show that it fits into our framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。