揭示连续博弈中均衡的稳健性机制及其动态演化关系
Robust equilibria in continuous games: From strategic to dynamic robustness
- 提出策略稳健性概念,刻画支付结构微小扰动下的不变均衡
- 证明策略稳健性蕴含动态稳健性,二者存在严格对应关系
- 发现熵正则化学习在仿射约束下收敛速度为几何级数
本文研究连续博弈中纳什均衡在策略与动态不确定性下的稳健性。首先引入稳健均衡概念:即对支付结构任意微小扰动保持不变的均衡,并给出其清晰的几何刻画。随后考察动态稳健性,分析随机与不确定性环境下“跟随正则化领导者”(FTRL)动力系统的稳定极限点。尽管起源不同,但两类稳健性具有结构性对应:策略稳健性蕴含动态稳健性,且若要维持动态稳健性,策略稳健性不可放松。最后,研究了基于正则化的收敛速率,发现熵正则化学习在仿射约束动作空间的博弈中收敛速率为几何级数。
原文摘要 · Abstract (English)
In this paper, we examine the robustness of Nash equilibria in continuous games, under both strategic and dynamic uncertainty. Starting with the former, we introduce the notion of a robust equilibrium as those equilibria that remain invariant to small -- but otherwise arbitrary -- perturbations to the game's payoff structure, and we provide a crisp geometric characterization thereof. Subsequently, we turn to the question of dynamic robustness, and we examine which equilibria may arise as stable limit points of the dynamics of "follow the regularized leader" (FTRL) in the presence of randomness and uncertainty. Despite their very distinct origins, we establish a structural correspondence between these two notions of robustness: strategic robustness implies dynamic robustness, and, conversely, the requirement of strategic robustness cannot be relaxed if dynamic robustness is to be maintained. Finally, we examine the rate of convergence to robust equilibria as a function of the underlying regularizer, and we show that entropically regularized learning converges at a geometric rate in games with affinely constrained action spaces.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。