提出新复杂度度量,解决带上下文的序列概率分配最优策略问题。
Sequential Probability Assignment with Contexts: Minimax Regret, Contextual Shtarkov Sums, and Contextual Normalized Maximum Likelihood
- 引入上下文Shtarkov和作为新复杂度度量
- 证明其与最小最大后悔值相等
- 适用于多类别专家场景,理论更通用
我们研究了在任意可能非参数假设类下的序列概率分配问题,即在线学习中的对数损失。目标是获得一个能刻画最小最大后悔值的复杂度度量,并确定一个普遍的最小最大最优算法。值得注意的是,已有文献广泛研究的序列ℓ∞熵并不能在一般情况下刻画最小最大风险。受Shtarkov(1987)和Rakhlin、Sridharan、Tewari(2010)工作的启发,我们提出了一个新的复杂度度量——上下文Shtarkov和,对应于将原问题投影到多叉上下文树后的Shtarkov和,并证明最坏情况下的对数上下文Shtarkov和等于最小最大后悔值。基于此,我们推导出最小最大最优策略,称为上下文归一化最大似然(cNML)。我们的结果适用于序列专家模型,且不限于二元标签,这是先前工作很少考虑的情形。为展示该刻画的实用性,我们给出一个简洁证明,得到关于序列ℓ∞熵的新后悔上界,统一并强化了Bilodeau等人(2020)和Wu等人(2023)的最先进结果。
原文摘要 · Abstract (English)
We study the fundamental problem of sequential probability assignment, also known as online learning with logarithmic loss, with respect to an arbitrary, possibly nonparametric hypothesis class. Our goal is to obtain a complexity measure for the hypothesis class that characterizes the minimax regret and to determine a general, minimax optimal algorithm. Notably, the sequential $\ell_{\infty}$ entropy, extensively studied in the literature (Rakhlin and Sridharan, 2015, Bilodeau et al., 2020, Wu et al., 2023), was shown to not characterize minimax risk in general. Inspired by the seminal work of Shtarkov (1987) and Rakhlin, Sridharan, and Tewari (2010), we introduce a novel complexity measure, the \emph{contextual Shtarkov sum}, corresponding to the Shtarkov sum after projection onto a multiary context tree, and show that the worst case log contextual Shtarkov sum equals the minimax regret. Using the contextual Shtarkov sum, we derive the minimax optimal strategy, dubbed \emph{contextual Normalized Maximum Likelihood} (cNML). Our results hold for sequential experts, beyond binary labels, which are settings rarely considered in prior work. To illustrate the utility of this characterization, we provide a short proof of a new regret upper bound in terms of sequential $\ell_{\infty}$ entropy, unifying and sharpening state-of-the-art bounds by Bilodeau et al. (2020) and Wu et al. (2023).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。