提出新维度刻画带反馈多分类学习的样本复杂度
PAC Learning with Bandit Feedback: Sharp Sample Complexity in the Realizable Setting
- 引入带反馈DS维度,通过伪盒结构建模学习难度
- 样本复杂度与总邻居数成正比,精度达对数因子最优
- 设计ListCascade算法,将带反馈学习转化为列表学习
研究在可实现设定下,带反馈的多分类PAC学习问题。学习者不观察独立同分布训练样本的真实标签,每轮仅接收未标记实例,预测标签后获得仅表示预测是否正确的带反馈信号。目标仍为经典PAC学习目标。本文给出该问题最优样本复杂度的通用刻画,对每个概念类均精确到对数因子。该刻画基于新提出的组合维度——带反馈DS维度,其通过称为伪盒的广义组合结构定义,扩展了原DS维度中的伪立方,允许各坐标拥有不同数量的邻点。不同于在全信息设定中通过伪立方的坐标数计数的DS维度,带反馈DS维度聚合各坐标的邻点总数,使得样本复杂度随总邻点数增长。同时提出一种达到上界的通用学习算法,基于名为ListCascade的算法原则,将带反馈学习与列表学习相连接,可能具有独立研究价值。
原文摘要 · Abstract (English)
We study the problem of multiclass PAC learning with bandit feedback in the realizable setting. In this framework, there is an unknown data distribution over an instance space $\mathcal{X}$ and a label space $\mathcal{Y}$, as in classical multiclass PAC learning, but the learner does not observe the labels of the i.i.d. training examples. Instead, in each round, it receives an unlabeled instance, predicts its label, and receives bandit feedback indicating only whether the prediction is correct. Despite this restriction, the goal remains the same as in classical PAC learning. We provide a general characterization of the optimal sample complexity of this problem, sharp for every concept class up to logarithmic factors. Our characterization is based on a new combinatorial dimension, termed the bandit $\mathrm{DS}$ dimension, defined via generalized combinatorial structures we call pseudo-boxes. These extend the pseudo-cubes underlying the $\mathrm{DS}$ dimension by allowing a different number of neighbors in each coordinate. In contrast to the $\mathrm{DS}$ dimension, which governs the full-information setting by counting the number of coordinates in the pseudo-cube, the bandit $\mathrm{DS}$ dimension aggregates the number of neighbors across coordinates, leading to a characterization in which the sample complexity scales with the total number of neighbors. We also propose a general learning algorithm achieving the upper bound, based on an algorithmic principle called ListCascade, which connects bandit learning to list learning and may be of independent interest.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。