在在线学习中通过精度与召回反馈优化集合预测,首次揭示其可学习性与VC维的等价关系。
Online Set Learning from Precision and Recall Feedback
- 基于随机抽取的精度/召回反馈设计自适应算法
- 证明了VC维有限是可学习的充要条件
- 适用于需平衡查准率与查全率的推荐系统场景
我们研究在在线设定下学习未知目标集合 $N_ ext{target}$ 的问题。每轮 $t$,学习者预测一个项目集合 ${N}_t$,并以相等概率收到两类反馈之一:精度反馈(随机披露 ${N}_t$ 中一项,告知是否属于 $N_ ext{target}$)或召回反馈(随机披露 $N_ ext{target}$ 中一项,告知是否在 ${N}_t$ 中)。若预测正确则获得奖励。目标是最大化累积奖励。该模型抽象了多种具有精度-召回反馈的学习场景。我们证明:一个假设类在此设置下可学习当且仅当其具有有限的Vapnik-Chervonenkis(VC)维度,与经典PAC学习的刻画一致。然而,算法结构远为复杂:标准的最小经验风险(ERM)原则在此失效,甚至所有正规学习规则也可能无效。我们设计了新算法处理反馈依赖性,在可实现与广义设定下均获得后悔界。结果提供了该模型可学习性的定性刻画,回答了最基础问题,并指向一系列自然且引人深思的开放问题,如最优后悔率的确定。
原文摘要 · Abstract (English)
We consider the problem of learning an unknown subset $N_\text{target}$ of a domain in an online setting. In each round $t$, the learner predicts a set of items ${N}_t$ and receives one of two types of feedback, each with equal probability: precision feedback, in which a randomly chosen item from the predicted set $N_t$ is revealed and the learner is told whether it belongs to $N_\text{target}$ (incurring a reward if it does), or recall feedback, in which a randomly chosen item from the target set $N_\text{target}$ is revealed and the learner is told whether it belongs to $N_t$ (incurring a reward if it does). The goal is to maximize the cumulative reward over time. This simple online set learning problem abstracts a variety of learning scenarios with precision- and recall-type feedback. We show that a hypothesis class (a family of subsets of the domain) is learnable in this setting if and only if it has finite Vapnik-Chervonenkis (VC) dimension, mirroring the classical PAC characterization. However, the resulting algorithmic structure is markedly more intricate: in contrast to standard Probably Approximately Correct (PAC) learning -- where the algorithmic landscape is governed by the simple principle of Empirical Risk Minimization (ERM) -- our partial feedback model can invalidate ERM and even all proper learning rules. We develop algorithms to address the dependencies induced by the feedback, obtaining regret guarantees in both the realizable and agnostic settings. Our results provide a qualitative characterization of learnability in this model, addressing its most basic question, while pointing to a range of natural and intriguing open questions, including the determination of optimal regret rates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。