在只看到正例的情况下,如何准确学习标签预测。
Probably Approximately Precision and Recall Learning
- 用集合函数建模多标签预测,突破单标签限制。
- 在仅正例数据下实现最优样本效率,且可乘法逼近。
- 适合标签不全反馈场景,如社交图片打标、医疗诊断。
精确率和召回率是多标签学习、语言生成、医学研究和推荐系统等任务中的核心指标,要求模型既准确又全面。这类任务常面临单边反馈问题:训练时仅能观测到正例——例如在给脸书照片打标签时,只知被标记的人,而不知图像中还有谁。为应对这种部分反馈,我们引入了一个可能近似正确(PAC)的框架,其中假设为集值函数,将每个输入映射到一组标签,超越了单标签预测,泛化了经典二分类、多分类与多标签模型。结果揭示了与标准设定的显著统计与算法差异:经典方法如经验风险最小化在简单假设类下会失效。我们提出了新算法,仅依赖正例数据即可学习,在可实现情况下达到最优样本复杂度;在不可实现情况下,建立乘法而非加法误差的保证,因加法误差无法达成。
原文摘要 · Abstract (English)
Precision and Recall are fundamental metrics in machine learning tasks where both accurate predictions and comprehensive coverage are essential, such as in multi-label learning, language generation, medical studies, and recommender systems. A key challenge in these settings is the prevalence of one-sided feedback, where only positive examples are observed during training--e.g., in multi-label tasks like tagging people in Facebook photos, we may observe only a few tagged individuals, without knowing who else appears in the image. To address learning under such partial feedback, we introduce a Probably Approximately Correct (PAC) framework in which hypotheses are set functions that map each input to a set of labels, extending beyond single-label predictions and generalizing classical binary, multi-class, and multi-label models. Our results reveal sharp statistical and algorithmic separations from standard settings: classical methods such as Empirical Risk Minimization provably fail, even for simple hypothesis classes. We develop new algorithms that learn from positive data alone, achieving optimal sample complexity in the realizable case, and establishing multiplicative--rather than additive-approximation guarantees in the agnostic case, where achieving additive regret is impossible.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。