arXiv:2605.07413cs.LG2026-05

用子集查询标签,实现更可靠多分类学习

Risk-Consistent Multiclass Learning from Random Label-Subset Membership Queries

论文配图:Risk-Consistent Multiclass Learning from Random Label-Subset Membership Queries
图 1 · 摘自论文原文
  • 通过随机标签子集查询构建弱监督学习框架
  • 提出无偏风险估计器并解决负经验风险问题
  • 适合标签获取困难或隐私受限的场景

准确获取类别标签往往成本高或不可靠,且受隐私等实际条件限制。相比要求标注者提供确切类别,询问真实标签是否属于某个标签子集更为简便。这种问答形式构成一种独特的弱监督机制:弱监督信息由标签子集反馈生成。尽管弱监督学习已有多种学习框架,但多数现有工作基于已知的弱标签对象。对于直接由此类查询-响应观测生成的弱监督学习,系统性表征仍不充分。本文提出了基于随机标签子集查询的多分类学习框架。我们建模了查询-响应观测的数据生成分布,并在经验风险最小化(ERM)框架下推导出目标风险的无偏估计器。为应对负经验风险及其导致的过拟合问题,引入基于非负和绝对值修正的风险估计器。理论分析建立了无偏估计器的条件泛化与过失风险界,以及修正风险估计器的偏差与一致性结果。在匹配的随机查询机制下的实验表明,直接基于查询-响应学习是可行的,且风险修正具有稳定作用。

原文摘要 · Abstract (English)

Obtaining accurate class labels is often costly or unreliable, and may also be limited by privacy or other practical conditions. Compared with asking an annotator to provide the exact class, it is often easier to ask whether the true label belongs to a certain label subset. This query-response form defines a distinct weak-supervision mechanism: weak supervision information is generated through feedback on a label subset. Although weakly supervised learning has studied many learning frameworks, most existing work starts from established weak label objects. A systematic characterization is still lacking for weakly supervised learning generated directly by such query response observations. This paper proposes a multiclass learn ing framework under random label-subset queries. We model the data-generating distribution of query-response observations and derive an unbiased estimator of the target risk under the empirical risk minimization (ERM) framework. To address negative empirical risk and the associated overfitting problem, we introduce corrected risk estimators based on non-negative and absolute-value corrections. Theoretical analysis establishes a conditional generalization and excess-risk bound for the unbiased estimator, and a bias-and-consistency result for the corrected risk estimator. Experiments under the matched random-query mechanism demonstrate the feasibility of direct query-response learning and the stabilization effect of risk correction.

弱监督多分类标签查询

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。