arXiv:2511.05736cs.LG2025-11中稿 · NeurIPS

用主动学习估算均值,标签数少时效果远超传统方法。

Near-Exponential Savings for Mean Estimation with Active Learning

  • 分层采样+上置信界策略,动态选择最有信息量的样本
  • 误差平方收敛速度接近指数级,理论最优且实证有效
  • 适合医疗数据等标注成本高、有辅助变量的场景

我们研究在仅有限标签数N的情况下,利用协变量X辅助信息高效估计k类随机变量Y的均值问题。提出名为PartiBandits的主动学习算法,其估计误差平方为$ ilde{/mathcal{O}}ig( rac{ν + ext{exp}(c imes (-N/ ext{log}(N)))}{N} ig)$,其中c>0为常数,ν为贝叶斯最优分类器的风险。该算法分两阶段:第一阶段学习无标签数据的划分以降低条件方差;第二阶段使用类似UCB的WarmStart-UCB子程序逐轮请求各层标签。主算法与子程序在经典设置下均达到极小极大最优收敛率。尽管传统上上下置信界与分歧基方法用于不同任务,PartiBandits成功融合二者。通过全国电子健康记录模拟验证方法有效性,并提供R语言实现包PartiBandits。

原文摘要 · Abstract (English)

We study the problem of efficiently estimating the mean of a $k$-class random variable, $Y$, using a limited number of labels, $N$, in settings where the analyst has access to auxiliary information (i.e.: covariates) $X$ that may be informative about $Y$. We propose an active learning algorithm ("PartiBandits") to estimate $\mathbb{E}[Y]$. The algorithm yields an estimate, $\widehatμ_{\text{PB}}$, such that $\left( \widehatμ_{\text{PB}} - \mathbb{E}[Y]\right)^2$ is $\tilde{\mathcal{O}}\left( \frac{ν+ \exp(c \cdot (-N/\log(N))) }{N} \right)$, where $c > 0$ is a constant and $ν$ is the risk of the Bayes-optimal classifier. PartiBandits is essentially a two-stage algorithm. In the first stage, it learns a partition of the unlabeled data that shrinks the average conditional variance of $Y$. In the second stage it uses a UCB-style subroutine ("WarmStart-UCB") to request labels from each stratum round-by-round. Both the main algorithm's and the subroutine's convergence rates are minimax optimal in classical settings. PartiBandits bridges the UCB and disagreement-based approaches to active learning despite these two approaches being designed to tackle very different tasks. We illustrate our methods through simulation using nationwide electronic health records. Our methods can be implemented using the PartiBandits package in R.

主动学习均值估计医疗数据分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。