用最优传输统一冷启动主动学习,自动调节采样策略。
One Knob to Rule Them All: A Unified Optimal Transport View of Cold-Start Active Learning

- 基于最优传输构建统一选择框架,整合典型性、覆盖度等方法
- 提出自适应正则化规则,在6个数据集上性能领先,图像分类提升1.29%
- 无需人工调参,适合缺乏先验知识的场景
冷启动主动学习(CSAL)旨在无任何先验知识或人工干预下,从大量未标注数据中选出高价值子集。现有方法基于典型性、覆盖度或多样性等不同思路,各自依赖特定归纳偏置,导致在某些任务表现好而在其他任务表现差。本文认为核心挑战不在于设计新选择启发式,而在于让CSAL能自动适应数据与任务。为此,我们从最优传输视角重新审视CSAL:首先提出广义传输选择框架,揭示现有方法共享的分配结构并精确包含代表性公式;其次建立理论分析,刻画熵正则化控制的权衡关系,并给出任务无关的极小极大边界;最后推导出数据自适应正则化规则,提出基于Sinkhorn的新型算法ε-自适应选择(ε-AS)。在六个公开数据集和多种标注预算下的实验表明,ε-AS持续达到最先进性能。在ImageNet-1k上,其平均准确率相比ActiveFT提升1.29%,同时选择时间减少56.2%。代码将开源。
原文摘要 · Abstract (English)
Cold-Start Active Learning (CSAL) aims to select a valuable subset from an unlabeled pool without any prior knowledge or human assistance. Existing methods take diverse routes based on typicality, coverage, or diversity. Each rests on its own inductive bias and therefore performs well on some tasks yet poorly on others. We argue that the real challenge is not to design yet another selection heuristic, but to make CSAL adapt automatically to the data and task at hand. To this end, we revisit CSAL through the lens of optimal transport. First, we propose a generalized transport selection framework that reveals the shared allocation structure of existing methods and exactly subsumes representative formulations. Second, we introduce a theoretical analysis that characterizes the trade-off controlled by entropic regularization and establishes a task-agnostic minimax bound for cold-start selection. These results provide a principled foundation for adapting the regularization strength to the unlabeled data. Third, we derive a data-adaptive regularization rule and present a novel Sinkhorn-based CSAL algorithm, termed $ε$-Adaptive Selection ($ε$-AS). Extensive experiments on six public datasets and multiple annotation budgets show that $ε$-AS consistently achieves state-of-the-art performance. On ImageNet-1k, it improves the average accuracy over ActiveFT by 1.29% while reducing selection time by 56.2%. Code will be released at https://github.com/Z-yiwei/OT-CSAL
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。