arXiv:2605.14689cs.CV2026-05中稿 · publication in Com…

不用预训练模型也能高效做主动学习,随机初始化就有效。

Are Candidate Models Really Needed for Active Learning?

论文配图:Are Candidate Models Really Needed for Active Learning?
图 1 · 摘自论文原文
  • 用随机初始化的CNN和Transformer替代初始候选模型。
  • 低置信度采样在多数实验中表现最佳,精度接近传统方法。
  • 无需额外训练候选模型,适合资源有限的研究者快速部署。

深度学习在计算机视觉和自然语言处理等领域取得了显著进展,但依赖大量标注数据带来了资源消耗和标注误差问题,尤其在参数量较大的CNN和Transformer模型上更为突出。主动学习通过有策略地选择最具信息量的样本进行标注,有望缓解标注负担。然而现有框架需依赖初始候选模型,且迭代采样耗时。本文研究了使用随机初始化权重的CNN与Transformer替代候选模型的可行性,在不依赖初始模型的情况下实现与传统方法相当的效果。评估了三种基于置信度的采样策略:高置信度(HC)、低置信度(LC)以及早期高置信度、后期低置信度的组合(HCLC)。实验表明,主要采用低置信度策略表现最优,证明其作为无需候选模型的主动学习策略的有效性。大量实验证实了所提方法的鲁棒性。该工作挑战了传统框架,提出一种更高效、灵活的主动学习方案,适用于多种数据集与领域。

原文摘要 · Abstract (English)

Deep learning has profoundly impacted domains such as computer vision and natural language processing by uncovering complex patterns in vast datasets. However, the reliance on extensive labeled data poses significant challenges, including resource constraints and annotation errors, particularly in training Convolutional Neural Networks (CNNs) and transformers due to a larger number of parameters. Active learning offers a promising solution to reduce labeling burdens by strategically selecting the most informative samples for annotation. However, the current active learning frameworks are time-intensive which select the samples iteratively with the help of initial candidate models. This study investigates the feasibility of using CNNs and transformers with randomly initialized weights, eliminating the need for initial candidate models while achieving results comparable to active learning frameworks that depend on such candidate models. We evaluate three confidence-based sampling strategies: high confidence (HC), low confidence (LC), and a combination of high confidence in the early stages of training and low confidence at later stages of training (HCLC). Among these, mostly LC demonstrated the best performance in our experiments, showcasing its effectiveness as an active learning strategy without the need for candidate models. Further, extensive experiments verify the robustness of the proposed active learning methods. By challenging traditional frameworks, the proposed work introduces a streamlined approach to active learning, advancing efficiency and flexibility across diverse datasets and domains.

主动学习随机初始化深度学习标注效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。