不依赖人工标注,自动选出最具代表性的数据,提升模型训练效率。
Unsupervised Active Learning via Natural Feature Progressive Framework
- 用特征学习机量化样本对模型的贡献度,替代传统梯度评分。
- 在多个视觉数据集上表现超越现有无监督主动学习方法,媲美有监督方案。
- 适合数据标注成本高、需高效筛选样本的场景,如医疗图像分析。
现代深度学习模型依赖大规模人工标注数据集,但标注过程耗时昂贵。主动学习(AL)通过仅标注最有信息量的数据来缓解此问题,但其迭代过程仍需大量人工参与。无监督主动学习(UAL)将标注负担简化为单次后处理步骤,但现有方法性能不佳:通常采用局部梯度评分估计样本重要性,易受模糊和噪声数据影响,且难以覆盖完整数据分布;同时使用浅层、一次性线性选择,无法真正实现无监督主动学习。本文提出自然特征渐进框架(NFPF),核心是使用特定特征学习机(SFLM)精准衡量每个样本对模型性能的贡献,并基于SFLM构建强大的重建差异度量进行初始样本选择。大量实验表明,NFPF显著优于所有现有UAL方法,在多个视觉数据集上达到与有监督主动学习相当的性能。消融研究与可视化结果充分验证了其优越性能、更强鲁棒性及更优的数据分布覆盖能力。
原文摘要 · Abstract (English)
The effectiveness of modern deep learning models is predicated on the availability of large-scale, human-annotated datasets, a process that is notoriously expensive and time-consuming. While Active Learning (AL) offers a strategic solution by labeling only the most informative and representative data, its iterative nature still necessitates significant human involvement. Unsupervised Active Learning (UAL) presents an alternative by shifting the annotation burden to a single, post-selection step. Unfortunately, prevailing UAL methods struggle to achieve state-of-the-art performance. These approaches typically rely on local, gradient-based scoring for sample importance estimation, which not only makes them vulnerable to ambiguous and noisy data but also hinders their capacity to select samples that adequately represent the full data distribution. Moreover, their use of shallow, one-shot linear selection falls short of a true UAL paradigm. In this paper, we propose the Natural Feature Progressive Framework (NFPF), a UAL method that revolutionizes how sample importance is measured. At its core, NFPF employs a Specific Feature Learning Machine (SFLM) to effectively quantify each sample's contribution to model performance. We further utilize the SFLM to define a powerful Reconstruction Difference metric for initial sample selection. Our comprehensive experiments show that NFPF significantly outperforms all established UAL methods and achieves performance on par with supervised AL methods on vision datasets. Detailed ablation studies and qualitative visualizations provide compelling evidence for NFPF's superior performance, enhanced robustness, and improved data distribution coverage.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。