用强化学习选数据,让标注更高效且均衡。
Labeled TrustSet Guided: Batch Active Learning with Reinforcement Learning

- 基于标签数据构建信任集,优化模型性能
- 在10个图像分类任务中达到最先进效果
- 适合需要减少标注成本的深度学习场景
批量主动学习(BAL)是降低标注成本、提升大规模深度学习模型数据效率的关键技术。传统方法多依赖马氏距离等度量来平衡不确定性与多样性,但仅关注未标记数据分布,忽视标签数据反馈与模型表现。为此,我们提出信任集(TrustSet),从已标记数据中选择最具信息量的样本,确保类别分布均衡,缓解长尾问题。不同于关注整体数据分布的CoreSet,TrustSet通过剔除冗余数据并利用标签信息优化选择过程。为进一步将信任集优势扩展至未标记池,我们设计基于强化学习(RL)的采样策略,近似从未标记数据中挑选高质量信任集候选。结合信任集与强化学习,提出批处理强化主动学习框架(BRAL-T)。该框架在10个图像分类基准和2项主动微调任务中均达到当前最优表现,证明了其在多个领域的有效性与高效性。
原文摘要 · Abstract (English)
Batch active learning (BAL) is a crucial technique for reducing labeling costs and improving data efficiency in training large-scale deep learning models. Traditional BAL methods often rely on metrics like Mahalanobis Distance to balance uncertainty and diversity when selecting data for annotation. However, these methods predominantly focus on the distribution of unlabeled data and fail to leverage feedback from labeled data or the model's performance. To address these limitations, we introduce TrustSet, a novel approach that selects the most informative data from the labeled dataset, ensuring a balanced class distribution to mitigate the long-tail problem. Unlike CoreSet, which focuses on maintaining the overall data distribution, TrustSet optimizes the model's performance by pruning redundant data and using label information to refine the selection process. To extend the benefits of TrustSet to the unlabeled pool, we propose a reinforcement learning (RL)-based sampling policy that approximates the selection of high-quality TrustSet candidates from the unlabeled data. Combining TrustSet and RL, we introduce the Batch Reinforcement Active Learning with TrustSet (BRAL-T) framework. BRAL-T achieves state-of-the-art results across 10 image classification benchmarks and 2 active fine-tuning tasks, demonstrating its effectiveness and efficiency in various domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。