用强化学习自动优化图像分类的标注选择,减少人工标注成本。
Image Classification with Deep Reinforcement Active Learning
- 基于马尔可夫决策过程,用深度强化学习动态调整选样策略。
- 在三个图像分类数据集上表现优于现有主动学习方法。
- 适合标注数据稀缺、需降低人工标注负担的场景。
深度学习在图像分类等任务中表现出色,但依赖大量标注数据。现实中标注成本高,主动学习通过迭代筛选少量待标注样本以降低工作量。现有方法依赖固定规则,在不同环境下表现不稳定。本文提出基于马尔可夫决策过程的自适应主动学习框架,结合深度确定性策略梯度(DDPG)算法,使模型能根据专家反馈和学习环境动态调整样本选择策略。在三个图像分类基准上的实验表明,该方法显著优于多种现有主动学习策略。
原文摘要 · Abstract (English)
Deep learning is currently reaching outstanding performances on different tasks, including image classification, especially when using large neural networks. The success of these models is tributary to the availability of large collections of labeled training data. In many real-world scenarios, labeled data are scarce, and their hand-labeling is time, effort and cost demanding. Active learning is an alternative paradigm that mitigates the effort in hand-labeling data, where only a small fraction is iteratively selected from a large pool of unlabeled data, and annotated by an expert (a.k.a oracle), and eventually used to update the learning models. However, existing active learning solutions are dependent on handcrafted strategies that may fail in highly variable learning environments (datasets, scenarios, etc). In this work, we devise an adaptive active learning method based on Markov Decision Process (MDP). Our framework leverages deep reinforcement learning and active learning together with a Deep Deterministic Policy Gradient (DDPG) in order to dynamically adapt sample selection strategies to the oracle's feedback and the learning environment. Extensive experiments conducted on three different image classification benchmarks show superior performances against several existing active learning strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。