arXiv:2503.07506cs.LGcs.CV2025-03

用自监督框架提升主动学习的样本选择能力,减少标注成本。

ADROIT: A Self-Supervised Framework for Learning Robust Representations for Active Learning

  • 基于变分自编码器统一整合多种损失,学习任务感知表示
  • 通过代理分类器与状态判别器动态对抗,识别高信息量未标记样本
  • 适用于数据标注昂贵的场景,尤其适合资源受限的主动学习任务

主动学习旨在选择最优样本进行标注,以降低标注成本。本文提出一种面向主动学习的任务感知统一表示学习框架——ADROIT。该框架基于变分自编码器(VAE),整合重构、对抗、自监督、知识蒸馏和分类损失。其包含三个核心组件:统一表示生成器(VAE)、状态判别器和(代理)任务学习器/分类器。ADROIT利用已标注和未标注数据共同学习潜在表示,并通过代理分类器结合已标注数据实现任务感知。不同于以往方法,代理分类器在未标注数据上引入自监督损失,并通过知识蒸馏与目标任务学习器对齐。状态判别器用于区分已标注与未标注数据,从而指导高信息量样本的选择。VAE与状态判别器之间的动态对抗形成竞争机制:VAE试图欺骗判别器,而判别器则持续学习区分输入来源。在多个数据集上的广泛实验与消融分析验证了该模型的有效性。

原文摘要 · Abstract (English)

Active learning aims to select optimal samples for labeling, minimizing annotation costs. This paper introduces a unified representation learning framework tailored for active learning with task awareness. It integrates diverse sources, comprising reconstruction, adversarial, self-supervised, knowledge-distillation, and classification losses into a unified VAE-based ADROIT approach. The proposed approach comprises three key components - a unified representation generator (VAE), a state discriminator, and a (proxy) task-learner or classifier. ADROIT learns a latent code using both labeled and unlabeled data, incorporating task-awareness by leveraging labeled data with the proxy classifier. Unlike previous approaches, the proxy classifier additionally employs a self-supervised loss on unlabeled data and utilizes knowledge distillation to align with the target task-learner. The state discriminator distinguishes between labeled and unlabeled data, facilitating the selection of informative unlabeled samples. The dynamic interaction between VAE and the state discriminator creates a competitive environment, with the VAE attempting to deceive the discriminator, while the state discriminator learns to differentiate between labeled and unlabeled inputs. Extensive evaluations on diverse datasets and ablation analysis affirm the effectiveness of the proposed model.

主动学习自监督表示学习变分自编码器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。