arXiv:2507.16424cs.CLcs.LG2025-07被引 5

通过动态提示优化少样本主动学习的决策边界,提升选样质量。

PromptAL: Sample-Aware Dynamic Soft Prompts for Few-Shot Active Learning

  • 用未标注数据构建动态软提示,增强分布对齐
  • 在6个域内和3个域外数据集上超越9个基线方法
  • 适合少样本场景下需要高效选样的研究者

主动学习(AL)通过选择最具信息量的样本进行标注,以优化模型训练并降低标注成本。传统AL方法依赖已标注数据的经验分布来定义决策边界,并进行不确定性或多样性估计,从而识别高质量样本。但在少样本情况下,经验分布与目标分布差异显著,导致决策边界偏离最优位置。现有方法忽视了未标注样本在提升经验分布与目标分布对齐中的作用,造成决策边界次优,所选样本无法充分代表目标分布。为此,我们提出混合主动学习框架PromptAL(Sample-Aware Dynamic Soft Prompts for Few-Shot Active Learning),通过量化每个未标注样本对分布对齐的贡献,优化决策边界。具体而言,PromptAL首先利用未标注数据构建样本感知的动态软提示,调整模型预测分布与决策边界;随后基于调整后的边界,结合全局与局部多样性进行不确定性估计,选择更准确反映目标分布的高质量样本。在六个域内和三个域外数据集上的实验表明,PromptAL显著优于九个基线方法。代码已公开。

原文摘要 · Abstract (English)

Active learning (AL) aims to optimize model training and reduce annotation costs by selecting the most informative samples for labeling. Typically, AL methods rely on the empirical distribution of labeled data to define the decision boundary and perform uncertainty or diversity estimation, subsequently identifying potential high-quality samples. In few-shot scenarios, the empirical distribution often diverges significantly from the target distribution, causing the decision boundary to shift away from its optimal position. However, existing methods overlook the role of unlabeled samples in enhancing the empirical distribution to better align with the target distribution, resulting in a suboptimal decision boundary and the selection of samples that inadequately represent the target distribution. To address this, we propose a hybrid AL framework, termed \textbf{PromptAL} (Sample-Aware Dynamic Soft \textbf{Prompts} for Few-Shot \textbf{A}ctive \textbf{L}earning). This framework accounts for the contribution of each unlabeled data point in aligning the current empirical distribution with the target distribution, thereby optimizing the decision boundary. Specifically, PromptAL first leverages unlabeled data to construct sample-aware dynamic soft prompts that adjust the model's predictive distribution and decision boundary. Subsequently, based on the adjusted decision boundary, it integrates uncertainty estimation with both global and local diversity to select high-quality samples that more accurately represent the target distribution. Experimental results on six in-domain and three out-of-domain datasets show that PromptAL achieves superior performance over nine baselines. Our codebase is openly accessible.

主动学习少样本动态提示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。