ALVIN通过插值生成新样本,打破模型对数据偏见的依赖。
ALVIN: Active Learning Via INterpolation
- 在类内不同群体间做插值,生成代表中间区域的虚拟样本
- 在6个数据集上提升分布内与分布外的泛化性能
- 适合解决标注数据存在群体偏差的场景
主动学习旨在通过从无标签数据中选择最有价值的样本,减少标注成本。然而,现有方法常忽视同一类别中不同样本群体的存在及其比例差异,例如职业分类数据集中某些人口特征在特定类别中占比过高。这种忽略导致模型依赖捷径进行预测,即在高比例群体中出现的输入属性与标签间的虚假相关性。为解决此问题,我们提出主动学习通过插值(ALVIN),在低频与高频群体样本之间进行类内插值,生成位于表征空间中的锚点(anchor)。通过选择靠近这些锚点的样本进行标注,ALVIN引导模型关注能抵消捷径影响的表征区域。关键在于,由于模型对这些样本具有高置信度,典型主动学习方法会将其忽略。在涵盖情感分析、自然语言推理和句子改写检测的六个数据集上的实验表明,ALVIN在分布内与分布外泛化能力上均优于当前最先进的主动学习方法。
原文摘要 · Abstract (English)
Active Learning aims to minimize annotation effort by selecting the most useful instances from a pool of unlabeled data. However, typical active learning methods overlook the presence of distinct example groups within a class, whose prevalence may vary, e.g., in occupation classification datasets certain demographics are disproportionately represented in specific classes. This oversight causes models to rely on shortcuts for predictions, i.e., spurious correlations between input attributes and labels occurring in well-represented groups. To address this issue, we propose Active Learning Via INterpolation (ALVIN), which conducts intra-class interpolations between examples from under-represented and well-represented groups to create anchors, i.e., artificial points situated between the example groups in the representation space. By selecting instances close to the anchors for annotation, ALVIN identifies informative examples exposing the model to regions of the representation space that counteract the influence of shortcuts. Crucially, since the model considers these examples to be of high certainty, they are likely to be ignored by typical active learning methods. Experimental results on six datasets encompassing sentiment analysis, natural language inference, and paraphrase detection demonstrate that ALVIN outperforms state-of-the-art active learning methods in both in-distribution and out-of-distribution generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。