arXiv:2504.02901cs.LGcs.AI2025-04ACL被引 35

用大模型辅助小模型,从噪声标签中自动筛出干净数据

Hide and Seek in Noise Labels: Noise-Robust Collaborative Active Learning with LLM-Powered Assistance

  • 双小模型协同预测,动态阈值划分噪声样本
  • 大模型只修正高置信度噪声样本,效率提升明显
  • 适合标注成本高、标签质量差的现实场景

在真实场景中,训练数据常包含错误或损坏的标签,如何从噪声标签中学习是重大挑战。现有方法多依赖主动学习识别噪声标签并请求人工校正,但效率受限于对干净与噪声样本的准确区分。本文提出基于主动学习的协作框架NoiseAL,融合大语言模型(LLMs)与小模型(SMs)实现噪声鲁棒学习。训练过程中,两个小模型构成协同预测网络,采用动态增强阈值策略将噪声数据划分为不同子集;随后从各子集中筛选出高置信度样本交由大模型进行标注修正;最后针对不同噪声程度的子集设计差异化优化目标以提升性能。在合成噪声和真实噪声数据集上的大量实验表明,该框架显著优于当前最优基线。

原文摘要 · Abstract (English)

Learning from noisy labels (LNL) is a challenge that arises in many real-world scenarios where collected training data can contain incorrect or corrupted labels. Most existing solutions identify noisy labels and adopt active learning to query human experts on them for denoising. In the era of large language models (LLMs), although we can reduce the human effort to improve these methods, their performances are still subject to accurately separating the clean and noisy samples from noisy data. In this paper, we propose an innovative collaborative learning framework NoiseAL based on active learning to combine LLMs and small models (SMs) for learning from noisy labels. During collaborative training, we first adopt two SMs to form a co-prediction network and propose a dynamic-enhanced threshold strategy to divide the noisy data into different subsets, then select the clean and noisy samples from these subsets to feed the active annotator LLMs to rectify noisy samples. Finally, we employ different optimization objectives to conquer subsets with different degrees of label noises. Extensive experiments on synthetic and real-world noise datasets further demonstrate the superiority of our framework over state-of-the-art baselines.

噪声标签主动学习大模型协同训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。