用无标签数据迭代优化大模型伪标签,提升分类准确率。
Self Iterative Label Refinement via Robust Unlabeled Learning
- 通过双无标签数据集迭代去噪,修正大模型生成的伪标签。
- 在低资源语言、专利分类等任务上显著超越原始模型和现有自精炼方法。
- 适合需要低成本标注且关注模型安全对齐的研究者使用。
大语言模型(LLM)在各类任务中表现优异,但依赖高质量反馈导致成本高昂。自精炼方法虽能减少人工监督,却常因模型内在偏差与过度自信而性能下降,尤其在知识匮乏领域。为此,我们提出一种基于无标签-无标签学习框架的迭代精炼流程,利用两个正类比例不同的无标签数据集,逐步净化并优化初始伪标签,有效缓解内部偏差。在低资源语言语料、专利分类与蛋白质结构分类等多类数据集上的实验表明,该方法持续优于原始模型及前沿自精炼模型(如GPT-4o、DeepSeek-R1)。此外,实验验证了经优化的分类器可有效支持大模型的安全对齐后训练,并成功拓展至生成任务的自精炼场景。
原文摘要 · Abstract (English)
Recent advances in large language models (LLMs) have yielded impressive performance on various tasks, yet they often depend on high-quality feedback that can be costly. Self-refinement methods attempt to leverage LLMs' internal evaluation mechanisms with minimal human supervision; however, these approaches frequently suffer from inherent biases and overconfidence, especially in domains where the models lack sufficient internal knowledge, resulting in performance degradation. As an initial step toward enhancing self-refinement for broader applications, we introduce an iterative refinement pipeline that employs the Unlabeled-Unlabeled learning framework to improve LLM-generated pseudo-labels for classification tasks. By exploiting two unlabeled datasets with differing positive class ratios, our approach iteratively denoises and refines the initial pseudo-labels, thereby mitigating the adverse effects of internal biases with minimal human supervision. Evaluations on diverse datasets, including low-resource language corpora, patent classifications, and protein structure categorizations, demonstrate that our method consistently outperforms both initial LLM's classification performance and the self-refinement approaches by cutting-edge models (e.g., GPT-4o and DeepSeek-R1). Moreover, we experimentally confirm that our refined classifier facilitates effective post-training alignment for safety in LLMs and demonstrate successful self-refinement in generative tasks as well.\footnote{Our code is available at https://github.com/HikaruAsano/self-iterative-label-refinement.}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。