用聚类选关键样本,结合大模型生成高质量标签数据。
Clustering Algorithms and RAG Enhancing Semi-Supervised Text Classification with Large LLMs
- 通过聚类选取代表性样本,避免传统伪标签方法的误差累积。
- 在100+类别场景下,Reuters准确率达95.41%,Web of Science达82.43%。
- 适合标签稀缺、需高精度分类的工业级文本任务。
本文提出一种聚类-标注-增强框架,显著提升半监督文本分类性能,有效应对标签极少但数据量庞大的挑战。不同于依赖少量已标注数据生成伪标签的传统方法,该框架利用聚类筛选出具有代表性的“地标”样本进行人工标注,并以这些样本为中介,结合检索增强生成(RAG)、大语言模型重写与同义词替换等技术,生成合成标签数据,无需对未标注数据打伪标签。实验表明,在超过100个类别的复杂文档分类任务中,该方法在Reuters数据集上达到95.41%的准确率,在Web of Science数据集上达到82.43%。该方法大幅减少人工标注需求与成本,保障数据质量并降低隐私风险。微调结果也验证了大模型在文本分类任务中的高效性,提供了一种可扩展的少样本解决方案。
原文摘要 · Abstract (English)
This paper proposes a Clustering, Labeling, then Augmenting framework that significantly enhances performance in Semi-Supervised Text Classification (SSTC) tasks, effectively addressing the challenge of vast datasets with limited labeled examples. Unlike traditional SSTC approaches that rely on a predefined small set of labeled data to generate pseudo-labels for the unlabeled data, this framework innovatively employs clustering to select representative "landmarks" for labeling. These landmarks subsequently act as intermediaries in an ensemble of augmentation techniques, including Retrieval-Augmented Generation (RAG), Large Language Model (LLMs)-based rewriting, and synonym substitution, to generate synthetic labeled data without making pseudo-labels for the unlabeled data. Empirical results show that even in complex text document classification scenarios involving over 100 categories, our method achieves state-of-the-art accuracies of 95.41% on the Reuters dataset and 82.43% on the Web of Science dataset. Our approach significantly reduces the reliance on human labeling efforts and the associated expenses, while simultaneously ensuring high data quality and minimizing privacy risks. The finetuning results further show the efficiency of fine-tuning LLMs for text classification tasks, highlighting a robust solution for leveraging limited labeled data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。