用少量样本+迭代对比提示,让大模型在动态分类中准确区分相似类别。
Small sample-based adaptive text classification through iterative and contrastive description refinement
- 通过迭代对比提示,逐步优化类别间的语义差异。
- 在AGNews和DBpedia上分别达到91%和84%准确率,新增未知类别后仍保持82%以上。
- 支持人工介入修改类别定义,适合持续演化的实际场景使用。
零样本文本分类在知识不断更新、类别边界模糊的领域(如工单系统)中仍具挑战性。大型语言模型因主题区分度低而难以泛化,少样本方法又受限于数据多样性不足。本文提出一种结合迭代主题优化、对比提示与主动学习的分类框架。从少量标注样本出发,模型生成初始类别标签;将误判或模糊样本用于迭代对比提示过程,显式训练模型区分相近类别。系统包含人机协作模块,允许用户以自然语言引入或修改类别定义,无需重新训练即可无缝接入新类别,适用于真实动态环境。在AGNews和DBpedia上的评估显示:在3个已知类、1个未见类条件下,AGNews准确率达91%;8个已知类、1个未见类时,DBpedia准确率为84%;引入未见类别后准确率仅轻微下降至82%和87%。结果表明,基于提示的语义推理在有限监督下对细粒度分类有效。
原文摘要 · Abstract (English)
Zero-shot text classification remains a difficult task in domains with evolving knowledge and ambiguous category boundaries, such as ticketing systems. Large language models (LLMs) often struggle to generalize in these scenarios due to limited topic separability, while few-shot methods are constrained by insufficient data diversity. We propose a classification framework that combines iterative topic refinement, contrastive prompting, and active learning. Starting with a small set of labeled samples, the model generates initial topic labels. Misclassified or ambiguous samples are then used in an iterative contrastive prompting process to refine category distinctions by explicitly teaching the model to differentiate between closely related classes. The framework features a human-in-the-loop component, allowing users to introduce or revise category definitions in natural language. This enables seamless integration of new, unseen categories without retraining, making the system well-suited for real-world, dynamic environments. The evaluations on AGNews and DBpedia demonstrate strong performance: 91% accuracy on AGNews (3 seen, 1 unseen class) and 84% on DBpedia (8 seen, 1 unseen), with minimal accuracy shift after introducing unseen classes (82% and 87%, respectively). The results highlight the effectiveness of prompt-based semantic reasoning for fine-grained classification with limited supervision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。