arXiv:2512.05732cs.CLcs.AI2025-12被引 2

用轻量分类器+校准预测,让大模型更高效地做文本分类。

Efficient Text Classification with Conformal In-Context Learning

  • 用校准预测动态缩小候选类别集,指导大模型少看样本、少写提示。
  • 在足够数据下性能超少样本提示,低数据下表现相当,最多省34.45%样本。
  • 适合类别不均衡任务,可搭配小模型用,节省计算资源。

大型语言模型(LLMs)虽具强大上下文学习能力,但其文本分类效果依赖精心设计的提示,且计算开销大。为应对这一问题,本文提出一种资源高效的框架CICLe,将轻量级基础分类器与校准预测结合,通过自适应缩减候选类别集来优化大模型提示。我们在多个NLP分类基准上对CICLe进行全面评估,结果表明:当训练样本充足时,CICLe持续优于基础分类器,并超越少样本提示基线;在低数据场景下表现相当。效率方面,CICLe最多减少34.45%的样本需求和25.16%的提示长度,同时支持使用更小模型仍保持竞争力。此外,该方法在类别高度不平衡的任务中尤为突出。这些发现表明,CICLe是一种实用且可扩展的高效文本分类方法,融合了传统分类器的鲁棒性与大模型的适应性,在数据与计算效率上取得显著提升。

原文摘要 · Abstract (English)

Large Language Models (LLMs) demonstrate strong in-context learning abilities, yet their effectiveness in text classification depends heavily on prompt design and incurs substantial computational cost. Conformal In-Context Learning (CICLe) has been proposed as a resource-efficient framework that integrates a lightweight base classifier with Conformal Prediction to guide LLM prompting by adaptively reducing the set of candidate classes. However, its broader applicability and efficiency benefits beyond a single domain have not yet been systematically explored. In this paper, we present a comprehensive evaluation of CICLe across diverse NLP classification benchmarks. The results show that CICLe consistently improves over its base classifier and outperforms few-shot prompting baselines when the sample size is sufficient for training the base classifier, and performs comparably in low-data regimes. In terms of efficiency, CICLe reduces the number of shots and prompt length by up to 34.45% and 25.16%, respectively, and enables the use of smaller models with competitive performance. CICLe is furthermore particularly advantageous for text classification tasks with high class imbalance. These findings highlight CICLe as a practical and scalable approach for efficient text classification, combining the robustness of traditional classifiers with the adaptability of LLMs, and achieving substantial gains in data and computational efficiency.

文本分类提示工程校准预测效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。