arXiv:2607.18358cs.CLcs.LG2026-07

让分类模型自我进化,用廉价管道+大模型纠错实现持续提效

A Classifier That Teaches Itself: Self-Improving, Frozen-gate Training (SIFT) for Dynamic Document Classification

  • 用稀疏编码器+轻量模型做快速分类,低置信度样本交由大模型修正
  • 模型纠错结果反哺训练数据,标注成本趋近于零,准确率随使用提升
  • 双保险机制防止模型退化,支持无人值守的自动迭代

文档分类在实验室已解决,但在企业中仍面临挑战:根本问题不在模型架构,而在于标注项目耗时及机构对模型自训练的顾虑。我们提出SIFT(Self-Improving, Frozen-gate Training),一种动态分类服务,同时应对两大难题。SIFT采用低成本、依赖CPU的流水线:SPLADE稀疏编码器接LightGBM分类头,仅将低置信度少数文档送入LLM判断。判断结果回写至标注语料库,使昂贵模型持续教导廉价模型:升级率下降,语料库通过生产流量增长而非预先标注,准确率随使用不断累积。新增文档类别只需声明式配置包、标签空间、锚定短语和判别词典,无需标注项目。更关键的是安全问题:自主重训练可能导致隐性退化。SIFT通过双重晋升门控机制解决:一是关键标签的F1值回归检测,二是永不参与训练的冻结黄金测试集,任一不通过即阻止晋升。这使“每月无须人工重训”从冒险变为常规操作。本文描述架构、自喂养语料循环、冻结门控晋升机制及多领域部署实例,并讨论了边际标注成本趋近于零的经济模型。

原文摘要 · Abstract (English)

Document classification is a solved problem in the laboratory and an unsolved one in the enterprise. The blocker is rarely model architecture; it is the labeling project that must precede a model and the institutional fear of letting a model retrain itself once one exists. We present SIFT (Self-Improving, Frozen-gate Training), a dynamic classifier service, which attacks both. SIFT serves classification from a deliberately cheap, CPU-bound pipeline, a SPLADE sparse encoder feeding a LightGBM head, and escalates only the low-confidence minority of pages to an LLM judge. The judge's verdicts are written back into a labeled corpus, so the expensive model continuously teaches the cheap one: the escalation rate falls, the corpus grows from production traffic rather than from an up-front annotation effort, and accuracy compounds with use. Onboarding a new document family requires only a declarative bundle, label space, anchor phrases, and a judge glossary, not a labeling project. The harder problem is safety: an autonomously retraining classifier can silently regress. SIFT resolves this with a two-part promote gate, a critical-label F1 regression check plus a frozen golden regression set the model is never trained on, either of which vetoes promotion. This turns "retrain monthly without a human" from reckless into routine. We describe the architecture, the self-feeding corpus loop, the frozen-gate promotion mechanism, and an illustrative multi-domain deployment, and we discuss the economics of a classifier whose marginal labeling cost trends toward zero.

自进化文档分类自动标注LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。