arXiv:2609.03972cs.LG2026-09

无需重训练,通过输出空间重分布实现标签动态删除

OSR: Output Space Redistribution for Adaptive Label Removal in Classification Models

论文配图:OSR: Output Space Redistribution for Adaptive Label Removal in Classification Models
图 1 · 摘自论文原文
  • 在输出空间进行统计重分布,模拟重训后模型的置信度
  • 相比全量重训提速显著,且保持分类性能接近原模型
  • 适合需要频繁更新类别体系的系统,兼顾效率与隐私

分类系统中标签删除频繁发生,尤其在分类体系动态演进时。现有方法多依赖原始数据重训或调整特征空间,存在计算开销大、存储成本高、结果不一致、可扩展性差及模型性能下降等问题。本文提出一种新型方法:在输出空间进行统计重分布,以近似重训后模型的置信度向量。该方法作为模块化输出过滤器,无需修改特征空间或损失函数收敛过程,突破了可扩展性瓶颈。仅需已有标签和历史输出置信度,避免了对原始数据的依赖,缓解了数据相关方案的隐私风险。大量实验表明,该方法在多个分类任务上表现接近全量重训,同时显著提升计算效率并增强隐私保护。

原文摘要 · Abstract (English)

Label removal occurs frequently in classification systems with evolving taxonomies, where categories must be dynamically updated or eliminated. To accommodate such changes, classification models must adapt accordingly. Existing solutions, broadly categorized as retraining-based and feature-space-adjustment-based, share common limitations despite their variations, including reliance on access to original data, substantial computational and storage costs, inconsistent results, poor scalability, and degradation of model utility. To address this, we propose a novel approach that leverages statistical redistribution in the output space to approximate the post-removal confidence vectors of a retrained model. Applicable as a modular output filter, our method bypasses the burden of feature-space adjustments or loss-function convergence, alleviating scalability limitations. Furthermore, by requiring only existing labels and prior output confidences, the method potentially mitigates privacy concerns inherent to data-dependent solutions. Extensive experiments demonstrate competitive performance against full retraining, with improvements in computational efficiency and privacy preservation across several classification tasks.

分类模型标签删除输出重分布

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。