arXiv:2410.09408cs.LG2024-10被引 8

用适配器提升分类器的置信预测效率,不牺牲准确率。

C-Adapter: Adapting Deep Classifiers for Efficient Conformal Prediction Sets

  • 引入适配器模块优化非符合性分数的判别力。
  • 在不同置信度下显著缩小预测集合大小。
  • 适用于各类分类模型,可无缝集成现有训练流程。

置信预测作为一种新兴的不确定性量化技术,通常作为训练后分类器输出的后处理。为实现最优预测效率,置信训练通过正则化项最小化特定误差率下的平均预测集大小,但该正则化会损害分类准确率,导致置信预测器效率下降。为此,我们提出 extbf{置信适配器}(C-Adapter),一种基于适配器的调优方法,在不损失准确率的前提下提升置信预测器的效率。具体而言,我们将适配器设计为一类保持内部顺序的函数,并采用新提出的损失函数,最大化正确匹配与随机匹配数据-标签对之间的非符合性分数判别力。使用C-Adapter后,模型对错误标签产生极高的非符合性分数,从而在不同覆盖率下有效提升预测集效率。大量实验表明,C-Adapter能有效适配多种分类器以生成高效预测集,并增强置信训练方法。

原文摘要 · Abstract (English)

Conformal prediction, as an emerging uncertainty quantification technique, typically functions as post-hoc processing for the outputs of trained classifiers. To optimize the classifier for maximum predictive efficiency, Conformal Training rectifies the training objective with a regularization that minimizes the average prediction set size at a specific error rate. However, the regularization term inevitably deteriorates the classification accuracy and leads to suboptimal efficiency of conformal predictors. To address this issue, we introduce \textbf{Conformal Adapter} (C-Adapter), an adapter-based tuning method to enhance the efficiency of conformal predictors without sacrificing accuracy. In particular, we implement the adapter as a class of intra order-preserving functions and tune it with our proposed loss that maximizes the discriminability of non-conformity scores between correctly and randomly matched data-label pairs. Using C-Adapter, the model tends to produce extremely high non-conformity scores for incorrect labels, thereby enhancing the efficiency of prediction sets across different coverage rates. Extensive experiments demonstrate that C-Adapter can effectively adapt various classifiers for efficient prediction sets, as well as enhance the conformal training method.

置信预测适配器不确定性量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。