用0-1损失优化生成分类器,提升准确率
Risk-based Calibration for Generative Classifiers
- 基于0-1损失迭代调整联合概率分布,强化正确类统计特征
- 在20个数据集上,训练误差和泛化误差均显著优于传统方法
- 适合追求分类性能的生成模型研究者使用
生成分类器基于联合概率分布构建,通常通过依赖数据统计的闭式方法学习,最大化数据拟合得分。但这些得分与监督分类指标(如错误率,即期望0-1损失)无直接关联。为此,我们提出一种称为风险校准(RC)的学习方法,通过在训练样本中根据0-1损失迭代调整联合概率分布,增强真实类别相关数据统计,削弱错误类别的统计。结果使分类器对正确标签的概率逐步提高,降低训练误差。在20个异构数据集上,使用朴素贝叶斯和二次判别分析进行实验,结果显示RC在训练误差和泛化误差上均显著优于闭式学习方法。该方法弥合了传统生成方法与性能导向学习之间的差距,更贴近监督分类目标。
原文摘要 · Abstract (English)
Generative classifiers are constructed on the basis of a joint probability distribution and are typically learned using closed-form procedures that rely on data statistics and maximize scores related to data fitting. However, these scores are not directly linked to supervised classification metrics such as the error, i.e., the expected 0-1 loss. To address this limitation, we propose a learning procedure called risk-based calibration (RC) that iteratively refines the generative classifier by adjusting its joint probability distribution according to the 0-1 loss in training samples. This is achieved by reinforcing data statistics associated with the true classes while weakening those of incorrect classes. As a result, the classifier progressively assigns higher probability to the correct labels, improving its training error. Results on 20 heterogeneous datasets using both naïve Bayes and quadratic discriminant analysis show that RC significantly outperforms closed-form learning procedures in terms of both training error and generalization error. In this way, RC bridges the gap between traditional generative approaches and learning procedures guided by performance measures, ensuring a closer alignment with supervised classification objectives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。