无需重训练即可实时应对类别分布变化,提升少数类识别准确率。
Online Bayesian Imbalanced Learning with Bregman-Calibrated Deep Networks
- 用Bregman损失训练网络,直接生成不依赖先验的似然比估计。
- 在测试分布显著偏移时,F1分数仍优于现有方法。
- 适合欺诈检测、医疗诊断等需动态适应的场景。
类别不平衡仍是机器学习中的核心挑战,传统分类器在少数类上性能严重下降。尽管现有方法通过重采样或代价敏感学习解决该问题,但在部署阶段类别分布发生变化时,仍需重新训练或访问标注数据,这在真实应用中极为常见,如欺诈检测、医学诊断和异常检测。本文提出一种名为在线贝叶斯不平衡学习(OBIL)的原理性框架,将似然比估计与类别先验假设解耦,实现无需重训练的实时适应。基于Bregman散度与正确评分规则的联系,证明使用此类损失训练的深度网络可产生后验概率,从中提取出不受先验影响的似然比。我们证明这些似然比估计在任意类别先验和代价结构变化下依然有效,仅需调整阈值即可获得最优贝叶斯决策。理论推导表明,OBIL在有限样本下的后悔界为 $O(\sqrt{T \log T})$,优于已知具有完美先验知识的基准。在基准数据集及医学诊断基准上的大量实验显示,当模拟部署分布发生显著偏移时,OBIL仍保持稳健性能,且在测试分布严重偏离训练条件时,其F1分数显著优于当前最优方法。
原文摘要 · Abstract (English)
Class imbalance remains a fundamental challenge in machine learning, where standard classifiers exhibit severe performance degradation in minority classes. Although existing approaches address imbalance through resampling or cost-sensitive learning during training, they require retraining or access to labeled target data when class distributions shift at deployment time, a common occurrence in real-world applications such as fraud detection, medical diagnosis, and anomaly detection. We present \textit{Online Bayesian Imbalanced Learning} (OBIL), a principled framework that decouples likelihood-ratio estimation from class-prior assumptions, enabling real-time adaptation to distribution shifts without model retraining. Our approach builds on the established connection between Bregman divergences and proper scoring rules to show that deep networks trained with such losses produce posterior probability estimates from which prior-invariant likelihood ratios can be extracted. We prove that these likelihood-ratio estimates remain valid under arbitrary changes in class priors and cost structures, requiring only a threshold adjustment for optimal Bayes decisions. We derive finite-sample regret bounds demonstrating that OBIL achieves $O(\sqrt{T \log T})$ regret against an oracle with perfect prior knowledge. Extensive experiments on benchmark datasets and medical diagnosis benchmarks under simulated deployment shifts demonstrate that OBIL maintains robust performance under severe distribution shifts, outperforming state-of-the-art methods in F1 Score when test distributions deviate significantly from the training conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。