arXiv:2511.18615cs.LGstat.ML2025-11被引 2

动态狄利克雷先验提升标签漂移估计精度,适合实时数据场景。

Bayesian-based Online Label Shift Estimation with Dynamic Dirichlet Priors

  • 用贝叶斯框架动态优化狄利克雷超参数与类别先验,突破传统方法限制。
  • 在CIFAR100和ImageNet上,相比基线降低40%和12%的KL散度,准确率显著提升。
  • 支持在线更新,计算高效,适合大规模、分布动态变化的学习任务。

标签漂移是监督学习中的常见挑战,当测试数据的类别先验分布与训练数据不同时,分类器性能会显著下降。为准确估计测试先验并提升分类精度,本文提出基于贝叶斯的标签漂移估计框架FMAPLS及其在线版本online-FMAPLS。该方法结合批处理与在线期望最大化(EM)算法,联合动态优化狄利克雷超参数α与类别先验π,克服了现有最大后验标签漂移(MAPLS)方法的刚性约束。此外,引入线性近似函数(LSF)替代梯度更新,获得闭式解,降低计算复杂度且保持渐近等价性。在线版本用随机逼近替代批E步,实现对流式数据的实时适应。理论分析揭示在线收敛速率与估计精度之间的根本权衡。在CIFAR100与ImageNet数据集上,面对洗牌长尾与狄利克雷测试先验,FMAPLS与online-FMAPLS分别实现最高40%和12%的KL散度降低,并在严重类别不平衡与分布不确定性下显著提升后漂移准确率,验证了方法在大规模动态学习场景中的鲁棒性、可扩展性与适用性。

原文摘要 · Abstract (English)

Label shift, a prevalent challenge in supervised learning, arises when the class prior distribution of test data differs from that of training data, leading to significant degradation in classifier performance. To accurately estimate the test priors and enhance classification accuracy, we propose a Bayesian framework for label shift estimation, termed Full Maximum A Posterior Label Shift (FMAPLS), along with its online version, online-FMAPLS. Leveraging batch and online Expectation-Maximization (EM) algorithms, these methods jointly and dynamically optimize Dirichlet hyperparameters $\boldsymbolα$ and class priors $\boldsymbolπ$, thereby overcoming the rigid constraints of the existing Maximum A Posterior Label Shift (MAPLS) approach. Moreover, we introduce a linear surrogate function (LSF) to replace gradient-based hyperparameter updates, yielding closed-form solutions that reduce computational complexity while retaining asymptotic equivalence. The online variant substitutes the batch E-step with a stochastic approximation, enabling real-time adaptation to streaming data. Furthermore, our theoretical analysis reveals a fundamental trade-off between online convergence rate and estimation accuracy. Extensive experiments on CIFAR100 and ImageNet datasets under shuffled long-tail and Dirichlet test priors demonstrate that FMAPLS and online-FMAPLS respectively achieve up to 40% and 12% lower KL divergence and substantial improvements in post-shift accuracy over state-of-the-art baselines, particularly under severe class imbalance and distributional uncertainty. These results confirm the robustness, scalability, and suitability of the proposed methods for large-scale and dynamic learning scenarios.

标签漂移贝叶斯方法在线学习狄利克雷先验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。