arXiv:2502.16948cs.LGstat.ML2025-02

针对少数类样本极少的不平衡数据,提出一种更鲁棒的极小极大分类方法。

Deep Minimax Classifiers for Imbalanced Datasets with a Small Number of Minority Samples

  • 通过交替优化目标先验与对抗先验,动态调整决策边界。
  • 在仅有5个少数类样本时仍保持稳定性能,优于现有方法。
  • 适合小样本、类别严重不平衡的数据场景,尤其适用于医疗诊断等关键领域。

极小极大分类器在统计决策理论中已有成熟基础,但其在神经网络中的实现仍具挑战性,尤其是在训练数据极度不平衡且少数类样本极少的情况下。为此,本文提出一种新型极小极大学习算法,旨在最小化最差表现类别的风险。该算法包含两个迭代步骤:最小化阶段基于选定的目标先验训练模型,最大化阶段则将目标先验向训练模型的对抗先验调整。最小化阶段引入一种定向对数调整损失函数,能高效识别在目标先验下的最优决策边界;基于新获得的依赖先验的泛化界,理论上证明该损失函数具有优于现有损失函数的泛化能力。最大化阶段通过关注最差表现类别而非逐类风险估计来更新先验,增强了小样本条件下的鲁棒性。此外,为适配过参数化神经网络,将数据集分为两部分:一部分用于最小化阶段的模型训练,另一部分用于最大化阶段的先验更新。所提算法具备可证明的收敛性,实验证明其性能优于或媲美现有方法。所有代码已公开于 https://github.com/hansung-choi/TLA-linear-ascent。

原文摘要 · Abstract (English)

The concept of a minimax classifier is well-established in statistical decision theory, but its implementation via neural networks remains challenging, particularly in scenarios with imbalanced training data having a limited number of samples for minority classes. To address this issue, we propose a novel minimax learning algorithm designed to minimize the risk of worst-performing classes. Our algorithm iterates through two steps: a minimization step that trains the model based on a selected target prior, and a maximization step that updates the target prior towards the adversarial prior for the trained model. In the minimization, we introduce a targeted logit-adjustment loss function that efficiently identifies optimal decision boundaries under the target prior. Moreover, based on a new prior-dependent generalization bound that we obtained, we theoretically prove that our loss function has a better generalization capability than existing loss functions. During the maximization, we refine the target prior by shifting it towards the adversarial prior, depending on the worst-performing classes rather than on per-class risk estimates. Our maximization method is particularly robust in the regime of a small number of samples. Additionally, to adapt to overparameterized neural networks, we partition the entire training dataset into two subsets: one for model training during the minimization step and the other for updating the target prior during the maximization step. Our proposed algorithm has a provable convergence property, and empirical results indicate that our algorithm performs better than or is comparable to existing methods. All codes are publicly available at https://github.com/hansung-choi/TLA-linear-ascent.

极小极大小样本不平衡数据分类器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。