用双粒度蒸馏融合两类弱模型,提升长尾噪声数据的鲁棒性。
Dual-granularity Sinkhorn Distillation for Enhanced Learning from Long-tailed Noisy Data
- 分别用抗噪声和抗长尾的弱模型提供互补监督信号
- 通过最优传输对齐样本级与类别级预测,减少误判
- 适合处理真实场景中同时存在类别不均衡和标签噪声的数据
真实世界深度学习数据集常同时面临类别不平衡与标签噪声问题,严重影响模型性能。现有方法多针对单一问题,但联合处理困难,因难以区分真实少数类样本与噪声数据,常导致优化目标冲突。本文提出新视角:不从零构建复杂技术,而是协同利用已有的、仅解决单一问题的‘弱’辅助模型——一个抗标签噪声,一个抗类别不平衡。二者分别在样本层(局部)与分布层(全局)发挥作用,具有天然互补性。为此,我们提出双粒度Sinkhorn蒸馏(D-SINK)框架,通过最优传输优化的代理标签分配,使主模型的样本级预测匹配噪声鲁棒模型,类别分布匹配长尾鲁棒模型。大量基准实验表明,D-SINK显著提升对长尾噪声数据的鲁棒性,实现优异的实证性能。
原文摘要 · Abstract (English)
Real-world datasets for deep learning frequently suffer from the co-occurring challenges of class imbalance and label noise, hindering model performance. While methods exist for each issue, effectively combining them is non-trivial, as distinguishing genuine tail samples from noisy data proves difficult, often leading to conflicting optimization strategies. This paper presents a novel perspective: instead of primarily developing new complex techniques from scratch, we explore synergistically leveraging well-established, individually 'weak' auxiliary models - specialized for tackling either class imbalance or label noise but not both. This view is motivated by the insight that class imbalance (a distributional-level concern) and label noise (a sample-level concern) operate at different granularities, suggesting that robustness mechanisms for each can in principle offer complementary strengths without conflict. We propose Dual-granularity Sinkhorn Distillation (D-SINK), a novel framework that enhances dual robustness by distilling and integrating complementary insights from such 'weak', single-purpose auxiliary models. Specifically, D-SINK uses an optimal transport-optimized surrogate label allocation to align the target model's sample-level predictions with a noise-robust auxiliary and its class distributions with an imbalance-robust one. Extensive experiments on benchmark datasets demonstrate that D-SINK significantly improves robustness and achieves strong empirical performance in learning from long-tailed noisy data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。