arXiv:2510.08177cs.LG2025-10NeurIPS被引 9

通过重平衡模型参数空间,提升长尾分布下的小类识别效果。

Long-tailed Recognition with Model Rebalancing

  • 直接调整模型参数分配,引入低秩组件与动态权重策略。
  • 在多分类和多标签任务上显著提升尾部类别准确率。
  • 无需增加计算量,可无缝集成现有方法作为通用模块。

长尾识别在深度学习中普遍存在且极具挑战性,尤其在基础模型微调场景下,类别分布不均常导致模型对尾部类别泛化能力不足。尽管已有数据增强、损失重加权、解耦训练等方法,但在多标签长尾识别等复杂场景中仍难持续提升性能。本文深入分析长尾环境下模型容量的影响,提出新型框架Model Rebalancing(MORE),通过直接重平衡模型参数空间缓解类别不平衡。MORE引入低秩参数组件,在定制化损失函数与正弦重加权策略引导下,实现参数空间的优化分配,同时保持模型整体复杂度和推理开销不变。在多种长尾基准测试上(涵盖多分类与多标签任务)的广泛实验表明,MORE显著提升了模型对尾部类别的泛化能力,并有效增强现有缓解方法的效果。结果验证了MORE在长尾场景中作为鲁棒即插即用模块的潜力。

原文摘要 · Abstract (English)

Long-tailed recognition is ubiquitous and challenging in deep learning and even in the downstream finetuning of foundation models, since the skew class distribution generally prevents the model generalization to the tail classes. Despite the promise of previous methods from the perspectives of data augmentation, loss rebalancing and decoupled training etc., consistent improvement in the broad scenarios like multi-label long-tailed recognition is difficult. In this study, we dive into the essential model capacity impact under long-tailed context, and propose a novel framework, Model Rebalancing (MORE), which mitigates imbalance by directly rebalancing the model's parameter space. Specifically, MORE introduces a low-rank parameter component to mediate the parameter space allocation guided by a tailored loss and sinusoidal reweighting schedule, but without increasing the overall model complexity or inference costs. Extensive experiments on diverse long-tailed benchmarks, spanning multi-class and multi-label tasks, demonstrate that MORE significantly improves generalization, particularly for tail classes, and effectively complements existing imbalance mitigation methods. These results highlight MORE's potential as a robust plug-and-play module in long-tailed settings.

长尾识别参数重平衡多标签学习模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。