三种方法协同提升长尾分类,兼顾少数类与多数类表现
Solving the long-tailed distribution problem by exploiting the synergies and balance of different techniques
- 融合对比学习、生成补全与动态边界损失,实现特征与决策协同优化
- 在多个长尾数据集上显著提升尾部类别准确率,同时保持头部类别性能
- 适合关注长尾问题的视觉识别研究者,尤其对少样本分类有实用价值
真实世界数据中长尾分布普遍存在,使基于经验风险最小化的模型难以有效学习和分类尾部类别。现有研究多聚焦于调整特征空间分布或模型决策边界,但对不同方法间的协同与矫正作用探讨不足。本文深入分析三种长尾识别技术:监督对比学习(SCL)、稀有类样本生成器(RSG)和标签分布感知边缘损失(LDAM)。SCL通过增强类内聚类与类间分离性提升性能,但倾向主导类别;引入RSG后,类内特征进一步向类别中心聚集,与SCL形成协同效应,且生成新尾部特征弥补了SCL导致的尾部特征空间压缩。同时,LDAM为尾部类别引入更大边缘,当与由SCL和RSG带来的更明确决策边界结合时,进一步增强尾部性能。此外,SCL可补偿因RSG和LDAM牺牲的主导类别准确率。实验表明,三者协同实现优势互补与短板互抵,在端到端架构下显著提升尾部类别准确率,同时不损害主导类别表现,达成整体平衡提升。
原文摘要 · Abstract (English)
In real-world data, long-tailed data distribution is common, making it challenging for models trained on empirical risk minimisation to learn and classify tail classes effectively. While many studies have sought to improve long tail recognition by altering the data distribution in the feature space and adjusting model decision boundaries, research on the synergy and corrective approach among various methods is limited. Our study delves into three long-tail recognition techniques: Supervised Contrastive Learning (SCL), Rare-Class Sample Generator (RSG), and Label-Distribution-Aware Margin Loss (LDAM). SCL enhances intra-class clusters based on feature similarity and promotes clear inter-class separability but tends to favour dominant classes only. When RSG is integrated into the model, we observed that the intra-class features further cluster towards the class centre, which demonstrates a synergistic effect together with SCL's principle of enhancing intra-class clustering. RSG generates new tail features and compensates for the tail feature space squeezed by SCL. Similarly, LDAM is known to introduce a larger margin specifically for tail classes; we demonstrate that LDAM further bolsters the model's performance on tail classes when combined with the more explicit decision boundaries achieved by SCL and RSG. Furthermore, SCL can compensate for the dominant class accuracy sacrificed by RSG and LDAM. Our research emphasises the synergy and balance among the three techniques, with each amplifying the strengths of the others and mitigating their shortcomings. Our experiment on long-tailed distribution datasets, using an end-to-end architecture, yields competitive results by enhancing tail class accuracy without compromising dominant class performance, achieving a balanced improvement across all classes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。