arXiv:2606.05740cs.AI2026-06

提出分支注意力机制,缓解类别不平衡下的梯度干扰问题

Class-Specific Branch Attention for Mitigating Gradient Interference under Class Imbalance

论文配图:Class-Specific Branch Attention for Mitigating Gradient Interference under Class Imbalance
图 1 · 摘自论文原文
  • 设计分支特异性通道重加权机制,降低不同类别梯度耦合
  • 在极端不平衡下使物理损伤类F1分数从0.261提升至0.522
  • 适合关注小样本分类性能优化的研究者与工程师

严重类别不平衡下,深度神经网络性能下降常归因于统计偏差。本文发现一个互补的优化层面问题:共享表征中不同类别间的梯度干扰,即多数类梯度会抑制少数类学习。为此,提出基于层间梯度流分析与梯度冲突矩阵的诊断框架,通过类间梯度余弦相似度量化干扰程度。研究多分支卷积架构后,提出轻量级改进方法——类特异性分支注意力(CSBA),实现分支特异的通道重加权,促进分支间隐式特征解耦,同时保持结构简单。实验表明,CSBA显著提升少数类表现,物理损伤类F1分数由0.261升至0.522,整体准确率基本不变;在CIFAR-10-LT上,宏平均F1从0.595提升至0.655,验证其在多种不平衡视觉识别任务中的泛化能力。研究强调,设计不平衡学习架构时应兼顾优化动态与统计方法。

原文摘要 · Abstract (English)

Deep neural networks trained under severe class imbalance often exhibit degraded performance, typically attributed to statistical bias. In this work, we identify a complementary optimization-level pathology: inter-class gradient interference within shared representations, where gradients from majority classes suppress minority-class learning. To analyze this phenomenon, we introduce a diagnostic framework based on layer-wise gradient flow analysis and a Gradient Conflict Matrix, which quantifies interference using cosine similarity between class-specific gradients. Using this framework, we study multi-branch convolutional architectures and propose a lightweight modification, Class-Specific Branch Attention (CSBA), that enables branch-specific channel reweighting to reduce gradient coupling. This mechanism promotes implicit feature decoupling across branches while preserving architectural simplicity. Empirically, CSBA improves minority-class performance, increasing the F1 score for the Physical-Damage class from 0.261 to 0.522 under severe imbalance, while maintaining comparable overall accuracy. Validation on CIFAR-10-LT confirms that this behavior generalizes across imbalanced visual recognition settings, with Macro-F1 improving from 0.595 to 0.655. More broadly, our findings highlight the importance of considering optimization dynamics alongside statistical methods when designing architectures for imbalanced learning.

类别不平衡梯度干扰分支注意力小样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。