arXiv:2507.09940cs.LGstat.AP2025-07ICCV

训练中动态增删神经元,提升少数类识别准确率。

Long-Tailed Data Classification by Increasing and Decreasing Neurons During Training

  • 训练时周期性增减神经元,增强少数类表征能力。
  • 在三个数据集上优于固定结构网络,部分场景提升超5%。
  • 适合处理类别不平衡问题,尤其对小样本类有效。

传统深度学习中神经元数量在训练过程中保持不变。但生物学研究表明,人类海马体在学习过程中会持续生成新神经元并修剪旧神经元,提示灵活的容量分配有助于提升性能。现实世界数据集常存在类别不平衡问题,某些类别样本远少于其他类别,导致依赖固定结构网络时少数类识别准确率显著下降。为此,我们提出一种在训练过程中周期性增加和移除神经元的方法,从而增强少数类的表征能力。通过保留多数类的关键特征,同时有选择地为样本较少的类别增加神经元,该方法在训练期间动态调整网络容量。重要的是,尽管训练中神经元数量变化,最终网络规模和结构保持不变,确保了部署效率与兼容性。此外,在三个不同数据集和五种代表性模型上的实验表明,所提方法优于固定大小网络,且与其他不平衡处理技术结合时表现更优。结果表明,动态、受生物启发的网络设计能有效提升类别不平衡数据上的性能。

原文摘要 · Abstract (English)

In conventional deep learning, the number of neurons typically remains fixed during training. However, insights from biology suggest that the human hippocampus undergoes continuous neuron generation and pruning of neurons over the course of learning, implying that a flexible allocation of capacity can contribute to enhance performance. Real-world datasets often exhibit class imbalance situations where certain classes have far fewer samples than others, leading to significantly reduce recognition accuracy for minority classes when relying on fixed size networks.To address the challenge, we propose a method that periodically adds and removes neurons during training, thereby boosting representational power for minority classes. By retaining critical features learned from majority classes while selectively increasing neurons for underrepresented classes, our approach dynamically adjusts capacity during training. Importantly, while the number of neurons changes throughout training, the final network size and structure remain unchanged, ensuring efficiency and compatibility with deployment.Furthermore, by experiments on three different datasets and five representative models, we demonstrate that the proposed method outperforms fixed size networks and shows even greater accuracy when combined with other imbalance-handling techniques. Our results underscore the effectiveness of dynamic, biologically inspired network designs in improving performance on class-imbalanced data.

类别不平衡动态网络神经元调控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。