通过动态选区与重要性采样提升CNN分类性能与训练效率
Tricks and Plug-ins for Gradient Boosting in Image Classification
- 引入动态特征选择与重要性采样,聚焦信息丰富的特征区域
- 在多个细粒度分类数据集上,准确率更高且训练速度更快
- 适合追求高效高精度的图像分类研究者与工程师
卷积神经网络(CNN)通过深层架构实现分层特征学习,在众多机器学习任务中取得显著成果。然而,其层数多、参数量大,导致训练计算成本高,需大量时间与人工调参才能找到最优结构。本文提出一种新型框架,将动态特征选择与BoostCNN原理结合,采用子网格选择和重要性采样策略,引导训练聚焦于特征空间中的有效区域。我们进一步设计一组算法,通过最小二乘损失将提升权重直接嵌入网络训练过程。该方法不仅减轻了人工架构设计负担,还提升了准确率与训练效率。在多个细粒度分类基准上的实验表明,所提出的增强型CNN变体在预测性能与训练速度上均持续优于传统CNN。
原文摘要 · Abstract (English)
Convolutional Neural Networks (CNNs) have achieved remarkable success across a wide range of machine learning tasks by leveraging hierarchical feature learning through deep architectures. However, the large number of layers and millions of parameters often make CNNs computationally expensive to train, requiring extensive time and manual tuning to discover optimal architectures. In this paper, we introduce a novel framework for boosting CNN performance that integrates dynamic feature selection with the principles of BoostCNN. Our approach incorporates two key strategies: subgrid selection and importance sampling, to guide training toward informative regions of the feature space. We further develop a family of algorithms that embed boosting weights directly into the network training process using a least squares loss formulation. This integration not only alleviates the burden of manual architecture design but also enhances accuracy and efficiency. Experimental results across several fine-grained classification benchmarks demonstrate that our boosted CNN variants consistently outperform conventional CNNs in both predictive performance and training speed.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。