arXiv:2506.14846cs.CVcs.AI2025-06

提出可自适应优化卷积核大小的新方法,提升模型精度并降低计算量。

Finding Optimal Kernel Size and Dimension in Convolutional Neural Networks An Architecture Optimization Approach

  • 基于信息论与学习理论,构建分层核尺寸优化函数BKSEF
  • 在多个数据集上实现最高3.1%精度提升,计算量减少42.8%
  • 适用于医疗图像与边缘设备场景,适合集成到自动架构搜索中

卷积神经网络中卷积核大小的选择是一个关键但常被忽视的设计决策,影响感受野、特征提取能力、计算成本和模型准确率。本文提出最佳卷积核尺寸估计函数(BKSEF),一种基于数学原理并经实证验证的分层核尺寸优化框架。该方法融合信息论、信号处理与学习理论,平衡信息增益、计算效率与精度提升。在CIFAR-10、CIFAR-100、ImageNet-lite、ChestX-ray14和GTSRB等数据集上的大量实验表明,使用BKSEF指导的模型相比采用统一3×3核的传统模型,最高可实现3.1%的准确率提升,同时减少42.8%的浮点运算次数(FLOPs)。两个真实场景案例进一步验证:一个用于云端医学图像分类,提升了可解释性与准确率;另一个用于边缘设备交通标志识别,显著降低延迟与模型体积,且准确率损失极小。结果表明,卷积核尺寸可作为可优化参数而非固定启发式设定。BKSEF为研究人员与开发者提供了实用的优化准则与理论支持,适用于集成至神经架构搜索流程与实时系统,为卷积网络优化提供新视角。

原文摘要 · Abstract (English)

Kernel size selection in Convolutional Neural Networks (CNNs) is a critical but often overlooked design decision that affects receptive field, feature extraction, computational cost, and model accuracy. This paper proposes the Best Kernel Size Estimation Function (BKSEF), a mathematically grounded and empirically validated framework for optimal, layer-wise kernel size determination. BKSEF balances information gain, computational efficiency, and accuracy improvements by integrating principles from information theory, signal processing, and learning theory. Extensive experiments on CIFAR-10, CIFAR-100, ImageNet-lite, ChestX-ray14, and GTSRB datasets demonstrate that BKSEF-guided architectures achieve up to 3.1 percent accuracy improvement and 42.8 percent reduction in FLOPs compared to traditional models using uniform 3x3 kernels. Two real-world case studies further validate the approach: one for medical image classification in a cloud-based setup, and another for traffic sign recognition on edge devices. The former achieved enhanced interpretability and accuracy, while the latter reduced latency and model size significantly, with minimal accuracy trade-off. These results show that kernel size can be an active, optimizable parameter rather than a fixed heuristic. BKSEF provides practical heuristics and theoretical support for researchers and developers seeking efficient and application-aware CNN designs. It is suitable for integration into neural architecture search pipelines and real-time systems, offering a new perspective on CNN optimization.

卷积神经网络架构优化核大小高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。