用空间门控替换卷积模块,让轻量模型更准更快
VeloxNet: Efficient Spatial Gating for Lightweight Embedded Image Classification
- 用空间门控单元替代局部卷积,全局建模仅需一层
- 参数减少46.1%,在三个灾情图像数据集上准确率显著提升
- 适合无人机巡检等嵌入式设备部署,兼顾精度与效率
在无人机灾情监测和基础设施巡检等任务中,将深度学习模型部署到嵌入式设备需兼顾准确性与模型大小、内存、延迟的严格限制。本文提出轻量级CNN架构VeloxNet,将SqueezeNet中的fire模块替换为空间门控多层感知机(gMLP)块。每个gMLP块采用空间门控单元(SGU),通过可学习的空间投影与乘性门控,在单层内捕捉完整特征图的时空依赖关系。相比小卷积核定义的局部感受野,SGU在每层实现全局空间建模且参数更少。在三个航拍图像数据集AIDER、CDD和LDD上评估,对比包括MobileNet、ShuffleNet、EfficientNet及最新视觉变压器在内的十一个基线模型。VeloxNet相较SqueezeNet参数量降低46.1%(从740,970降至399,366),同时在AIDER上加权F1提升6.32%,在CDD上提升30.83%,在LDD上提升2.51%。结果表明,以空间门控块替代局部卷积模块,能有效提升资源受限场景下的分类精度与参数效率。源代码将在论文录用后公开。
原文摘要 · Abstract (English)
Deploying deep learning models on embedded devices for tasks such as aerial disaster monitoring and infrastructure inspection requires architectures that balance accuracy with strict constraints on model size, memory, and latency. This paper introduces VeloxNet, a lightweight CNN architecture that replaces SqueezeNet's fire modules with gated multi-layer perceptron (gMLP) blocks for embedded image classification. Each gMLP block uses a spatial gating unit (SGU) that applies learned spatial projections and multiplicative gating, enabling the network to capture spatial dependencies across the full feature map in a single layer. Unlike fire modules, which are limited to local receptive fields defined by small convolutional kernels, the SGU provides global spatial modeling at each layer with fewer parameters. We evaluate VeloxNet on three aerial image datasets: the Aerial Image Database for Emergency Response (AIDER), the Comprehensive Disaster Dataset (CDD), and the Levee Defect Dataset (LDD), comparing against eleven baselines including MobileNet variants, ShuffleNet, EfficientNet, and recent vision transformers. VeloxNet reduces the parameter count by 46.1% relative to SqueezeNet (from 740,970 to 399,366) while improving weighted F1 scores by 6.32% on AIDER, 30.83% on CDD, and 2.51% on LDD. These results demonstrate that substituting local convolutional modules with spatial gating blocks can improve both classification accuracy and parameter efficiency for resource-constrained deployment. The source code will be made publicly available upon acceptance of the paper.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。