提出分组共享低秩压缩法,让大核卷积模型在手机上高效运行。
Group-Shared Low-Rank Approximation for Mobile-Efficient Pointwise Convolutions in Large-Kernel CNNs
- 用分组共享的低秩分解替代传统点卷积,减少参数量
- 在多个大核模型上实现存储成本降低超87%且性能接近原模型
- 适合需要部署高精度视觉模型的移动端开发者
大核卷积神经网络通过大幅扩展感受野在视觉任务中表现优异,但其参数量呈二次增长,严重制约边缘设备的存储部署。现有高效架构虽通过深度可分离卷积和低秩近似等技术压缩深度卷积,却忽视了点卷积占据超过87%参数量(如RepLKNet-31B)这一关键瓶颈,导致资源受限设备(如4-12 GB RAM的智能手机)面临存储成本过高和内存加载压力过大的问题。为此,本文提出通道分组共享(CGS)低秩近似,一种基于奇异值分解(SVD)的参数共享策略:在层内构建结构化低秩范式,包含跨通道组共享的上下投影矩阵(高参数成本)与通道组特异的可扩展对角矩阵(低参数成本)。该设计显著减少参数量。大量实验表明,引入CGS的大核CNN(RepLKNet、ConvNeXt、SLaK)在保持竞争力性能的同时,大幅降低存储开销。关键在于,CGS缓解了存储限制,减轻加载时的内存带宽压力,降低模型加载延迟,使预训练大核CNN在边缘设备上的实际部署成为可能,弥合高性能视觉模型与边缘落地之间的差距。
原文摘要 · Abstract (English)
Large-kernel Convolutional Neural Networks (CNNs) deliver remarkable performance in vision tasks by significantly expanding receptive fields, yet their quadratic parameter growth critically impedes storage-efficient edge deployment. While existing efficient architectures adopt parameter-efficient depthwise separable convolution backbones that leverage techniques like low-rank approximation and weight sharing to compress depthwise convolutions, we identify a critical oversight: pointwise convolutions dominate parameter volume (>87% in models like RepLKNet-31B) and constitute the primary deployment bottleneck on resource-constrained edge devices. This results in prohibitive storage costs and severe memory-loading constraints on resource-limited devices (e.g., smartphones with 4-12 GB Random Access Memory (RAM)). To overcome this, we propose Channel Group-Shared (CGS) low-rank approximation, a novel Singular Value Decomposition (SVD)-based parameter-sharing strategy. CGS constructs a structured low-rank paradigm isomorphic to SVD decomposition, comprising shared (high-parameter-cost) down/up-projection matrices across channel groups within a layer and channel-group-specific (low-parameter-cost) scalable diagonal matrices. This group-sharing design achieves significant parameter reduction. Extensive experiments demonstrate that large-kernel CNNs (RepLKNet, ConvNeXt, SLaK) enhanced with CGS strike an empirically favorable balance between competitive performance and substantially reduced storage costs. Crucially, by alleviating storage constraints, reducing memory bandwidth pressure during loading, and minimizing model loading latency, CGS enables the feasible deployment of pre-trained large-kernel CNN models on edge devices, thereby bridging the gap between high-performance vision models and practical edge deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。