让卷积网络自动适应设备算力,一模型多精度运行
Slimmable ConvNeXt: Width-Adaptive Inference for Efficient Multi-Device Deployment

- 基于层归一化与倒置瓶颈设计,实现通道宽度自适应推理
- 小模型仅1.2 GMAC就达77.4%准确率,大模型达82.8%
- 比同类模型快且省资源,适合移动端与动态算力场景
在资源各异的设备上部署视觉模型,或单设备因电池、散热、延迟导致算力波动时,通常需训练多个独立模型。宽度自适应推理通过训练一个包含多个嵌套子网络的共享权重模型,解决此问题。现有基于CNN的方法依赖可切换批量归一化,而近期方法集中于视觉变压器(ViT)。本文提出Slimmable ConvNeXt,利用其现代设计(层归一化与倒置瓶颈)实现通道宽度剪枝,无需归一化切换,训练更简单。在ImageNet-1k上,含3个子网络的Slimmable ConvNeXt-T从头训练600轮,4.5 GMAC下达80.8%准确率,1.2 GMAC下达77.4%。在相近计算量下,优于HydraViT(6头:78.4%@4.6 GMAC,3头:73.0%@1.3 GMAC)和MatFormer-S(78.6%)、SortedNet-S(78.2%),并进一步扩展至ConvNeXt-B,最大准确率达82.8%(15.35 GMAC)。
原文摘要 · Abstract (English)
Deploying vision models across devices with varying resource constraints, or even on a single device where available compute fluctuates due to battery state, thermal throttling, or latency deadlines, typically requires training and maintaining separate models. Width-adaptive inference addresses this by training a single set of shared weights containing multiple nested subnetworks of increasing capacity, but prior CNN-based approaches required switchable batch normalization, while recent scalable methods have focused on Vision Transformers. We present Slimmable ConvNeXt, which shows that ConvNeXt's modern design, specifically LayerNorm and inverted bottlenecks, makes it particularly suited for channel-width slimming, eliminating the normalization overhead of classical slimmable networks and producing a simpler training pipeline than both prior CNN and ViT approaches. On ImageNet-1k, Slimmable ConvNeXt-T with 3 subnetworks achieves 80.8% top-1 accuracy at 4.5 GMACs and 77.4% at 1.2 GMACs, trained from scratch for 600 epochs. At comparable compute, this exceeds HydraViT's 6-head subnetwork (78.4% at 4.6 GMACs) by 2.4 percentage points and its 3-head configuration (73.0% at 1.3 GMACs) by 4.4 percentage points, while also outperforming MatFormer-S (78.6%) and SortedNet-S (78.2%) at the same GMACs. Scaling to Slimmable ConvNeXt-B further improves maximum accuracy to 82.8% at 15.35 GMACs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。