针对深度可分离网络,用三值权重降低计算能耗
PROM: Prioritize Reduction of Multiplications Over Lower Bit-Widths for Efficient CNNs
- 点卷积用三值权重,其余模块保持8位,简化计算
- 相比浮点16位基线,能耗降23.9倍,存储减2.7倍
- 适合移动端高效部署,硬件支持广泛
卷积神经网络在资源受限设备上的视觉任务中至关重要。量化能有效压缩模型,降低存储和能耗。但在现代深度可分离架构中,计算开销分布不均,点卷积最为耗时。现有量化方法因忽略这种不均衡,未能充分挖掘效率潜力。为此,我们提出PROM:通过选择性使用两种不同位宽,对现代深度可分离卷积网络进行量化。具体而言,点卷积采用三值权重,其余模块使用8位权重,通过简单的量化感知训练实现。同时,将激活量化为8位后,三值权重的点卷积转化为int8加法,广泛兼容硬件平台,彻底避免昂贵乘法。应用于MobileNetV2,相比float16基线,能量消耗降低23.9倍,存储减少2.7倍,且ImageNet分类性能相近。该方法显著提升了量化卷积模型在ImageNet上能耗与精度的帕累托前沿。
原文摘要 · Abstract (English)
Convolutional neural networks (CNNs) are crucial for computer vision tasks on resource-constrained devices. Quantization effectively compresses these models, reducing storage size and energy cost. However, in modern depthwise-separable architectures, the computational cost is distributed unevenly across its components, with pointwise operations being the most expensive. By applying a general quantization scheme to this imbalanced cost distribution, existing quantization approaches fail to fully exploit potential efficiency gains. To this end, we introduce PROM, a straightforward approach for quantizing modern depthwise-separable convolutional networks by selectively using two distinct bit-widths. Specifically, pointwise convolutions are quantized to ternary weights, while the remaining modules use 8-bit weights, which is achieved through a simple quantization-aware training procedure. Additionally, by quantizing activations to 8-bit, our method transforms pointwise convolutions with ternary weights into int8 additions, which enjoy broad support across hardware platforms and effectively eliminates the need for expensive multiplications. Applying PROM to MobileNetV2 reduces the model's energy cost by more than an order of magnitude (23.9x) and its storage size by 2.7x compared to the float16 baseline while retaining similar classification performance on ImageNet. Our method advances the Pareto frontier for energy consumption vs. top-1 accuracy for quantized convolutional models on ImageNet. PROM addresses the challenges of quantizing depthwise-separable convolutional networks to both ternary and 8-bit weights, offering a simple way to reduce energy cost and storage size.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。