arXiv:2606.30516cs.CV2026-06

无需重训练,实时动态压缩预训练CNN模型,显著降低计算量。

HASTE: A Framework for Training-Free, Dynamic, and Steerable Compression of Pre-Trained Convolutional Neural Networks

论文配图:HASTE: A Framework for Training-Free, Dynamic, and Steerable Compression of Pre-Trained Convolutional Neural Networks
图 1 · 摘自论文原文
  • 通过局部敏感哈希识别并合并特征图冗余通道,实现推理时动态压缩。
  • ResNet34在CIFAR-10上减少46.2%计算量,精度仅降1.25%。
  • 适用于无数据、无重训练场景,适合部署在资源受限设备上。

在资源受限设备上部署大型卷积神经网络(CNN)面临高计算成本的挑战。尽管动态执行方法具有潜力,但现有CNN方法通常需要专用训练或微调,限制了其在预训练模型上的应用且需访问数据。为此,我们提出HASTE(Hashing for Tractable Efficiency),一个即插即用的卷积模块,实现对大型预训练CNN的无训练、动态压缩。推理时,HASTE利用局部敏感哈希在块级识别并合并潜在特征图的冗余通道,同时压缩输入特征及其对应滤波器的深度,从而实现更低计算开销的卷积。我们在CIFAR-10和ImageNet上对多种架构进行了广泛实验,结果显示,在CIFAR-10上的ResNet34实现了46.2%的FLOPs减少,精度仅下降1.25%,且无需任何重训练。通过详尽的消融研究、方法性质与局限性分析,以及将通道合并方案与视觉变压器中的标记合并任务联系起来的讨论,验证了核心设计的有效性。结果表明,HASTE为预训练CNN提供了可调控的运行时压缩解决方案,开辟了高效深度学习部署的新路径。

原文摘要 · Abstract (English)

Deploying large convolutional neural networks (CNNs) on resource-constrained devices is challenging due to their high computational cost. While dynamic execution methods are promising, existing approaches for CNNs typically require specialized training or fine-tuning, limiting their effectiveness when applied to pre-trained models and requiring data access. To address this gap, we propose HASTE (Hashing for Tractable Efficiency), a plug-and-play convolution module that enables training-free, dynamic compression of large pre-trained CNNs. At inference time, HASTE uses locality-sensitive hashing to identify and merge redundant channels of latent feature maps on a patch-wise basis. This process simultaneously compresses the depth of both input features and their corresponding filters, resulting in computationally cheaper convolutions. We conduct extensive experiments on CIFAR-10 and ImageNet across a range of architectures, demonstrating a 46.2% FLOPs reduction in a ResNet34 on CIFAR-10 with only a 1.25% drop in accuracy, without any retraining. We support our claims by comprehensive ablation studies to validate our core design choices, an analysis of the method's properties and limitations, and a discussion that connects our channel merging scheme to the conceptually related task of token merging in Vision Transformers. Our results demonstrate that HASTE provides an effective solution for steerable compression of pre-trained CNNs at runtime, opening new possibilities for the deployment of efficient deep learning methods.

模型压缩动态推理无训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。