arXiv:2601.09352cs.CV2026-01

通过频谱重建精度识别冗余通道,实现极致结构化压缩。

Spectral Complex Autoencoder Pruning: A Fidelity-Guided Criterion for Extreme Structured Channel Compression

论文配图:Spectral Complex Autoencoder Pruning: A Fidelity-Guided Criterion for Extreme Structured Channel Compression
图 1 · 摘自论文原文
  • 构建复数交互场,用频域自编码器评估通道重要性。
  • 在VGG16上实现90.11%计算量与96.30%参数量压缩,精度仅降1.67%。
  • 适合需要极致模型轻量化且容忍小幅精度损失的部署场景。

我们提出谱复数自动编码器剪枝(SCAP),一种基于重构的通道级冗余度度量方法。对每个卷积层,将多通道输入激活作为实部,单个输出通道激活(空间对齐并广播至所有输入通道)作为虚部,构建复数交互场。将该场转换至频域,并训练一个低容量自编码器以重构归一化频谱。频谱重构保真度高的通道位于自编码器所捕捉的低维流形附近,可被高效压缩;保真度低的通道则保留,因其包含无法被紧凑表示的信息。由此生成重要性评分(可与滤波器L1范数融合),支持简单阈值剪枝,获得结构一致的剪枝网络。在CIFAR-10上训练的VGG16中,固定阈值0.6下,达到90.11% FLOP减少和96.30%参数减少,微调后准确率从93.44%下降1.67个百分点,证明频谱重建保真度是极端压缩下通道冗余的有效代理指标。

原文摘要 · Abstract (English)

We propose Spectral Complex Autoencoder Pruning (SCAP), a reconstruction-based criterion that measures functional redundancy at the level of individual output channels. For each convolutional layer, we construct a complex interaction field by pairing the full multi-channel input activation as the real part with a single output-channel activation (spatially aligned and broadcast across input channels) as the imaginary part. We transform this complex field to the frequency domain and train a low-capacity autoencoder to reconstruct normalized spectra. Channels whose spectra are reconstructed with high fidelity are interpreted as lying close to a low-dimensional manifold captured by the autoencoder and are therefore more compressible; conversely, channels with low fidelity are retained as they encode information that cannot be compactly represented by the learned manifold. This yields an importance score (optionally fused with the filter L1 norm) that supports simple threshold-based pruning and produces a structurally consistent pruned network. On VGG16 trained on CIFAR-10, at a fixed threshold of 0.6, we obtain 90.11% FLOP reduction and 96.30% parameter reduction with an absolute Top-1 accuracy drop of 1.67% from a 93.44% baseline after fine-tuning, demonstrating that spectral reconstruction fidelity of complex interaction fields is an effective proxy for channel-level redundancy under aggressive compression.

模型压缩通道剪枝频域分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。