arXiv:2511.17242cs.CVcs.LG2025-11中稿 · IEEE EdgeCom 2025

让旋转不变模型更小更快,还能自动修复精度下降。

Equivariant-Aware Structured Pruning for Efficient Edge Deployment: A Comprehensive Framework with Adaptive Fine-Tuning

  • 基于群不变卷积与结构化剪枝,保持旋转不变性的同时压缩模型。
  • 在多个数据集上实现29.3%参数减少,精度损失后自动恢复。
  • 适合卫星图像等需几何鲁棒性的边缘部署场景。

本文提出一种结合群不变卷积神经网络(G-CNN)与不变性感知结构化剪枝的新框架,为资源受限环境生成紧凑且具备变换不变性的模型。通过e2cnn库实现对旋转的C4循环群等变性,确保几何变换下性能稳定并降低计算开销。方法分析e2cnn层结构,对全连接部分进行神经元级剪枝,同时保留等变特性。为缓解精度下降,引入自适应微调机制:当精度下降超过2%时自动触发,采用早停和学习率调度高效恢复。框架集成动态INT8量化及完整流程——训练、知识蒸馏、结构化剪枝、微调与量化。在卫星图像(EuroSAT)和标准基准(CIFAR-10、Rotated MNIST)上验证有效性,实验显示参数减少29.3%,精度显著恢复,证明该方法可在保持几何鲁棒性前提下实现大幅压缩。该流程提供可复现的优化方案,弥合群论网络设计与实际部署之间的差距,特别适用于卫星图像分析与几何视觉任务。

原文摘要 · Abstract (English)

This paper presents a novel framework combining group equivariant convolutional neural networks (G-CNNs) with equivariant-aware structured pruning to produce compact, transformation-invariant models for resource-constrained environments. Equivariance to rotations is achieved through the C4 cyclic group via the e2cnn library,enabling consistent performance under geometric transformations while reducing computational overhead. Our approach introduces structured pruning that preserves equivariant properties by analyzing e2cnn layer structure and applying neuron-level pruning to fully connected components. To mitigate accuracy degradation, we implement adaptive fine-tuning that automatically triggers when accuracy drop exceeds 2%, using early stopping and learning rate scheduling for efficient recovery. The framework includes dynamic INT8 quantization and a comprehensive pipeline encompassing training, knowledge distillation, structured pruning, fine-tuning, and quantization. We evaluate our method on satellite imagery (EuroSAT) and standard benchmarks (CIFAR-10, Rotated MNIST) demonstrating effectiveness across diverse domains. Experimental results show 29.3% parameter reduction with significant accuracy recovery, demonstrating that structured pruning of equivariant networks achieves substantial compression while maintaining geometric robustness. Our pipeline provides a reproducible framework for optimizing equivariant models, bridging the gap between group-theoretic network design and practical deployment constraints, with particular relevance to satellite imagery analysis and geometric vision tasks.

模型压缩等变网络边缘部署剪枝

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。