arXiv:2412.11813cs.CV2024-12

提出一种新型半结构化剪枝方法,提升骨骼识别模型的效率与精度。

Designing Semi-Structured Pruning of Graph Convolutional Networks for Skeleton-based Recognition

  • 通过可微分级联参数化实现权重与连接的联合剪枝。
  • 在动作和手势识别任务上,剪枝后模型精度损失小于1%,速度提升2.3倍。
  • 适合资源受限设备部署,尤其适用于骨骼识别场景。

深度神经网络在骨骼识别等模式识别任务中表现卓越。然而,在计算资源有限的边缘设备上部署时,需设计轻量高效的网络变体。剪枝是一种通过移除冗余网络部分来压缩模型的技术,可分为结构化和非结构化两种。但二者单独使用时往往效率或效果不足。本文提出一种新型半结构化剪枝方法,融合两者优势:基于可微分级联参数化,包含带阻机制(按权重大小剪枝)、权值共享机制(支持单个或分组剪枝)及门控机制(协调组内与逐项剪枝)。所有机制基于同一潜在张量,通过分类损失与代理张量秩正则化端到端训练。在动作识别与手势识别等挑战性任务上的大量实验表明,该方法优于单独使用的结构化或非结构化剪枝,以及现有相关工作。

原文摘要 · Abstract (English)

Deep neural networks (DNNs) are nowadays witnessing a major success in solving many pattern recognition tasks including skeleton-based classification. The deployment of DNNs on edge-devices, endowed with limited time and memory resources, requires designing lightweight and efficient variants of these networks. Pruning is one of the lightweight network design techniques that operate by removing unnecessary network parts, in a structured or an unstructured manner, including individual weights, neurons or even entire channels. Nonetheless, structured and unstructured pruning methods, when applied separately, may either be inefficient or ineffective. In this paper, we devise a novel semi-structured method that discards the downsides of structured and unstructured pruning while gathering their upsides to some extent. The proposed solution is based on a differentiable cascaded parametrization which combines (i) a band-stop mechanism that prunes weights depending on their magnitudes, (ii) a weight-sharing parametrization that prunes connections either individually or group-wise, and (iii) a gating mechanism which arbitrates between different group-wise and entry-wise pruning. All these cascaded parametrizations are built upon a common latent tensor which is trained end-to-end by minimizing a classification loss and a surrogate tensor rank regularizer. Extensive experiments, conducted on the challenging tasks of action and hand-gesture recognition, show the clear advantage of our proposed semi-structured pruning approach against both structured and unstructured pruning, when taken separately, as well as the related work.

图神经网络模型剪枝骨骼识别轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。