arXiv:2608.03100cs.CV2026-08中稿 · ACM MM2026, 16 pag…

动态生成样本并按通道自适应蒸馏,提升动作识别模型压缩效果

Channel-wise Dynamic Knowledge Distillation via Adaptive Sample Generation for Action Recognition

论文配图:Channel-wise Dynamic Knowledge Distillation via Adaptive Sample Generation for Action Recognition
图 1 · 摘自论文原文
  • 根据梯度和频谱差异动态生成新样本,增强师生特征对齐
  • 按通道重要性调整蒸馏强度,在三大数据集上达到最优性能
  • 适合需要高效压缩大模型的动作识别任务

知识蒸馏(KD)为压缩大型动作识别模型提供了有前景但尚未充分探索的路径。现有方法存在两大局限:一是依赖固定输入样本,导致冻结教师模型与可学习学生模型间特征对齐不佳;二是对所有通道采用统一蒸馏强度,未能考虑其在不同训练阶段对运动时序或幅度等知识的重要性差异。为此,我们提出自适应样本感知的通道级动态(ASCD)KD方法,分两阶段进行。第一阶段,通过自适应样本生成模块,结合样本梯度中的语义信息生成更新样本,该梯度由各层通道中心频率差加权的特征损失最小化得到,并利用高斯掩码保留关键运动细节。第二阶段,基于样本梯度和特征频率,采用通道级动态蒸馏模块训练学生模型。为提高效率,样本仅周期性更新而非每轮迭代。在三个视频基准数据集(UCF101、Kinetics-400、Something-Something-v2)和两个图像数据集(CIFAR-100、ImageNet)上的大量实验表明,该方法性能达到当前最优。代码已公开于 https://github.com/mlvccn/ASCD_KD_Action。

原文摘要 · Abstract (English)

Knowledge Distillation (KD) offers a promising yet underexplored path for compressing large action recognition models. However, existing KD methods suffer from two key limitations: 1) reliance on fixed input samples leads to suboptimal feature alignment between the frozen teacher (larger model) and the learnable student (smaller model), and 2) applying a uniform distillation strength for all channels fails to account for their varying importance in capturing distinct knowledge (e.g., motion tempo or magnitude) across training epochs. This motivates us to develop an Adaptive Sample-aware Channel-wise Dynamic (ASCD) KD approach, which operates in two stages. First, we use an adaptive sample generation module to create updated samples by incorporating semantics from sample gradients, which are derived by minimizing a feature loss weighted by channel centroid frequency differences at each layer. Meanwhile, crucial motion-related details are preserved by applying a Gaussian mask to frequency features. Second, we employ a channel-wise dynamic distillation module to train student on these generated samples, guided by sample gradients and feature frequencies. For efficiency, samples are updated periodically rather than per epoch. Extensive experiments on three video benchmarks (UCF101, Kinetics-400, Something-Something-v2) and two image datasets (CIFAR-100, ImageNet) demonstrate the state-of-the-art performance of our method. Code is available at https://github.com/mlvccn/ASCD_KD_Action.

知识蒸馏动作识别动态蒸馏模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。