提出GaitKD框架,让小模型高效学习大模型的步态识别能力。
GaitKD: A Universal Decoupled Distillation Framework for Efficient Gait Recognition

- 分两步蒸馏:决策层对齐分类逻辑,边界层保留嵌入空间结构
- 在多个数据集上提升小模型性能,比直接特征回归更稳定
- 支持不同架构师生模型,部署无额外开销,适合边缘设备
步态识别是一种适用于远距离、非接触式身份认证的生物特征技术,但高性能模型通常依赖深层且计算量大的网络结构,难以实际部署。知识蒸馏(KD)可将强教师模型的知识迁移到轻量学生模型,但传统蒸馏在具有部件结构的步态模型中效果不佳,因监督信号来自部件级分类输出和部件级检索嵌入。本文提出GaitKD,一种解耦的蒸馏框架,将步态知识迁移分为两个互补部分:决策层蒸馏与边界层蒸馏。具体而言,通过部件校准的逻辑蒸馏对齐教师与学生模型的类间决策关系,同时采用激活边界目标而非直接特征回归,以保留教师诱导的嵌入空间划分。该方法仅需简单对齐部件设计,即可支持异构师生模型,不增加推理成本。在多个步态识别基准和师生配置下实验表明,其性能持续优于现有强基线。研究还证实两部分蒸馏具有互补性,边界保持型蒸馏比直接特征回归更具稳定性。源代码已公开于https://github.com/liyiersan/GaitKD/
原文摘要 · Abstract (English)
Gait recognition is an attractive biometric modality for long-range and contact-free identification, but high-performing gait models often rely on deep and computationally expensive architectures that are difficult to deploy in practice. Knowledge distillation (KD) offers a natural way to transfer knowledge from a powerful teacher to an efficient student; however, standard KD is often less effective for part-structured gait models, where supervision is formed from both part-wise classification logits and part-wise retrieval embeddings. In this paper, we propose GaitKD, a distillation framework that decouples gait knowledge transfer into two complementary components: decision-level distillation and boundary-level distillation. Specifically, GaitKD aligns the teacher and student through part-calibrated logit distillation to transfer inter-class decision relations, while preserving the teacher-induced partitioning of the embedding space through an activation-boundary objective instead of direct feature regression. With a simple aligned part-wise design, GaitKD supports heterogeneous teacher-student gait models without introducing additional inference cost. Experimental results across multiple gait recognition benchmarks and teacher-student configurations show consistent improvements over strong gait baselines. Our study demonstrates that the two transfer components are complementary, and boundary-preserving distillation provides more stable performance than direct feature regression. Source code is available at https://github.com/liyiersan/GaitKD/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。