arXiv:2606.14684cs.CVcs.LG2026-06

用混合教师模型蒸馏出轻量火情分类器,兼顾精度与实时性。

HumP-KD: A Hybrid Uncertainty-Aware Multi-Stage Progressive Knowledge Distillation Framework for Efficient Fire Classification

论文配图:HumP-KD: A Hybrid Uncertainty-Aware Multi-Stage Progressive Knowledge Distillation Framework for Efficient Fire Classification
图 1 · 摘自论文原文
  • 分阶段融合注意力掩码,引导知识蒸馏聚焦关键区域。
  • 在3万张图上达0.9876的平均F1,显著优于基线模型。
  • 模型仅494万参数,37.72帧/秒,适合边缘设备部署。

实时火情分类系统需兼具高精度、低计算开销与边缘部署能力。本文提出HumP-KD框架,利用两个冻结的异构教师模型(Swin-Tiny和ViT-Base)及其元MLP集成,通过三阶段渐进式蒸馏,将知识传递给轻量级MobileViT-S学生模型。该框架包含分层特征构建器,生成融合空间注意力掩码以指导蒸馏至判别区域。在包含31,309张图像的Dataset-II上,模型平均F1得分达0.9876 ± 0.0063,显著优于未蒸馏的MobileViT-S基线(0.9537 ± 0.0351),经独立t检验(p=0.0195)和威尔科克斯符号秩检验(W=1, p=0.0039)确认统计显著性。模型仅含4.94M参数、19.01MB大小,较Swin-Tiny减少5.7倍,较ViT-Base减少17.5倍,且实现37.72 CPU FPS,具备强泛化性与退化视觉条件下的鲁棒性。

原文摘要 · Abstract (English)

Real-time fire classification systems require models that are simultaneously accurate, computationally efficient, and deployable on resource-constrained hardware. This work proposes \textbf{HumP-KD}, a Hybrid Uncertainty-aware Multi-stage Progressive Knowledge Distillation framework for efficient fire classification. Two datasets, FlameVision and Dataset-II, containing 8,600 and 31,309 images, are used. Various CNN and transformer baselines are applied under standard preprocessing, online augmentation, Gaussian noise and motion blur robustness conditions. The proposed HumP-KD model distills knowledge from two frozen heterogeneous transformer teachers, Swin-Tiny and ViT-Base, along with their Meta-MLP ensemble, into a lightweight MobileViT-S student via three tightly integrated components. Hierarchical Progressive Knowledge Distillation employs a Hierarchical Feature Builder. It generates a fused spatial attention mask to guide distillation toward discriminative regions selectively. Multi-Stage Knowledge Distillation progressively activates three distillation stages across training. On Dataset-II, HumP-KD achieves a mean F1 score of $0.9876 \pm 0.0063$ across 10 independent trials, significantly outperforming the MobileViT-S baseline trained without distillation ($0.9537 \pm 0.0351$), with statistical significance confirmed by both independent t-test ($p = 0.0195$) and Wilcoxon signed-rank test ($W = 1$, $p = 0.0039$). The proposed method also demonstrates strong generalization across datasets and robustness under degraded visual conditions. The student model retains only 4.94M parameters and 19.01Mb model size, representing a $5.7\times$ parameter reduction over Swin-Tiny and a $17.5\times$ reduction over ViT-Base, while achieving 37.72 CPU FPS, making it suitable for real-time deployment.

知识蒸馏火情识别轻量化模型边缘部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。