提出双流谱解耦蒸馏方法,提升遥感目标检测轻量化效果。
Dual-Stream Spectral Decoupling Distillation for Remote Sensing Object Detection
- 基于小波变换分解光谱特征,分离显式与隐式知识
- 在DIOR上使RetinaNet的AP50提升4.2%,Faster R-CNN提升3.8%
- 适合处理密集小目标的遥感检测场景
知识蒸馏是一种高效且硬件友好的轻量化方法,在遥感目标检测中发挥关键作用。然而,现有蒸馏方法常因遥感图像中特征混合问题,忽略细微特征差异带来的偏差,导致知识混淆。为此,我们提出一种架构无关的蒸馏方法——双流谱解耦蒸馏(DS2D2),适用于通用遥感目标检测任务。首先,通过一阶小波变换进行光谱分解,保留遥感图像的关键空间特征;在此基础上设计密度无关尺度权重(DISW),解决遥感图像中密集与小目标检测难题。其次,揭示学生模型与教师模型间细微特征差异中隐藏的隐式知识,这些知识在检测头激活后显著影响预测结果。通过全频段与高频放大器提取此类差异,并映射为预测偏差。在DIOR和DOTA数据集上的大量实验验证了该方法的有效性:在DIOR数据集上,DS2D2使RetinaNet的AP50提升4.2%,Faster R-CNN提升3.8%,优于现有蒸馏方法。代码将公开于https://github.com/PolarAid/DS2D2。
原文摘要 · Abstract (English)
Knowledge distillation is an effective and hardware-friendly method, which plays a key role in lightweighting remote sensing object detection. However, existing distillation methods often encounter the issue of mixed features in remote sensing images (RSIs), and neglect the discrepancies caused by subtle feature variations, leading to entangled knowledge confusion. To address these challenges, we propose an architecture-agnostic distillation method named Dual-Stream Spectral Decoupling Distillation (DS2D2) for universal remote sensing object detection tasks. Specifically, DS2D2 integrates explicit and implicit distillation grounded in spectral decomposition. Firstly, the first-order wavelet transform is applied for spectral decomposition to preserve the critical spatial characteristics of RSIs. Leveraging this spatial preservation, a Density-Independent Scale Weight (DISW) is designed to address the challenges of dense and small object detection common in RSIs. Secondly, we show implicit knowledge hidden in subtle student-teacher feature discrepancies, which significantly influence predictions when activated by detection heads. This implicit knowledge is extracted via full-frequency and high-frequency amplifiers, which map feature differences to prediction deviations. Extensive experiments on DIOR and DOTA datasets validate the effectiveness of the proposed method. Specifically, on DIOR dataset, DS2D2 achieves improvements of 4.2% in AP50 for RetinaNet and 3.8% in AP50 for Faster R-CNN, outperforming existing distillation approaches. The source code will be available at https://github.com/PolarAid/DS2D2.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。