用强化学习动态分配知识蒸馏力度,提升低比特图像修复效果。
SPARK: Spatial Policy-driven Adaptive Reinforcement learning for Knowledge distillation
- 通过四个难度信号构建轻量策略网络,自适应生成空间权重图。
- 在多种学生模型上超越现有方法,逼近全精度教师性能。
- 无需修改架构,无推理开销,适用于任意量化训练流程。
低比特量化使图像修复(IR)模型可在资源受限设备上部署,但引入的舍入噪声会严重破坏边缘和细纹理等高频区域。现有知识蒸馏(KD)方法对所有空间位置施加相同的蒸馏信号,忽略了图像区域间重建难度差异。为此,我们提出SPARK(Spatial Policy-driven Adaptive Reinforcement Learning for Knowledge Distillation),一种基于轻量强化学习策略网络的自适应蒸馏框架。每轮训练中,难度特征提取器计算拉普拉斯方差、像素方差、学生重建误差与师生知识差距四类信号,输入紧凑策略卷积网络,生成随机空间权重图以调节量化感知训练(QAT)中的蒸馏损失。SPARK与任务无关,不增加推理开销,可无缝集成至任意现有QAT流程。在基准数据集上的实验表明,其在多种学生模型上持续优于PTQ、QAT及当前最先进(SOTA)KD方法,在显著计算约束下实现最接近全精度教师的重建质量。
原文摘要 · Abstract (English)
Low-bit quantization enables deployment of image restoration (IR) networks on resource-constrained devices, but introduces rounding noise that disproportionately degrades high-frequency regions such as edges and fine textures. Existing knowledge distillation (KD) methods apply distillation signals uniformly across all spatial locations, overlooking the varying reconstruction difficulty across image regions. To address this, we propose SPARK (Spatial Policy-driven Adaptive Reinforcement Learning for Knowledge Distillation), a framework that adaptively allocates distillation effort using a lightweight reinforcement learning (RL) policy network. At each training step, a difficulty feature extractor computes four signals, namely Laplacian variance, pixel variance, student reconstruction error, and teacher-student knowledge gap, which are fed into a compact policy CNN that produces a stochastic spatial weight map to modulate the KD loss during quantization-aware training (QAT). SPARK is IR task-agnostic, adds no inference cost, and integrates into any existing QAT pipeline without architectural changes. Experiments on benchmark datasets demonstrate that SPARK consistently outperforms PTQ, QAT, and state-of-the-art (SOTA) KD approaches across multiple student architectures, achieving reconstruction quality closest to the full-precision teacher under significant computational constraints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。