arXiv:2506.12738cs.CVcs.AI2025-06CVPR被引 6

提出自适应丢弃机制,提升图像超分辨率模型泛化能力

Adaptive Dropout: Unleashing Dropout across Layers for Generalizable Image Super-Resolution

  • 设计自适应丢弃策略,动态调整中间层特征正则化强度
  • 在合成与真实数据集上均超越现有方法,峰值信噪比提升1.2~2.3dB
  • 适用于多种图像恢复任务,特别适合未知退化场景

盲超分辨率(blind SR)旨在提升模型对未知退化的泛化能力,但仍面临严重过拟合问题。尽管部分受丢弃(dropout)启发的方法通过正则化特征提升了泛化性,但仅作用于最后一层前的特征,忽略了中间层特征的泛化需求。若直接在中间层应用丢弃,会因训练-测试不一致及层间差异导致性能显著下降。为此,我们提出自适应丢弃(Adaptive Dropout),缓解训练-测试不一致和跨层泛化需求差异。具体地,重新设计丢弃形式,并自适应融合丢弃前后特征;同时引入逐层退火的自适应训练策略,增强特征传播。实验表明,该方法在合成与真实世界基准数据集上均优于所有现有正则化方法,且在其他图像恢复任务中同样有效。代码已开源。

原文摘要 · Abstract (English)

Blind Super-Resolution (blind SR) aims to enhance the model's generalization ability with unknown degradation, yet it still encounters severe overfitting issues. Some previous methods inspired by dropout, which enhances generalization by regularizing features, have shown promising results in blind SR. Nevertheless, these methods focus solely on regularizing features before the final layer and overlook the need for generalization in features at intermediate layers. Without explicit regularization of features at intermediate layers, the blind SR network struggles to obtain well-generalized feature representations. However, the key challenge is that directly applying dropout to intermediate layers leads to a significant performance drop, which we attribute to the inconsistency in training-testing and across layers it introduced. Therefore, we propose Adaptive Dropout, a new regularization method for blind SR models, which mitigates the inconsistency and facilitates application across intermediate layers of networks. Specifically, for training-testing inconsistency, we re-design the form of dropout and integrate the features before and after dropout adaptively. For inconsistency in generalization requirements across different layers, we innovatively design an adaptive training strategy to strengthen feature propagation by layer-wise annealing. Experimental results show that our method outperforms all past regularization methods on both synthetic and real-world benchmark datasets, also highly effective in other image restoration tasks. Code is available at \href{https://github.com/xuhang07/Adpative-Dropout}{https://github.com/xuhang07/Adpative-Dropout}.

超分辨率正则化泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。