arXiv:2510.14463cs.CV2025-10中稿 · WI-IAT 2025被引 1

通过迭代剪枝压缩多任务图像修复模型,仅用10%参数保持高性能。

Pruning Overparameterized Multi-Task Networks for Degraded Web Image Restoration

  • 采用迭代剪枝+权重重置策略,挖掘稀疏子网络。
  • 在去雨、去雾、去噪任务上仅保留10%参数仍达先进性能。
  • 适合需要轻量级部署的图像修复应用开发者。

图像质量是网页平台呈现视觉吸引力内容的关键因素。然而,由于在线社交网络(OSNs)的有损操作,图像常出现退化,影响用户体验。图像修复旨在从退化输入中恢复出高质量的清晰图像。近年来,能够同时处理多种退化类型的多任务(全功能)图像修复模型受到广泛关注。但这类模型通常具有过多可训练参数,计算效率低下。本文提出一种压缩多任务图像修复模型的方法。目标是在过参数化深度模型中发现高度稀疏的子网络,使其性能可媲美甚至超越原始密集模型。所提模型MIR-L采用迭代剪枝策略,在多轮中移除低幅值权重,并将剩余权重重置为初始值。该过程对多任务图像修复模型优化至关重要,有效发掘出‘胜者彩票’(winning tickets),在高稀疏度下维持或超越当前最优表现。在去雨、去雾、去噪基准数据集上的实验表明,MIR-L仅保留10%的可训练参数,同时保持高图像修复性能。代码、数据集及预训练模型已公开于https://github.com/Thomkat/MIR-L。

原文摘要 · Abstract (English)

Image quality is a critical factor in delivering visually appealing content on web platforms. However, images often suffer from degradation due to lossy operations applied by online social networks (OSNs), negatively affecting user experience. Image restoration is the process of recovering a clean high-quality image from a given degraded input. Recently, multi-task (all-in-one) image restoration models have gained significant attention, due to their ability to simultaneously handle different types of image degradations. However, these models often come with an excessively high number of trainable parameters, making them computationally inefficient. In this paper, we propose a strategy for compressing multi-task image restoration models. We aim to discover highly sparse subnetworks within overparameterized deep models that can match or even surpass the performance of their dense counterparts. The proposed model, namely MIR-L, utilizes an iterative pruning strategy that removes low-magnitude weights across multiple rounds, while resetting the remaining weights to their original initialization. This iterative process is important for the multi-task image restoration model's optimization, effectively uncovering "winning tickets" that maintain or exceed state-of-the-art performance at high sparsity levels. Experimental evaluation on benchmark datasets for the deraining, dehazing, and denoising tasks shows that MIR-L retains only 10% of the trainable parameters while maintaining high image restoration performance. Our code, datasets and pre-trained models are made publicly available at https://github.com/Thomkat/MIR-L.

图像修复模型剪枝多任务学习轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。