arXiv:2608.23799cs.CVcs.AI2026-08

新旧图像退化持续学习,不遗忘历史,仅用轻量适配器实现高效恢复

Restoring Without Forgetting: Continual Learning Across Image Degradations

论文配图:Restoring Without Forgetting: Continual Learning Across Image Degradations
图 1 · 摘自论文原文
  • 为新增退化设计轻量适配器,避免重训练与灾难性遗忘
  • 在五类退化序列上,比直接微调提升15.25 dB(Restormer)和11.83 dB(NAFNet)
  • 无需标签即可自动路由,适用于真实场景中未知退化的图像修复

图像恢复近期进展趋向于统一架构,单个网络同时处理多种退化。这类方法在静态基准上有效,但假设训练时能同时访问所有退化类型,属于封闭世界设定。实际部署中,退化随环境逐步出现,历史数据常因隐私或存储限制无法获取。新增退化需重新训练全部数据(成本高)或微调(引发灾难性遗忘)。本文将多退化图像恢复建模为持续领域增量学习问题,退化逐次到来且历史数据不可用。提出的RwF框架为每种新退化学习轻量适配器,从构造上消除遗忘,成本仅为专用网络的极小部分。为隔离退化学习与数据变化,构建包含五类退化域、共享图像内容的基准。测试时,无监督路由机制可识别未知输入的恢复路径,无需领域标签。在五域序列上,RwF相比朴素序列微调,在Restormer和NAFNet骨干上分别提升15.25 dB和11.83 dB。该框架在11个典型真实退化基准(3,465张图像)上实现89.5%路由准确率,仅产生+0.94 dB的最优基线差距,首次建立持续多退化图像恢复的系统性基准。

原文摘要 · Abstract (English)

Recent progress in image restoration has converged on all-in-one architectures that jointly handle multiple degradations within a single network. These methods are effective on static benchmarks but target a closed-world setting that assumes simultaneous access to every target degradation at training time. In practice, degradations are encountered sequentially as field-deployed systems progressively face new environmental conditions, and historical training data is often unavailable due to privacy or storage constraints. Accommodating a new degradation then requires either retraining on the union of all prior data, which is often costly or infeasible, or fine-tuning, which causes catastrophic forgetting. We formulate multi-degradation image restoration as a continual domain-incremental learning problem, in which degradations arrive incrementally and prior data is unavailable. Our proposed Restoring without Forgetting (RwF) framework learns a lightweight adapter for each new degradation, eliminating forgetting by construction at a fraction of the cost of dedicated per-domain networks. To isolate degradation learning from dataset variation, we construct a benchmark spanning five degradation domains under shared image content. At test time, an unsupervised routing mechanism identifies the appropriate restoration path for unknown inputs without requiring domain labels. Across the five-domain sequence, RwF improves final average PSNR over naive sequential fine-tuning by 15.25 dB and 11.83 dB on the Restormer and NAFNet backbones, respectively. The framework transfers to eleven canonical real-degradation benchmarks (3,465 images) at 89.5% routing accuracy with only a +0.94 dB oracle PSNR gap, establishing, to our knowledge, the first systematic baseline for continual multi-degradation image restoration.

图像恢复持续学习退化建模轻量适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。