用物理退化模型统一处理多种图像修复任务,速度快效果好。
From Physical Degradation Models to Task-Aware All-in-One Image Restoration
- 基于物理退化建模,预测任务感知的逆退化算子
- 两阶段修复:先恢复再根据不确定性图优化,提升可靠性
- 仅用一个网络实现多任务,适合实时应用
全功能图像修复旨在用单一模型自适应处理多种修复任务。现有方法虽通过提示信息或大模型取得良好效果,但增加的学习模块提高了系统复杂度,限制了实时性。本文从物理退化建模出发,预测任务感知的逆退化算子,实现高效全功能图像修复。框架分为两阶段:第一阶段,预测的逆算子生成初始修复图像及不确定性感知图,突出难以重建区域,保障修复可靠性;第二阶段,在该不确定性图引导下进一步优化修复结果。两个阶段共用同一逆算子预测网络,仅在算子预测后引入任务感知参数以适配不同退化任务。此外,通过加速逆算子卷积运算,提升了效率。提出的紧密集成架构OPIR经实验验证,在全功能修复性能上显著优于现有方法,同时在任务对齐修复任务中仍具竞争力。
原文摘要 · Abstract (English)
All-in-one image restoration aims to adaptively handle multiple restoration tasks with a single trained model. Although existing methods achieve promising results by introducing prompt information or leveraging large models, the added learning modules increase system complexity and hinder real-time applicability. In this paper, we adopt a physical degradation modeling perspective and predict a task-aware inverse degradation operator for efficient all-in-one image restoration. The framework consists of two stages. In the first stage, the predicted inverse operator produces an initial restored image together with an uncertainty perception map that highlights regions difficult to reconstruct, ensuring restoration reliability. In the second stage, the restoration is further refined under the guidance of this uncertainty map. The same inverse operator prediction network is used in both stages, with task-aware parameters introduced after operator prediction to adapt to different degradation tasks. Moreover, by accelerating the convolution of the inverse operator, the proposed method achieves efficient all-in-one image restoration. The resulting tightly integrated architecture, termed OPIR, is extensively validated through experiments, demonstrating superior all-in-one restoration performance while remaining highly competitive on task-aligned restoration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。