分而治之的图像修复框架,按病灶类型自动分配专用模型。
Divide and Restore: A Modular Task-Decoupled Framework for Universal Image Restoration
- 输入图像由轻量分类器诊断,路由至对应专用修复模块。
- 支持新增退化类型仅需训练单个专家,无需重训全系统。
- 在普通本地设备上实现多类退化图像高效修复,可扩展性强。
恢复受噪声、模糊或曝光不当等多种退化影响的图像,仍是计算机视觉中的重要挑战。尽管当前趋势倾向于使用复杂的统一架构,但这类模型常因任务间干扰导致性能下降,且需要在高端计算集群上进行大量联合训练。本文提出一种基于显式诊断路由机制的模块化、任务解耦图像修复框架。该架构包含一个轻量级卷积神经网络(CNN)分类器,用于评估输入图像,并动态将其导向特定的修复节点。关键优势在于模型无关的可扩展性:我们以三个独立的U-Net专家为例展示其应用,系统可集成任何针对特定任务定制的修复方法。通过隔离重建路径,该框架避免特征冲突,显著降低训练开销。与整体模型不同,新增退化类型只需训练单一专家并更新路由模块,无需重新训练整个系统。实验结果表明,该计算成本较低的方法可在标准本地硬件上高效实现多退化图像修复。代码将在论文接受后发布。
原文摘要 · Abstract (English)
Restoring images affected by various types of degradation, such as noise, blur, or improper exposure, remains a significant challenge in computer vision. While recent trends favor complex monolithic all-in-one architectures, these models often suffer from negative task interference and require extensive joint training cycles on high-end computing clusters. In this paper, we propose a modular, task-decoupled image restoration framework based on an explicit diagnostic routing mechanism. The architecture consists of a lightweight Convolutional Neural Network (CNN) classifier that evaluates the input image and dynamically directs it to a specialized restoration node. A key advantage of this framework is its model-agnostic extensibility: while we demonstrate it using three independent U-Net experts, the system allows for the integration of any restoration method tailored to specific tasks. By isolating reconstruction paths, the framework prevents feature conflicts and significantly reduces training overhead. Unlike monolithic models, adding new degradation types in our framework only requires training a single expert and updating the router, rather than a full system retraining. Experimental results demonstrate that this computationally accessible approach offers a scalable and efficient solution for multi-degradation restoration on standard local hardware. The code will be published upon paper acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。