无需提示词,自动识别图像退化类型并精准修复
Degradation-Aware All-in-One Image Restoration via Latent Prior Encoding
- 通过隐空间先验学习自动推断退化特征,不依赖外部提示
- 在六类退化任务上平均提升1.68 dB,效率是SOTA的三倍
- 适合处理复杂混合退化,尤其适用于真实场景图像修复
真实图像常面临雾霾、雨雪、低光照等空间异质性退化,严重影响视觉质量与下游任务。现有全功能修复(AIR)方法依赖外部文本提示或人工设计的结构先验(如频域启发式),导致假设僵硬,泛化能力弱。为此,我们提出将AIR重构为可学习的隐空间先验推理:从输入中自动推断退化感知表示,无需显式任务提示。基于该先验,构建结构化推理范式:(1)选择哪些特征进行路由(自适应特征选择),(2)在何处修复(空间定位),(3)修复什么内容(退化语义)。设计轻量级解码模块,高效利用这些隐编码线索实现空间自适应修复。在六类常见退化任务、五种复合场景及未见过的退化上广泛实验表明,本方法优于当前最先进方法,平均PSNR提升1.68 dB,同时效率高出三倍。
原文摘要 · Abstract (English)
Real-world images often suffer from spatially diverse degradations such as haze, rain, snow, and low-light, significantly impacting visual quality and downstream vision tasks. Existing all-in-one restoration (AIR) approaches either depend on external text prompts or embed hand-crafted architectural priors (e.g., frequency heuristics); both impose discrete, brittle assumptions that weaken generalization to unseen or mixed degradations. To address this limitation, we propose to reframe AIR as learned latent prior inference, where degradation-aware representations are automatically inferred from the input without explicit task cues. Based on latent priors, we formulate AIR as a structured reasoning paradigm: (1) which features to route (adaptive feature selection), (2) where to restore (spatial localization), and (3) what to restore (degradation semantics). We design a lightweight decoding module that efficiently leverages these latent encoded cues for spatially-adaptive restoration. Extensive experiments across six common degradation tasks, five compound settings, and previously unseen degradations demonstrate that our method outperforms state-of-the-art (SOTA) approaches, achieving an average PSNR improvement of 1.68 dB while being three times more efficient.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。