arXiv:2606.28112cs.CVcs.AI2026-06

提出双向退化记忆机制,让图像修复模型既提升效果又可解释。

BiDeMem: Bidirectional Degradation Memory for Explainable Image Restoration

  • 用输入特征查询退化记忆库,动态选择关键退化信息。
  • 在多退化场景下比基线高0.2839 dB,且保留可解释性。
  • 适合需要透明化修复过程的研究与工业应用。

退化感知提示、条件和潜在先验在图像修复中日益重要,但通常仅通过峰值信噪比(PSNR)单一指标评估,难以检验语义层面的有效性。一个条件可能仅通过增加容量或利用数据集捷径来提升性能,而非真正作为可解释的退化先验。本文提出BiDeMem,一种用于可解释图像修复的双向退化记忆机制。通过恢复特征和输入统计构建查询,检索记忆槽的紧凑前k个子集;同一选中的槽身份同时支持推理时的修复路径与训练时的前向退化解释路径。研究在可控的多退化NAFNet设置中展开,新设计的对照实验分离了仅修正头、密集查询先验和静态全局先验的贡献:三者分别低于BiRank 0.2588 dB、0.2586 dB 和 0.2839 dB。强残差监督与更宽的退化头仍低于完整双向记忆模型。干预探针显示,BiRank在保持修复质量的同时,增强了对错误先验和原生先验的敏感性,将退化记忆定位为兼具修复功能与可验证解释能力的机制。

原文摘要 · Abstract (English)

Degradation-aware prompts, conditions, and latent priors are increasingly used in image restoration, yet they are usually judged by a single endpoint: whether the restored image obtains higher PSNR. This is a weak test of semantics. A condition can help by adding capacity, acting as a global correction bias, or exploiting dataset shortcuts, without becoming an interpretable degradation prior. We propose BiDeMem, a bidirectional degradation memory for explainable image restoration. A query built from restoration features and input statistics retrieves a compact top-k subset of memory slots. The same selected slot identity supports the restoration path at inference time and a training-only forward-degradation explanation path. The study centers on verifiability in a controlled multi-degradation NAFNet setting. New controls separate the gain from a correction head alone, a dense query prior, and a static global prior: these variants are 0.2588, 0.2586, and 0.2839 dB below BiRank, respectively. Strong residual supervision and a wider degradation head also remain below the full bidirectional memory model. Intervention probes show that BiRank preserves restoration quality while increasing wrong-prior and native-prior sensitivity, framing degradation memory as both a restoration module and a falsifiable explanation mechanism.

图像修复可解释性记忆机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。