提出多时间尺度液态Mamba,自适应处理图像修复中的复杂退化。
Learning Adaptive Dynamical Features via Multi-$τ$ Liquid-Mamba for All-in-one Image Restoration

- 通过输入感知的多时间尺度离散化,动态调整状态演化速度。
- 在所有任务统一修复中表现最佳,且保持线性计算复杂度。
- 可直接嵌入现有Mamba模型,适合需要统一修复的场景。
图像修复旨在从退化观测中恢复高质量图像。基于Mamba的模型虽能以线性复杂度建模长程依赖,但多数设计依赖单一状态演化时标,难以适应空间异质性和任务相关的退化模式。本文提出多-τ液态Mamba,一种自适应状态空间模块,将输入条件感知的多时标液体离散化引入选择性状态空间建模。该模块不改变整体选择性扫描流程,而是调节多个动力学分支的有效离散步数,并根据退化感知门控权重自适应融合响应。此设计使模型同时捕捉快速变化的局部细节与缓慢演化的全局结构,同时保持Mamba对序列长度的线性扩展特性。重要的是,多-τ液态Mamba在保留原始选择性参数化和硬件高效选择性扫描机制的前提下调节有效转移动态,成为即插即用模块,可无缝集成至现有Mamba架构中。基于此框架,我们构建了多-τ液态Mamba图像修复网络(MLMIR),在广泛修复基准上实验表明,MLMIR在所有任务统一修复中持续达到领先性能,且在任务对齐修复设置中也具有竞争力。
原文摘要 · Abstract (English)
Image restoration aims to recover high-quality images from degraded observations. Recent Mamba-based image restoration models have demonstrated strong potential in modeling long-range dependencies with linear complexity. However, most existing designs still rely on a single state-evolution timescale, which limits their adaptability to spatially heterogeneous and task-dependent degradation patterns in all-in-one image restoration. In this paper, we propose Multi-$τ$ Liquid-Mamba, an adaptive state space module that introduces input-conditioned multi-timescale liquid discretization into selective state space modeling. Instead of changing the overall selective scan pipeline, the proposed module modulates the effective discretization steps of multiple dynamical branches and adaptively fuses their responses according to degradation-aware gating weights. This design allows the model to capture both fast-varying local details and slowly evolving global structures while preserving the linear scaling property of Mamba with respect to sequence length. Importantly, Multi-$τ$ Liquid-Mamba modulates the effective transition dynamics while preserving the original selective parameterization and hardware-efficient selective scan mechanism, making it a plug-and-play module that can be seamlessly integrated into existing Mamba-based architectures. Built upon this framework, we develop a Multi-$τ$ Liquid-Mamba Image Restoration Network (MLMIR) for all-in-one image restoration. Extensive experiments on a wide range of restoration benchmarks demonstrate that MLMIR consistently achieves state-of-the-art performance in all-in-one image restoration while remaining highly competitive in task-aligned restoration settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。