arXiv:2511.18028cs.CV2025-11TPAMI被引 3

MambaX通过动态状态预测控制提升图像超分辨率精度与稳定性。

MambaX: Image Super-Resolution with State Predictive Control

  • 用动态非线性状态控制替代固定映射,建模中间过程误差
  • 在单图和多模态融合任务中均超越现有方法
  • 适合需要高精度重建与跨模态融合的图像处理场景

图像超分辨率(SR)是突破传感器硬件限制的关键技术。然而,现有方法多聚焦于最终分辨率提升,常忽略中间阶段的误差传播与累积问题。近期,Mamba因其可将重建过程建模为多节点状态序列而受到关注,支持中间干预。但其固定线性映射存在感受野窄、灵活性不足的问题,影响细粒度图像表现。为此,本文提出非线性状态预测控制模型MambaX,将连续光谱带映射至潜在状态空间,并通过动态学习控制方程的非线性状态参数,泛化超分辨率任务。相比现有序列模型,MambaX:1)采用动态状态预测控制学习,逼近状态空间模型的非线性微分系数;2)引入新型状态交叉控制范式,实现多模态超分辨率融合;3)使用渐进式过渡学习,缓解领域与模态偏移带来的异质性。实验表明,该动态光谱-状态表示模型在单图超分辨率和基于多模态融合的超分辨率任务中均表现优异,展现出在任意维度与模态下推进光谱泛化建模的巨大潜力。

原文摘要 · Abstract (English)

Image super-resolution (SR) is a critical technology for overcoming the inherent hardware limitations of sensors. However, existing approaches mainly focus on directly enhancing the final resolution, often neglecting effective control over error propagation and accumulation during intermediate stages. Recently, Mamba has emerged as a promising approach that can represent the entire reconstruction process as a state sequence with multiple nodes, allowing for intermediate intervention. Nonetheless, its fixed linear mapper is limited by a narrow receptive field and restricted flexibility, which hampers its effectiveness in fine-grained images. To address this, we created a nonlinear state predictive control model \textbf{MambaX} that maps consecutive spectral bands into a latent state space and generalizes the SR task by dynamically learning the nonlinear state parameters of control equations. Compared to existing sequence models, MambaX 1) employs dynamic state predictive control learning to approximate the nonlinear differential coefficients of state-space models; 2) introduces a novel state cross-control paradigm for multimodal SR fusion; and 3) utilizes progressive transitional learning to mitigate heterogeneity caused by domain and modality shifts. Our evaluation demonstrates the superior performance of the dynamic spectrum-state representation model in both single-image SR and multimodal fusion-based SR tasks, highlighting its substantial potential to advance spectrally generalized modeling across arbitrary dimensions and modalities.

图像超分辨率状态空间模型多模态融合Mamba

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。