聚焦关键帧,用轻量处理提升快速超分辨率效果
Keyframe-Centric State-Space Modeling for Burst Image Super-Resolution
- 分离关键帧与辅助帧计算,主路径专注重建关键帧
- 在三个数据集上达到当前最佳性能,支持长序列扩展
- 适合需要高效图像超分的实时应用或移动设备
突发图像超分辨率(BISR)通过聚合短序列低分辨率帧中的子像素信息来重建高分辨率关键帧。现有方法通常对所有帧使用重型骨干网络或全程保持深度跨帧交互,导致非关键帧冗余计算,且难以随突发长度扩展。本文提出BurstMamba,基于核心原则:将大部分算力分配给关键帧重建,仅用突发帧提取子像素先验。为此,BurstMamba将BISR解耦为高容量关键帧超分流与轻量突发流,二者仅通过阶段残差注入交互。为增强从突发到关键帧的信息传递,提出GAS机制(收集→聚合→散射),仅在对应关系下进行跨帧通信,同时通过残差连接保留原始视图特征;并引入小波条件状态更新,引导选择性路由偏向高频区域。在SyntheticSR、RealBSR-RAW和RealBSR-RGB三个数据集上,BurstMamba均达到最先进水平。大量消融实验证明,提出的计算分离、GAS及小波条件路由均显著提升模型精度与可扩展性。
原文摘要 · Abstract (English)
Burst image super-resolution (BISR) reconstructs a high-resolution keyframe by aggregating complementary sub-pixel evidence from a short burst of low-resolution frames. Existing methods often process all burst frames with heavy backbones or maintain deep cross-frame interaction throughout the network, leading to redundant computation on non-key frames and limiting scalability with burst length. In this work we propose BurstMamba, a BISR architecture built on a simple principle: allocate most compute to reconstructing the keyframe, and process the burst primarily to extract sub-pixel priors. To this end, BurstMamba decouples BISR into a high-capacity keyframe super-resolution stream and a lightweight burst stream that interacts with it only through stage-wise residual injection. To improve burst-to-keyframe transfer, we introduce Gather -> Aggregate -> Scatter (GAS), which uses correspondence only for cross-frame message passing while preserving native-view features through a residual connection, and a wavelet-conditioned state update that biases selective routing toward high-frequency regions. Across SyntheticSR, RealBSR-RAW, and RealBSR-RGB, BurstMamba achieves state-of-the-art results. Extensive ablations show that the proposed compute separation, GAS, and wavelet-conditioned routing each contribute to the model's accuracy and scaling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。