arXiv:2606.24479cs.CV2026-06中稿 · ECCV

用状态空间模型高效重建4K原始图像,速度更快、质量更高。

MambaRaw: Selective State Space Modeling for Efficient 4K Raw Image Reconstruction

论文配图:MambaRaw: Selective State Space Modeling for Efficient 4K Raw Image Reconstruction
图 1 · 摘自论文原文
  • 用轻量模块仅处理信息密集块,提升计算效率
  • 在低码率下提升1.2-1.4 dB PSNR,编码延迟降9%
  • 适合需要高速高质图像重建的手机相机场景

相机中的JPEG预览在原始图像格式中广泛存在,以极低存储成本提供sRGB参考。尽管现有基于元数据的重建框架可利用这一附加信息恢复原始图像,但其上下文建模在高分辨率(如4K)下因注意力机制随特征图呈二次增长而变得计算昂贵,限制了实际应用。为此,我们提出MambaRaw,一种基于JPEG条件的元数据驱动原始图像重建框架,采用状态空间模型(SSMs)高效估计熵参数。核心贡献包括两个轻量级模块:(1) TileMambaBlock,仅对信息密集区域进行类Mamba的选择性扫描,提升效率;(2) Energy-Aware Refinement(EAR),一个身份初始化的残差模块,增强特征表示以匹配原始信号的长尾能量分布。在三个相机数据集(Sony、Olympus、Samsung)上的大量实验表明,该方法持续优于强基线,为JPEG引导的原始图像重建树立新基准,且效率极高。特别地,在低元数据比特率下,PSNR提升1.2–1.4 dB,端到端编码延迟降低约9%。代码已开源:https://github.com/Peizeli1/MambaRaw。

原文摘要 · Abstract (English)

In-camera JPEG previews are ubiquitous in raw image formats and provide an sRGB reference at negligible storage cost. Although existing metadata-based reconstruction frameworks can exploit this side information when recovering raw images, their context models often become computationally expensive especially at high resolution, eg, 4K raw image, given that attention mechanisms scale quadratically with feature maps, hindering its practical application. To address these limitations, we propose MambaRaw, a JPEG-conditioned metadata-based raw image reconstruction framework that uses State Space Models (SSMs) to estimate entropy parameters efficiently. Our key contribution comprises a Spatial-Energy Coupled Context Modeling mechanism with two lightweight modules: (1) TileMambaBlock, which performs Mamba-style selective scanning only on information-dense tiles to improve the efficiency; and (2) Energy-Aware Refinement (EAR), an identity-initialized residual module that enhance feature representation to match the long-tail energy distribution of raw signals. Extensive experiments on three camera datasets (Sony, Olympus, Samsung) show consistent improvements over strong metadata-based baselines and set a new state of the art for JPEG-guided raw reconstruction with great efficiency. Notably, at low metadata bitrates, MambaRaw increases PSNR by 1.2--1.4 dB and reduces end-to-end coding latency by about 9%. Code is released at https://github.com/Peizeli1/MambaRaw.

图像重建状态空间模型4K图像JPEG压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。