arXiv:2603.07489cs.CV2026-03

提出RobustSCI,让快照压缩成像从重建转为真实场景还原。

RobustSCI: Beyond Reconstruction to Restoration for Snapshot Compressive Imaging under Real-World Degradations

  • 设计双分支网络,分别处理模糊与低频增强,分离去除退化
  • 在模拟和真实退化数据上均超越现有方法,峰值提升1.2dB
  • 适合实际弱光、运动模糊场景下的视频恢复应用

深度学习在视频快照压缩成像(SCI)中表现优异,但主要针对干净测量数据。现实中信号常受运动模糊和低光严重退化,导致现有模型在实际中失效。为此,我们首次提出鲁棒视频SCI复原任务,目标从“重建”转向“还原”——从退化测量中恢复原始清晰画面。我们基于DAVIS 2017数据集构建大规模退化基准,模拟连续真实退化。提出RobustSCI网络,增强编码器-解码器骨干,引入新型RobustCFormer模块,包含多尺度去模糊分支与频率增强分支,显式分离并消除退化。进一步提出RobustSCI-C,集成预训练轻量级后处理去模糊网络,仅增加少量开销即显著提升性能。大量实验表明,所提方法在新退化测试集上优于所有当前最优模型,真实退化数据验证也确认其实用性,使SCI真正实现从“重建所拍”到“还原所发生”的跨越。

原文摘要 · Abstract (English)

Deep learning algorithms for video Snapshot Compressive Imaging (SCI) have achieved great success, yet they predominantly focus on reconstructing from clean measurements. This overlooks a critical real-world challenge: the captured signal itself is often severely degraded by motion blur and low light. Consequently, existing models falter in practical applications. To break this limitation, we pioneer the first study on robust video SCI restoration, shifting the goal from "reconstruction" to "restoration"--recovering the underlying pristine scene from a degraded measurement. To facilitate this new task, we first construct a large-scale benchmark by simulating realistic, continuous degradations on the DAVIS 2017 dataset. Second, we propose RobustSCI, a network that enhances a strong encoder-decoder backbone with a novel RobustCFormer block. This block introduces two parallel branches--a multi-scale deblur branch and a frequency enhancement branch--to explicitly disentangle and remove degradations during the recovery process. Furthermore, we introduce RobustSCI-C (RobustSCI-Cascade), which integrates a pre-trained Lightweight Post-processing Deblurring Network to significantly boost restoration performance with minimal overhead. Extensive experiments demonstrate that our methods outperform all SOTA models on the new degraded testbeds, with additional validation on real-world degraded SCI data confirming their practical effectiveness, elevating SCI from merely reconstructing what is captured to restoring what truly happened.

压缩成像去模糊视频恢复鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。