提出动态演化框架,让视频压缩感知重建更高效
Differential Unfolding: Efficient Unfolding Reconstruction for Video Snapshot Compressive Imaging

- 用差异演化机制替代重复结构,分阶段处理特征生成与优化
- 在保持高精度的同时,计算量大幅降低,实现效率与质量双赢
- 适合追求实时视频重建的科研与工业应用
尽管深度展开网络(DUNs)主导视频快照压缩感知(SCI),但其仍受限于统一设计范式。现有方法反复堆叠相同结构的高复杂度先验,忽略了优化轨迹趋向静态的事实,导致表征停滞,高成本计算仅带来微小特征更新。为此,本文提出差异展开(DU),一种异构框架,以动态演化替代均匀重复。核心是差异演化框架(DEF),将展开过程分为结构锚定与差异演化两部分:高参数通用阶段稀疏部署,构建高质量特征基础;轻量级差异阶段则通过差异表示先验(DRP)利用差分机制传播并精炼这些基础特征。结合差异演化注意力(DRA)与差分调制前馈网络(DM-FFN),DRP以极小开销有效建模跨阶段变化。通过聚焦动态演化而非静态冗余,DU在准确率与效率间取得更优平衡。大量实验验证,该方法在显著降低计算开销的同时,达到新最佳性能。
原文摘要 · Abstract (English)
While Deep Unfolding Networks (DUNs) dominate video Snapshot Compressive Imaging (SCI), they remain constrained by a uniform design philosophy. Existing methods repeatedly stack high-complexity priors with identical structures, ignoring the fact that optimization trajectories converge toward static states. This results in representation stagnation, where high-cost computations are wasted on minimal feature updates. To address this inefficiency, we present Differential Unfolding (DU), a heterogeneous framework that replaces uniform repetition with dynamic evolution. Central to DU is the Differential Evolutionary Framework (DEF), which partitions the unfolding process into two complementary roles: structural anchoring and differential evolution. In this scheme, high-parameter general stages are sparsely deployed to generate high-fidelity feature foundations. Complementing these, lightweight differential stages employ a Differential Representation Prior (DRP) to propagate and refine these foundational features through a differential mechanism. By integrating Differential Representation Attention (DRA) for evolving attention maps and a Differential Modulated FFN (DM-FFN) for feature rectification, DRP effectively models cross-stage variations with minimal overhead. By focusing computational resources on dynamic evolution rather than static redundancy, DU achieves a superior trade-off between accuracy and efficiency. Extensive experiments verify that our method establishes new state-of-the-art results while significantly slashing computational overhead. https://github.com/Muyuan-Zhang/DU
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。