arXiv:2506.11768cs.CV2025-06被引 1

用动态扫描机制提升视频超分,兼顾精度与效率

MambaVSR: Content-Aware Scanning State Space Model for Video Super-Resolution

  • 引入内容感知扫描机制,动态对齐跨帧相似内容
  • 在REDS数据集上比基于Transformer的方法高0.58dB PSNR,参数减少55%
  • 适合追求高效高精度视频超分的工程师和研究者

视频超分辨率(VSR)面临如何有效建模错位帧间非局部依赖关系,同时保持计算效率的挑战。现有方法多依赖光流或Transformer架构,在大运动位移和长序列下表现受限。为此,我们提出MambaVSR,首个用于VSR的状态空间模型框架,引入创新的内容感知扫描机制。不同于传统视觉Mamba的固定一维序列处理,MambaVSR通过共享指南针构建(SCC)和内容感知序列化(CAS)实现动态时空交互。SCC模块利用高效稀疏注意力构建帧内语义连接图,并通过谱聚类生成自适应空间扫描序列;基于SCC,CAS模块沿学习到的空间顺序交错整合多帧时序特征,实现非局部内容对齐与聚合。为融合全局依赖与局部细节,全局-局部状态空间块(GLSSB)协同集成窗口自注意力与基于SSM的特征传播,实现在全局依赖引导下的高频细节恢复。大量实验验证其优越性:在REDS数据集上,相比Transformer方法提升0.58 dB PSNR,参数量减少55%。

原文摘要 · Abstract (English)

Video super-resolution (VSR) faces critical challenges in effectively modeling non-local dependencies across misaligned frames while preserving computational efficiency. Existing VSR methods typically rely on optical flow strategies or transformer architectures, which struggle with large motion displacements and long video sequences. To address this, we propose MambaVSR, the first state-space model framework for VSR that incorporates an innovative content-aware scanning mechanism. Unlike rigid 1D sequential processing in conventional vision Mamba methods, our MambaVSR enables dynamic spatiotemporal interactions through the Shared Compass Construction (SCC) and the Content-Aware Sequentialization (CAS). Specifically, the SCC module constructs intra-frame semantic connectivity graphs via efficient sparse attention and generates adaptive spatial scanning sequences through spectral clustering. Building upon SCC, the CAS module effectively aligns and aggregates non-local similar content across multiple frames by interleaving temporal features along the learned spatial order. To bridge global dependencies with local details, the Global-Local State Space Block (GLSSB) synergistically integrates window self-attention operations with SSM-based feature propagation, enabling high-frequency detail recovery under global dependency guidance. Extensive experiments validate MambaVSR's superiority, outperforming the Transformer-based method by 0.58 dB PSNR on the REDS dataset with 55% fewer parameters.

视频超分状态空间模型动态扫描高效建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。