arXiv:2511.06172cs.CVcs.AI2025-11AAAI被引 2

用新数据集和Mamba模型提升老戏曲视频画质,尤其擅长处理大动作场景。

MambaOVSR: Multiscale Fusion with Global Motion Modeling for Chinese Opera Video Super-Resolution

  • 引入多尺度交替扫描的全局融合模块,建模长距离运动信息
  • 在自研戏曲视频数据集上,平均PSNR比现有方法高1.86 dB
  • 适合修复有大幅动作的老式戏曲录像,研究者可下载代码数据

中国戏曲是珍贵的古典艺术遗产,但上世纪拍摄设备限制导致许多名家表演视频质量下降(如低帧率、低分辨率),影响档案保存。尽管时空视频超分(STVSR)已有进展,直接应用于戏曲视频仍面临挑战:数据集稀缺难以恢复高频细节,现有方法缺乏全局建模能力,处理戏曲特有的大范围运动时视觉质量不佳。为此,我们首次构建大规模中文戏曲视频片段数据集COVC,并提出基于Mamba的多尺度融合网络——MambaOVSR。该模型包含三个创新组件:全局融合模块(GFM)通过多尺度交替扫描实现运动建模;多尺度协同Mamba模块(MSMM)支持不同序列长度的对齐;MambaVR块则缓解对齐过程中的特征伪影与位置信息丢失问题。在COVC数据集上的实验表明,MambaOVSR相比当前最优的STVSR方法,在PSNR指标上平均提升1.86 dB。数据集与代码将公开发布。

原文摘要 · Abstract (English)

Chinese opera is celebrated for preserving classical art. However, early filming equipment limitations have degraded videos of last-century performances by renowned artists (e.g., low frame rates and resolution), hindering archival efforts. Although space-time video super-resolution (STVSR) has advanced significantly, applying it directly to opera videos remains challenging. The scarcity of datasets impedes the recovery of high frequency details, and existing STVSR methods lack global modeling capabilities, compromising visual quality when handling opera's characteristic large motions. To address these challenges, we pioneer a large scale Chinese Opera Video Clip (COVC) dataset and propose the Mamba-based multiscale fusion network for space-time Opera Video Super-Resolution (MambaOVSR). Specifically, MambaOVSR involves three novel components: the Global Fusion Module (GFM) for motion modeling through a multiscale alternating scanning mechanism, and the Multiscale Synergistic Mamba Module (MSMM) for alignment across different sequence lengths. Additionally, our MambaVR block resolves feature artifacts and positional information loss during alignment. Experimental results on the COVC dataset show that MambaOVSR significantly outperforms the SOTA STVSR method by an average of 1.86 dB in terms of PSNR. Dataset and Code will be publicly released.

视频超分戏曲修复Mamba多尺度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。