arXiv:2605.27024cs.CVcs.MM2026-05

专为屏幕内容视频设计神经表示,提升压缩效率与实时性。

NeR-SC: Adapting Neural Video Representation to Screen Content

论文配图:NeR-SC: Adapting Neural Video Representation to Screen Content
图 1 · 摘自论文原文
  • 引入可学习颜色调色板和注意力门控融合机制,适配屏幕视频特征。
  • 在DSCVC和VCD数据集上达到40.32~41.73dB PSNR,低码率下优于H.264/265。
  • 帧跳过策略实现无损实时解码,适合云游戏、远程教学等场景。

隐式神经表示已成为视频压缩的有前景范式,现有方法在自然视频上表现良好。然而屏幕内容视频(常见于远程桌面、在线教育、云游戏)具有鲜明特征:锐利边缘、有限色域和强时序冗余。现有神经表示方法针对自然场景设计,缺乏利用这些特性的机制,改进空间广阔。本文提出专为屏幕内容视频优化的NeR-SC框架,基于SNeRV架构,引入三项针对性模块:(i) 可学习颜色调色板,通过限制低频子带仅取学习到的颜色集,建模屏幕内容的离散色彩结构;(ii) 多门控密集融合模块,以注意力门控的跨阶段密集交互替代顺序特征融合;(iii) 嵌入级帧跳过策略,在静态帧上跳过冗余解码器调用,零训练开销。在DSCVC和VCD数据集上的实验表明,NeR-SC平均PSNR达40.32~41.73dB,超越代表性神经视频表示方法,且在低码率下优于H.264和H.265。帧跳过策略实现无质量损失的实时解码。

原文摘要 · Abstract (English)

Implicit neural representations have emerged as a promising paradigm for video compression, with recent methods achieving competitive performance on natural video. However, screen content video -- common in remote desktop, online education, and cloud gaming -- exhibits distinct statistics: sharp edges, limited color palettes, and strong temporal redundancy. Existing neural representation methods, designed for natural scenes, lack mechanisms to exploit these properties, leaving substantial room for improvement. In this paper, we propose NeR-SC, a neural representation framework tailored for screen content video. Building on the SNeRV backbone, NeR-SC introduces three screen-content-specific modules: (i) a learnable color palette that models the discrete color structure of screen content by restricting the low-frequency sub-band to a learned color set; (ii) a multi-gate dense fusion module that replaces sequential feature fusion with dense, attention-gated cross-stage interaction; and (iii) an embedding-level frame skip strategy that bypasses redundant decoder invocations for static frames, with zero training overhead. Experiments on DSCVC and VCD show that NeR-SC achieves 40.32~dB and 41.73~dB average PSNR, outperforming representative neural video representation methods and, at low bitrates, surpassing H.264 and H.265. The skip strategy enables real-time decoding with no loss in quality.

神经视频屏幕内容压缩实时解码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。