arXiv:2506.23382cs.CVcs.AI2025-06被引 2

SIEDD让视频神经压缩编码快20-30倍,还能保持画质和分辨率可调。

SIEDD: Shared-Implicit Encoder with Discrete Decoders

  • 共享坐标编码器快速学全局特征,再并行训练轻量离散解码器。
  • 在高清与4K上实现20-30倍编码加速,画质和压缩比仍具竞争力。
  • 支持连续分辨率解码,适合需要灵活转码的实时应用。

隐式神经表示(INRs)通过为每段视频学习优化函数,在视频压缩中表现出卓越保真度,但其实际应用受限于极慢的编码速度。现有加速方法常以牺牲重建质量或关键的坐标级控制为代价。本文提出SIEDD(共享隐式编码器与离散解码器),从根本上加速INR编码而无需这些权衡。SIEDD首先在稀疏锚帧上快速训练一个共享的基于坐标的编码器,高效捕捉视频全局低频特征;该编码器随后被冻结,用于并行训练轻量级离散解码器,针对不同帧组进行独立优化,并通过激进的坐标空间采样进一步提速。这种协同设计在高清与4K基准测试上实现了相比当前最优INR编解码器20-30倍的编码速度提升,同时保持了具有竞争力的重建质量与压缩比。关键的是,SIEDD保留了完整的坐标级控制能力,支持连续分辨率解码,避免了昂贵的转码过程。本方法显著提升了高保真神经视频压缩的实用性,为真实世界部署提供了可扩展、高效的路径。代码已开源:https://github.com/VikramRangarajan/SIEDD。

原文摘要 · Abstract (English)

Implicit Neural Representations (INRs) offer exceptional fidelity for video compression by learning per-video optimized functions, but their adoption is crippled by impractically slow encoding times. Existing attempts to accelerate INR encoding often sacrifice reconstruction quality or crucial coordinate-level control essential for adaptive streaming and transcoding. We introduce SIEDD (Shared-Implicit Encoder with Discrete Decoders), a novel architecture that fundamentally accelerates INR encoding without these compromises. SIEDD first rapidly trains a shared, coordinate-based encoder on sparse anchor frames to efficiently capture global, low-frequency video features. This encoder is then frozen, enabling massively parallel training of lightweight, discrete decoders for individual frame groups, further expedited by aggressive coordinate-space sampling. This synergistic design delivers a remarkable 20-30X encoding speed-up over state-of-the-art INR codecs on HD and 4K benchmarks, while maintaining competitive reconstruction quality and compression ratios. Critically, SIEDD retains full coordinate-based control, enabling continuous resolution decoding and eliminating costly transcoding. Our approach significantly advances the practicality of high-fidelity neural video compression, demonstrating a scalable and efficient path towards real-world deployment. Our codebase is available at https://github.com/VikramRangarajan/SIEDD .

视频压缩隐式表示编码加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。