arXiv:2604.09220cs.CV2026-04

轻量级神经视频表示实现高效低延迟重建。

TinyNeRV: Compact Neural Video Representations via Capacity Scaling, Distillation, and Low-Precision Inference

论文配图:TinyNeRV: Compact Neural Video Representations via Capacity Scaling, Distillation, and Low-Precision Inference
图 1 · 摘自论文原文
  • 设计极简架构,通过容量压缩与蒸馏提升紧凑模型性能。
  • 参数减少90%以上,仍保持高重建质量与实时解码速度。
  • 适合移动端、嵌入式等资源受限场景的视频应用。

隐式神经视频表示将整个视频序列编码在神经网络参数中,实现恒定时间帧重建。现有神经视频表示(NeRV)虽具良好重建性能且无需顺序解码,但多数研究聚焦中高容量模型,对资源受限环境所需的极小模型探索不足。本文系统研究了适用于高效部署的微型NeRV架构,提出两个轻量级配置NeRV-T和NeRV-T+,在多个视频数据集上评估其在极端容量压缩下的重建质量、计算复杂度与解码吞吐量表现。除架构缩放外,还探索不增加推理成本的优化策略:采用频率感知焦点监督的知识蒸馏以提升低容量网络重建保真度;通过后训练量化与量化感知训练分析低精度推理对微型模型鲁棒性的影响。实验表明,精心设计的微型NeRV变体可在大幅降低参数量、计算开销与内存占用的同时,实现优良的质量-效率权衡。研究揭示了紧凑神经视频表示的实际边界,为在资源受限与实时环境中部署NeRV类模型提供指导。官方代码已开源:https://github.com/HannanAkhtar/TinyNeRV-Implementation。

原文摘要 · Abstract (English)

Implicit neural video representations encode entire video sequences within the parameters of a neural network and enable constant time frame reconstruction. Recent work on Neural Representations for Videos (NeRV) has demonstrated competitive reconstruction performance while avoiding the sequential decoding process of conventional video codecs. However, most existing studies focus on moderate or high capacity models, leaving the behavior of extremely compact configurations required for constrained environments insufficiently explored. This paper presents a systematic study of tiny NeRV architectures designed for efficient deployment. Two lightweight configurations, NeRV-T and NeRV-T+, are introduced and evaluated across multiple video datasets in order to analyze how aggressive capacity reduction affects reconstruction quality, computational complexity, and decoding throughput. Beyond architectural scaling, the work investigates strategies for improving the performance of compact models without increasing inference cost. Knowledge distillation with frequency-aware focal supervision is explored to enhance reconstruction fidelity in low-capacity networks. In addition, the impact of lowprecision inference is examined through both post training quantization and quantization aware training to study the robustness of tiny models under reduced numerical precision. Experimental results demonstrate that carefully designed tiny NeRV variants can achieve favorable quality efficiency trade offs while substantially reducing parameter count, computational cost, and memory requirements. These findings provide insight into the practical limits of compact neural video representations and offer guidance for deploying NeRV style models in resource constrained and real-time environments. The official implementation is available at https: //github.com/HannanAkhtar/TinyNeRV-Implementation.

神经视频轻量模型量化低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。