arXiv:2605.15579eess.IVcs.CV2026-05中稿 · IEEE Transactions …

提出可逆网络框架TVRN,实现压缩感知的视频帧率重缩放。

TVRN: Invertible Neural Networks for Compression-Aware Temporal Video Rescaling

论文配图:TVRN: Invertible Neural Networks for Compression-Aware Temporal Video Rescaling
图 1 · 摘自论文原文
  • 用多输入多输出时序小波变换+高频重建模块保持高频率信息
  • 在工业级压缩场景下重建质量优于现有方法
  • 适合视频编解码、流媒体传输等需要帧率适配的场景

为适应多样化的显示与带宽需求,高帧率视频需进行帧率下采样至低帧率(LFR),随后再上采样,要求联合优化以实现高效帧率重缩放。然而,现有方法通常通过训练目标关联上下采样操作,未充分挖掘其互逆特性,易导致高频信息丢失;且忽略有损编码器对LFR视频的影响,限制实际应用。本文提出端到端的压缩感知帧率重缩放框架TVRN。为缓解帧率下采样中的高频信息损失,TVRN采用可逆架构,结合多输入多输出时序小波变换与高频重建模块。为支持通过非可微有损编码器的端到端训练,设计了近似梯度的代理网络。为进一步提升在不同压缩等级下的鲁棒性,通过学习排序策略引入压缩感知特征,构建非对称架构。大量实验表明,TVRN在工业级视频压缩设置下显著优于现有方法。源代码公开于https://github.com/fengxinmin/TVRN_public。

原文摘要 · Abstract (English)

To fit diverse display and bandwidth constraints, high-frame-rate videos are temporally downscaled to low-frame-rate (LFR) and later upscaled, requiring joint optimization for effective frame-rate rescaling. However, existing methods typically link the two operations via training objectives, without fully exploiting their reciprocal nature, which may cause high-frequency information loss. Moreover, they overlook the impact of lossy codecs on LFR videos, limiting real-world applicability. In this work, we propose an end-to-end framework for compression-aware frame-rate rescaling, named TVRN. To regularize high-frequency information lost during frame-rate downscaling, TVRN adopts an invertible architecture that combines a Multi-Input Multi-Output Temporal Wavelet Transform with a high-frequency reconstruction module. To enable end-to-end training through non-differentiable lossy codecs, we design a surrogate network that approximates their gradients. Finally, to improve robustness under various compression levels, we extend TVRN to an asymmetric architecture by incorporating compression-aware features learned via a learning-to-rank strategy. Extensive experiments show that TVRN outperforms existing methods in reconstruction quality under industrial video compression settings. Source code is publicly available at https://github.com/fengxinmin/TVRN_public.

视频压缩帧率重缩放可逆网络时序小波

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。