arXiv:2608.16756cs.CV2026-08TPAMI

提出轻量级二值化视频修复框架,计算量降96%仍保持高精度。

Binarized High-Efficiency RAW Video Restoration and Beyond

论文配图:Binarized High-Efficiency RAW Video Restoration and Beyond
图 1 · 摘自论文原文
  • 设计统一模块联合建模时空信息,提升视频连贯性。
  • 引入统计感知二值卷积,减少量化误差,性能仅降4%。
  • 支持多比特量化,适配不同硬件部署需求。

RAW视频修复是高质量低层视觉感知的基础,广泛应用于下游视觉任务。尽管二值神经网络(BNNs)能实现图像增强的轻量化高效部署,但在建模时间一致性与激活值分布方面存在不足,限制了其在视频场景中的应用。本文提出BinRVR框架,将计算量和参数量降低约96%,性能仅下降约4%。具体而言,我们设计了二值化信息交互模块(BIIM),以统一高效方式联合建模空间与时间信息;同时提出分布感知二值卷积(DAB-Conv),利用全精度激活统计信息缓解量化误差。该框架还支持多比特量化,可在不同硬件约束下灵活权衡精度与效率。大量实验表明,BinRVR在低光增强、去噪、去模糊及超分辨率等RAW视频修复任务上,表现优于现有先进二值化方法。此外,我们进一步探索了该方法在目标检测与单目深度估计等下游视频任务中的潜力。

原文摘要 · Abstract (English)

RAW video restoration is fundamental to high-quality low-level perception and serves as the basis for a wide range of downstream vision applications. While binary neural networks (BNNs) enable efficient lightweight deployment for image enhancement, their deficiencies in modeling temporal coherence and activation value distributions hinder their effectiveness when applied to video scenarios. In this paper, we propose BinRVR, a binarized RAW video restoration framework that reduces computation and parameters by approximately 96% while incurring only about 4% performance degradation. Specifically, we present a Binarized Information Interaction Module (BIIM) to jointly model spatial and temporal information in an efficient and unified manner. Moreover, we develop a Distribution-Aware Binarized Convolution (DAB-Conv) that leverages the statistics of full-precision activations to mitigate quantization errors. The proposed framework further supports multi-bit quantization, enabling flexible accuracy-efficiency trade-offs across different hardware constraints. Extensive experiments demonstrate that our BinRVR achieves competitive performance compared with state-of-the-art binarized methods on RAW video restoration tasks, including low-light enhancement, denoising, deblurring, and super-resolution. We further explore the potential of our method on downstream video applications, including object detection and monocular depth estimation.

视频修复二值化轻量化RAW处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。