arXiv:2604.11014cs.CV2026-04

用高斯过程指导去噪,实现4K视频实时清晰修复

UHD-GPGNet: UHD Video Denoising via Gaussian-Process-Guided Local Spatio-Temporal Modeling

论文配图:UHD-GPGNet: UHD Video Denoising via Gaussian-Process-Guided Local Spatio-Temporal Modeling
图 1 · 摘自论文原文
  • 通过高斯过程建模局部时空退化特征,动态引导去噪
  • 参数少、速度超快,4K视频可实时处理,比同类方法快数倍
  • 仅用合成数据训练却能有效修复手机拍摄的真实噪声

超高清(UHD)视频去噪需同时抑制复杂的时空退化、保留细微纹理与色度稳定性,并支持全分辨率4K高效部署。本文提出UHD-GPGNet,一种基于高斯过程引导的局部时空去噪框架。该方法不依赖隐式特征学习,而是对紧凑的时空描述子估计稀疏高斯过程后验统计量,显式表征局部退化响应与不确定性,进而指导自适应时序细节融合。结构-色彩协同重建头解耦亮度、色度与高频修正,异方差损失函数与重叠分块推理进一步稳定优化,支持内存受限的4K部署。在UVG和RealisVideo-4K数据集上的实验表明,UHD-GPGNet在保持竞争力还原质量的同时,参数量显著低于现有方法,实现真正的实时全分辨率4K推理,相比最优竞争模型速度大幅提升,并在多级混合退化场景下表现稳健。对手机拍摄4K视频的真实世界测试进一步验证:模型仅在合成退化数据上训练,仍能泛化至未见的真实传感器噪声,在严苛条件下提升下游目标检测性能。

原文摘要 · Abstract (English)

Ultra-high-definition (UHD) video denoising requires simultaneously suppressing complex spatio-temporal degradations, preserving fine textures and chromatic stability, and maintaining efficient full-resolution 4K deployment. In this paper, we propose UHD-GPGNet, a Gaussian-process-guided local spatio-temporal denoising framework that addresses these requirements jointly. Rather than relying on implicit feature learning alone, the method estimates sparse GP posterior statistics over compact spatio-temporal descriptors to explicitly characterize local degradation response and uncertainty, which then guide adaptive temporal-detail fusion. A structure-color collaborative reconstruction head decouples luminance, chroma, and high-frequency correction, while a heteroscedastic objective and overlap-tiled inference further stabilize optimization and enable memory-bounded 4K deployment. Experiments on UVG and RealisVideo-4K show that UHD-GPGNet achieves competitive restoration fidelity with substantially fewer parameters than existing methods, enables real-time full-resolution 4K inference with significant speedup over the closest quality competitor, and maintains robust performance across a multi-level mixed-degradation schedule.A real-world study on phone-captured 4K video further confirms that the model, trained entirely on synthetic degradation, generalizes to unseen real sensor noise and improves downstream object detection under challenging conditions.

视频去噪高斯过程4K实时真实泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。