用小波先验优化4D查表,实现低光视频实时保色增强
Optimizing 4D Lookup Table for Low-light Video Enhancement via Wavelet Priori
- 引入小波低频域构建查表先验,自适应调节增强效果
- 动态融合策略补偿低光区域信息损失,提升颜色一致性
- 适合需要实时低光视频增强的应用场景
低光视频增强需保持时空颜色一致性,提升色彩映射精度并维持低延迟极具挑战。为此,本文提出基于小波先验的4D查找表(WaveLUT),有效增强帧间颜色一致性与色彩映射准确性,同时保持低延迟。具体地,利用小波低频域构建优化的查找表先验,通过设计的小波先验4D查找表实现自适应增强。为补偿低光区域先验信息损失,进一步提出动态融合策略,根据小波光照先验与目标强度结构的相关性自适应确定空间权重。训练阶段,采用文本驱动的外观重建方法,通过多模态语义引导的傅里叶谱动态平衡亮度与内容。在多个基准数据集上的大量实验表明,该方法显著提升对色彩空间的感知能力,在保持高效率的同时实现指标优越且感知优良的实时增强。
原文摘要 · Abstract (English)
Low-light video enhancement is highly demanding in maintaining spatiotemporal color consistency. Therefore, improving the accuracy of color mapping and keeping the latency low is challenging. Based on this, we propose incorporating Wavelet-priori for 4D Lookup Table (WaveLUT), which effectively enhances the color coherence between video frames and the accuracy of color mapping while maintaining low latency. Specifically, we use the wavelet low-frequency domain to construct an optimized lookup prior and achieve an adaptive enhancement effect through a designed Wavelet-prior 4D lookup table. To effectively compensate the a priori loss in the low light region, we further explore a dynamic fusion strategy that adaptively determines the spatial weights based on the correlation between the wavelet lighting prior and the target intensity structure. In addition, during the training phase, we devise a text-driven appearance reconstruction method that dynamically balances brightness and content through multimodal semantics-driven Fourier spectra. Extensive experiments on a wide range of benchmark datasets show that this method effectively enhances the previous method's ability to perceive the color space and achieves metric-favorable and perceptually oriented real-time enhancement while maintaining high efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。