提出轻量高效RAW图像增强网络,实现实时4K低光处理
ERIENet: An Efficient RAW Image Enhancement Network under Low-Light Environment
- 并行多尺度处理+通道感知残差密集块,降低计算开销
- 利用绿色通道信息引导重建,提升画质且参数极少
- 4K图像达146+帧/秒,适合移动端实时低光增强
RAW图像在低光图像增强等任务中表现优于sRGB图像。然而,现有基于RAW的低光增强方法通常采用逐级处理多尺度信息,难以实现轻量化与高速处理,且常忽略RAW图像绿色通道的优势,未能有效利用其丰富信息。为此,本文提出高效RAW图像增强网络ERIENet,通过高效的并行多尺度架构与新型通道感知残差密集块提取特征,显著降低计算成本,实现实时处理。同时引入绿色通道引导分支,充分挖掘输入RAW图像中绿色通道的信息,以极少的参数和计算量提升重建质量。在常用低光图像增强数据集上的实验表明,ERIENet在提升低光RAW图像质量方面优于现有最优方法,且在单张NVIDIA GeForce RTX 3090(24G内存)上实现超过146帧/秒的处理速度,适用于4K分辨率图像。
原文摘要 · Abstract (English)
RAW images have shown superior performance than sRGB images in many image processing tasks, especially for low-light image enhancement. However, most existing methods for RAW-based low-light enhancement usually sequentially process multi-scale information, which makes it difficult to achieve lightweight models and high processing speeds. Besides, they usually ignore the green channel superiority of RAW images, and fail to achieve better reconstruction performance with good use of green channel information. In this work, we propose an efficient RAW Image Enhancement Network (ERIENet), which parallelly processes multi-scale information with efficient convolution modules, and takes advantage of rich information in green channels to guide the reconstruction of images. Firstly, we introduce an efficient multi-scale fully-parallel architecture with a novel channel-aware residual dense block to extract feature maps, which reduces computational costs and achieves real-time processing speed. Secondly, we introduce a green channel guidance branch to exploit the rich information within the green channels of the input RAW image. It increases the quality of reconstruction results with few parameters and computations. Experiments on commonly used low-light image enhancement datasets show that ERIENet outperforms state-of-the-art methods in enhancing low-light RAW images with higher effiency. It also achieves an optimal speed of over 146 frame-per-second (FPS) for 4K-resolution images on a single NVIDIA GeForce RTX 3090 with 24G memory.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。