仅用一层网络实现快速高质量低光图像增强
Striving for Faster and Better: A One-Layer Architecture with Auto Re-parameterization for Low-Light Image Enhancement
- 通过自重参数化扩展参数空间,提升单层网络学习能力
- 在多种硬件上运行速度超越现有最快方法,峰值达30.87dB PSNR
- 适合追求高效实时低光增强的工程应用与部署场景
近年来基于深度学习的低光图像增强方法在保持良好视觉质量的同时,逐步减少参数量并提升计算效率。本文旨在探索增强器在视觉质量与计算效率上的极限,力求兼顾性能与速度。通过重新思考任务需求,提出视觉质量与计算效率分别对应模型学习与结构设计的观点。为此,引入重参数化技术,在预定义的极简网络(如仅一层)基础上扩展参数空间,避免陷入局部最优。同时设计分层搜索策略,发现面向任务的重参数化结构,强化结构表达能力,支持高效实现。最终仅用一个卷积层即达成高效的低光图像增强,保持优异视觉质量。实验表明,本方法在质量和效率上均优于近期主流方法;尤其在多种平台(如CPU、GPU、NPU、DSP)上运行时间持续领先现有最快方案。源代码将发布于https://github.com/vis-opt-group/AR-LLIE。
原文摘要 · Abstract (English)
Deep learning-based low-light image enhancers have made significant progress in recent years, with a trend towards achieving satisfactory visual quality while gradually reducing the number of parameters and improving computational efficiency. In this work, we aim to delving into the limits of image enhancers both from visual quality and computational efficiency, while striving for both better performance and faster processing. To be concrete, by rethinking the task demands, we build an explicit connection, i.e., visual quality and computational efficiency are corresponding to model learning and structure design, respectively. Around this connection, we enlarge parameter space by introducing the re-parameterization for ample model learning of a pre-defined minimalist network (e.g., just one layer), to avoid falling into a local solution. To strengthen the structural representation, we define a hierarchical search scheme for discovering a task-oriented re-parameterized structure, which also provides powerful support for efficiency. Ultimately, this achieves efficient low-light image enhancement using only a single convolutional layer, while maintaining excellent visual quality. Experimental results show our sensible superiority both in quality and efficiency against recently-proposed methods. Especially, our running time on various platforms (e.g., CPU, GPU, NPU, DSP) consistently moves beyond the existing fastest scheme. The source code will be released at https://github.com/vis-opt-group/AR-LLIE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。