提出首个继承主流去噪设计的搜索框架,高效找到高性能去噪模型。
Denoising Designs-inherited Search Framework for Image Denoising
- 构建网络、模块、卷积核三级搜索空间,继承现有去噪设计
- 所搜模型参数为Restormer的1/3,在真实数据集上性能领先1.50 dB
- 引入先验与推理时间正则化,支持高效搜索与可扩展性
如何利用大量现有的去噪设计?现有基于神经架构搜索(NAS)的方法探索的搜索空间有限,且因计算开销大难以扩展。为此,我们提出首个可探索主流去噪设计的搜索框架。该框架包含网络级、模块级和卷积核级搜索空间,旨在最大程度继承现有设计。通过协调的搜索策略,支持多种去噪设计的灵活扩展。在如此庞大的搜索空间中,寻找最优结构极具挑战。为此,我们首次引入基于去噪先验的正则化,降低搜索难度;并引入基于推理时间的正则化,优化模型复杂度。基于此框架,所搜架构在多个真实世界与合成数据集上达到当前最佳性能:参数量仅为Restormer的1/3,在真实数据集上比现有NAS方法提升1.50 dB。此外,我们分析了200个搜索到的架构偏好,为后续研究提供方向。
原文摘要 · Abstract (English)
How to benefit from plenty of existing denoising designs? Few methods via Neural Architecture Search (NAS) intend to answer this question. However, these NAS-based denoising methods explore limited search space and are hard to extend in terms of search space due to high computational burden. To tackle these limitations, we propose the first search framework to explore mainstream denoising designs. In our framework, the search space consists of the network-level, the cell-level and the kernel-level search space, which aims to inherit as many denoising designs as possible. Coordinating search strategies are proposed to facilitate the extension of various denoising designs. In such a giant search space, it is laborious to search for an optimal architecture. To solve this dilemma, we introduce the first regularization, i.e., denoising prior-based regularization, which reduces the search difficulty. To get an efficient architecture, we introduce the other regularization, i.e., inference time-based regularization, optimizes the search process on model complexity. Based on our framework, our searched architecture achieves state-of-the-art results for image denoising on multiple real-world and synthetic datasets. The parameters of our searched architecture are $1/3$ of Restormer's, and our method surpasses existing NAS-based denoising methods by $1.50$ dB in the real-world dataset. Moreover, we discuss the preferences of $\textbf{200}$ searched architectures, and provide directions for further work.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。