用像素自适应的MLP提升图像增强,实时且能捕捉复杂色彩关系。
Learning Pixel-adaptive Multi-layer Perceptrons for Real-time Image Enhancement
- 基于双边网格生成动态MLP参数,每像素独立获取映射能力。
- 在多个公开数据集上超越现有方法,保持实时处理速度。
- 适合需要高精度色彩调整的实时图像处理场景。
基于深度学习的双边网格处理已成为图像增强的有前景方案,天然编码空间与强度信息,并通过切片操作实现全分辨率高效处理。然而,现有方法仅限于线性仿射变换,难以建模复杂的色彩关系。尽管多层感知机(MLPs)擅长非线性映射,传统方法采用全局共享参数,难以应对局部变化。为此,我们提出基于双边网格的像素自适应多层感知机(BPAM)框架。该方法融合双边网格的空间建模能力与MLP的非线性表达能力。具体地,生成包含MLP参数的双边网格,每个像素根据空间坐标和强度值动态检索专属变换参数,获得独特的颜色映射MLP。此外,提出一种新颖的网格分解策略,将MLP参数按类型分存于不同子网格中,利用多通道引导图从对应子网格提取类别特异性参数,确保切片时有效利用色彩信息并精确生成参数。在多个公开数据集上的大量实验表明,本方法在性能上优于现有最先进方法,同时保持实时处理能力。
原文摘要 · Abstract (English)
Deep learning-based bilateral grid processing has emerged as a promising solution for image enhancement, inherently encoding spatial and intensity information while enabling efficient full-resolution processing through slicing operations. However, existing approaches are limited to linear affine transformations, hindering their ability to model complex color relationships. Meanwhile, while multi-layer perceptrons (MLPs) excel at non-linear mappings, traditional MLP-based methods employ globally shared parameters, which is hard to deal with localized variations. To overcome these dual challenges, we propose a Bilateral Grid-based Pixel-Adaptive Multi-layer Perceptron (BPAM) framework. Our approach synergizes the spatial modeling of bilateral grids with the non-linear capabilities of MLPs. Specifically, we generate bilateral grids containing MLP parameters, where each pixel dynamically retrieves its unique transformation parameters and obtain a distinct MLP for color mapping based on spatial coordinates and intensity values. In addition, we propose a novel grid decomposition strategy that categorizes MLP parameters into distinct types stored in separate subgrids. Multi-channel guidance maps are used to extract category-specific parameters from corresponding subgrids, ensuring effective utilization of color information during slicing while guiding precise parameter generation. Extensive experiments on public datasets demonstrate that our method outperforms state-of-the-art methods in performance while maintaining real-time processing capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。