用可自适应的颜料空间提升图像增强效果
Image Enhancement Based on Pigment Representation
- 将颜色从RGB转为高维颜料空间,动态适配图像内容
- 在颜料空间中重投影并融合,显著改善光影与色彩表现
- 适合需要高质量图像调色的摄影与影视后期人员
本文提出一种基于颜料表示的新型高效图像增强方法。与传统受限于预定义色彩空间(如RGB)的方法不同,该方法通过将输入的RGB颜色动态映射到高维特征空间——即‘颜料’空间,实现内容自适应。所提出的颜料表示具备高度可适应性与表达能力,显著提升图像增强性能。具体流程包括:将输入图像的RGB颜色转换为高维颜料;在颜料空间中对各颜色进行独立重投影并融合,以提炼和聚合色彩信息;最后将重构的颜料转换回RGB生成增强图像。变换与重投影参数由视觉编码器自适应估计,依据输入图像内容动态调整。大量实验表明,该方法在图像润饰与色调映射任务中均优于现有最先进方法,同时保持较低计算复杂度与较小模型规模。
原文摘要 · Abstract (English)
This paper presents a novel and efficient image enhancement method based on pigment representation. Unlike conventional methods where the color transformation is restricted to pre-defined color spaces like RGB, our method dynamically adapts to input content by transforming RGB colors into a high-dimensional feature space referred to as \textit{pigments}. The proposed pigment representation offers adaptability and expressiveness, achieving superior image enhancement performance. The proposed method involves transforming input RGB colors into high-dimensional pigments, which are then reprojected individually and blended to refine and aggregate the information of the colors in pigment spaces. Those pigments are then transformed back into RGB colors to generate an enhanced output image. The transformation and reprojection parameters are derived from the visual encoder which adaptively estimates such parameters based on the content in the input image. Extensive experimental results demonstrate the superior performance of the proposed method over state-of-the-art methods in image enhancement tasks, including image retouching and tone mapping, while maintaining relatively low computational complexity and small model size.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。