用可学习的色相/饱和度/明度查表法,精准消除高光区紫边伪影。
CAST-LUT: Tokenizer-Guided HSV Look-Up Tables for Purple Flare Removal
- 分步处理:先用语义标记器提取紫边特征,再生成独立的三通道校正曲线。
- 在自建大规模数据集上,视觉效果和量化指标均超越现有方法。
- 适合图像修复、摄影后期及低光照成像优化场景使用。
紫边是一种常见于高光区域的色散伪影,严重破坏图像色调过渡与色彩表现。传统方法依赖手工设计特征,灵活性差且依赖固定先验,而配对训练数据稀缺严重制约了深度学习应用。为此,本文提出基于解耦HSV查找表(LUT)的新网络架构。通过独立调整色相(H)、饱和度(S)和明度(V)分量,解决传统方法中的颜色耦合问题。模型采用两阶段设计:首先,色度感知光谱标记器(CAST)将输入图像从RGB空间转换至HSV空间,分别编码色相(H)和明度(V)通道为描述紫边状态的语义标记;其次,HSV-LUT模块以这些标记为输入,动态生成三个独立的1D校正曲线(1D-LUTs)用于修正H、S、V三通道。为有效训练与验证,我们构建了首个包含多样化场景的大规模紫边数据集,并提出了专门针对该任务的新评估指标与损失函数。大量实验表明,本模型在视觉效果和所有定量指标上均显著优于现有方法,达到当前最优水平。
原文摘要 · Abstract (English)
Purple flare, a diffuse chromatic aberration artifact commonly found around highlight areas, severely degrades the tone transition and color of the image. Existing traditional methods are based on hand-crafted features, which lack flexibility and rely entirely on fixed priors, while the scarcity of paired training data critically hampers deep learning. To address this issue, we propose a novel network built upon decoupled HSV Look-Up Tables (LUTs). The method aims to simplify color correction by adjusting the Hue (H), Saturation (S), and Value (V) components independently. This approach resolves the inherent color coupling problems in traditional methods. Our model adopts a two-stage architecture: First, a Chroma-Aware Spectral Tokenizer (CAST) converts the input image from RGB space to HSV space and independently encodes the Hue (H) and Value (V) channels into a set of semantic tokens describing the Purple flare status; second, the HSV-LUT module takes these tokens as input and dynamically generates independent correction curves (1D-LUTs) for the three channels H, S, and V. To effectively train and validate our model, we built the first large-scale purple flare dataset with diverse scenes. We also proposed new metrics and a loss function specifically designed for this task. Extensive experiments demonstrate that our model not only significantly outperforms existing methods in visual effects but also achieves state-of-the-art performance on all quantitative metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。