用可学习的查找表+迭代流匹配,实现高效高保真图像增强。
FlowLUT: Efficient Image Enhancement via Differentiable LUTs and Iterative Flow Matching
- 多组可微分3D查表器结合动态融合权重,实现轻量自适应调色
- 在三个基准上达到实时处理与高保真度,细节恢复效果显著
- 适合需要快速部署且要求图像质量的移动端或嵌入式场景
基于深度学习的图像增强方法在计算效率与表达能力间存在根本权衡。传统三维查找表(3D LUT)虽能实时处理退化图像,但缺乏表达灵活性,仅依赖固定先验。为此,我们提出FlowLUT,一种端到端模型,融合了LUT的高效性、多重先验及流匹配重建图像的参数无关特性。首先,输入图像通过一组可微分3D LUT(包含多个具有不同先验的3D LUT)进行颜色空间变换。随后,一个轻量级内容感知动态网络预测融合权重,实现$/mathcal{O}(1)$复杂度的场景自适应色彩校正。接着,轻量级融合预测网络作用于多个3D LUT,保持$/mathcal{O}(1)$复杂度以完成自适应调色。此外,为克服LUT固有的表达限制,设计创新的迭代流匹配方法,恢复局部结构细节并消除伪影。最终,整个模型在复合损失函数下联合优化,强制保证感知与结构保真度。大量实验结果表明该方法在三个基准上均具有效性。
原文摘要 · Abstract (English)
Deep learning-based image enhancement methods face a fundamental trade-off between computational efficiency and representational capacity. For example, although a conventional three-dimensional Look-Up Table (3D LUT) can process a degraded image in real time, it lacks representational flexibility and depends solely on a fixed prior. To address this problem, we introduce FlowLUT, a novel end-to-end model that integrates the efficiency of LUTs, multiple priors, and the parameter-independent characteristic of flow-matched reconstructed images. Specifically, firstly, the input image is transformed in color space by a collection of differentiable 3D LUTs (containing a large number of 3D LUTs with different priors). Subsequently, a lightweight content-aware dynamically predicts fusion weights, enabling scene-adaptive color correction with $\mathcal{O}(1)$ complexity. Next, a lightweight fusion prediction network runs on multiple 3D LUTs, with $\mathcal{O}(1)$ complexity for scene-adaptive color correction.Furthermore, to address the inherent representation limitations of LUTs, we design an innovative iterative flow matching method to restore local structural details and eliminate artifacts. Finally, the entire model is jointly optimized under a composite loss function enforcing perceptual and structural fidelity. Extensive experimental results demonstrate the effectiveness of our method on three benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。