用确定性流匹配重建高质量RAW图像,解决颜色偏差与细节丢失问题。
RAW-Flow: Advancing RGB-to-RAW Image Reconstruction with Deterministic Latent Flow Matching
- 将反向ISP建模为确定性潜在空间传输,通过流匹配学习隐变量场。
- 在多个数据集上实现峰值信噪比提升1.2~2.5dB,显著改善细节与色彩还原。
- 适合图像恢复、相机系统逆向设计等需要高保真原始数据的研究者。
RGB到RAW的重建,即对相机图像信号处理(ISP)流水线的逆向建模,旨在从RGB图像中恢复高保真原始数据。尽管已有显著进展,现有基于学习的方法通常将其视为直接回归任务,在量化后的RGB图像存在信息损失的情况下,因逆ISP问题的病态性,仍面临细节不一致和颜色偏差问题。为此,我们首次从生成视角出发,将RGB到RAW的重建重构为确定性潜在空间传输问题,提出名为RAW-Flow的新框架,利用流匹配在潜在空间中学习确定性向量场,有效弥合RGB与RAW表示之间的差距,实现结构细节与颜色信息的精确重建。为进一步增强潜在空间传输能力,引入跨尺度上下文引导模块,将分层的RGB特征注入流估计过程。此外,设计了双域潜在自编码器,结合特征对齐约束,联合编码RGB与RAW输入,促进训练稳定性和高保真重建。大量实验表明,RAW-Flow在定量和定性指标上均优于现有最先进方法。
原文摘要 · Abstract (English)
RGB-to-RAW reconstruction, or the reverse modeling of a camera Image Signal Processing (ISP) pipeline, aims to recover high-fidelity RAW data from RGB images. Despite notable progress, existing learning-based methods typically treat this task as a direct regression objective and struggle with detail inconsistency and color deviation, due to the ill-posed nature of inverse ISP and the inherent information loss in quantized RGB images. To address these limitations, we pioneer a generative perspective by reformulating RGB-to-RAW reconstruction as a deterministic latent transport problem and introduce a novel framework named RAW-Flow, which leverages flow matching to learn a deterministic vector field in latent space, to effectively bridge the gap between RGB and RAW representations and enable accurate reconstruction of structural details and color information. To further enhance latent transport, we introduce a cross-scale context guidance module that injects hierarchical RGB features into the flow estimation process. Moreover, we design a dual-domain latent autoencoder with a feature alignment constraint to support the proposed latent transport framework, which jointly encodes RGB and RAW inputs while promoting stable training and high-fidelity reconstruction. Extensive experiments demonstrate that RAW-Flow outperforms state-of-the-art approaches both quantitatively and visually.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。