让照片修复更抗编辑,提升RAW还原的实用性和灵活性。
Edit-aware RAW Reconstruction
- 引入可插拔的编辑感知损失函数,模拟真实相机处理流程。
- 在多种编辑条件下,sRGB重建峰值信噪比提升1.5-2 dB。
- 适用于现有方法,尤其适合需要适配特定修图风格的场景。
用户常在拍摄后对照片进行后期调整以达成理想的成片效果。尽管在RAW域编辑能提供更高精度与灵活性,但多数操作仍基于相机输出的显示相关图像(如8位sRGB JPEG),因为RAW数据很少被保存。现有RAW重建方法虽可从sRGB图像恢复RAW数据,但通常仅优化像素级重建质量,在不同渲染风格和编辑操作下性能下降明显。本文提出一种即插即用的编辑感知损失函数,可集成至任意现有RAW重建框架中,使恢复的RAW数据对不同渲染风格和编辑更具鲁棒性。该损失函数包含模块化、可微分的图像信号处理器(ISP),可模拟具有可调参数的真实摄影后期流水线。训练时,各ISP模块参数从精心设计的概率分布中随机采样,以建模真实相机处理中的实际变化。损失在sRGB空间中计算,比较真实与重建RAW经该可微分ISP渲染后的差异。实验表明,引入该损失后,各类编辑条件下的sRGB重建质量提升1.5–2 dB PSNR。此外,应用于元数据辅助的RAW重建方法时,可针对目标编辑进行微调,获得进一步增益。由于摄影编辑是消费级成像中进行RAW重建的主要动机,本方法为现有技术提供了通用且高效的提升编辑保真度与渲染灵活性的机制。
原文摘要 · Abstract (English)
Users frequently edit camera images post-capture to achieve their preferred photofinishing style. While editing in the RAW domain provides greater accuracy and flexibility, most edits are performed on the camera's display-referred output (e.g., 8-bit sRGB JPEG) since RAW images are rarely stored. Existing RAW reconstruction methods can recover RAW data from sRGB images, but these approaches are typically optimized for pixel-wise RAW reconstruction fidelity and tend to degrade under diverse rendering styles and editing operations. We introduce a plug-and-play, edit-aware loss function that can be integrated into any existing RAW reconstruction framework to make the recovered RAWs more robust to different rendering styles and edits. Our loss formulation incorporates a modular, differentiable image signal processor (ISP) that simulates realistic photofinishing pipelines with tunable parameters. During training, parameters for each ISP module are randomly sampled from carefully designed distributions that model practical variations in real camera processing. The loss is then computed in sRGB space between ground-truth and reconstructed RAWs rendered through this differentiable ISP. Incorporating our loss improves sRGB reconstruction quality by up to 1.5-2 dB PSNR across various editing conditions. Moreover, when applied to metadata-assisted RAW reconstruction methods, our approach enables fine-tuning for target edits, yielding further gains. Since photographic editing is the primary motivation for RAW reconstruction in consumer imaging, our simple yet effective loss function provides a general mechanism for enhancing edit fidelity and rendering flexibility across existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。