arXiv:2606.31513cs.CV2026-06

用预训练潜空间解耦反射,一次前向传播恢复清晰图像。

PRISM: Latent Composition Consistency for Single-Image Reflection Removal

论文配图:PRISM: Latent Composition Consistency for Single-Image Reflection Removal
图 1 · 摘自论文原文
  • 在预训练VAE潜空间中将反射去除转为线性分离问题。
  • 在6个基准上超越现有方法,对真实场景图像泛化能力强。
  • 通过潜空间一致性与对比学习,无需反射标注即可分离图层。

单图像反射去除(SIRR)旨在从被反射污染的混合图像中恢复透射层,这是一个严重病态的问题。现有方法在像素空间操作,受非线性的sRGB成像模型干扰,限制了泛化能力。我们发现,预训练VAE潜空间中图像各层间的相干性远低于像素空间,更适合分解。基于此,提出PRISM(Pretrained-latent Reflection Image Separation Model),将SIRR重新定义为潜空间中的线性分离问题。在近似加性形式下,PRISM在预训练FLUX主干上学习流匹配速度场,实现单次前向传播同时恢复透射与反射层。为增强鲁棒解耦,引入潜空间组合一致性(LCC)策略,通过跨样本交换反射潜变量构造合成混合图像,并利用循环损失强制一致分解。进一步提出层对比分离(LCS)损失,通过局部块级对比学习促进层间语义分离,无需显式反射标签。在六个基准上的实验表明,PRISM持续显著优于当前最优方法,且对真实场景图像具有强泛化能力。

原文摘要 · Abstract (English)

Single-image reflection removal (SIRR) seeks to recover the transmission layer from a mixture corrupted by reflections -- a severely ill-posed problem. Existing methods operate in pixel space, where the nonlinear sRGB formation model entangles the two layers and limits generalization. We observe that pretrained VAE latent spaces exhibit substantially lower coherence between image layers compared to pixel space, providing a more favorable working space for decomposition. Building on this finding, we propose \textbf{PRISM} (Pretrained-latent Reflection Image Separation Model), which reinterprets SIRR as a latent linear separation problem. Under an approximate additive formulation in latent space, PRISM learns a flow matching velocity field on a pretrained FLUX backbone that recovers both transmission and reflection in a single forward pass. To enforce robust disentanglement, we introduce a Latent Composition Consistency (LCC) strategy that constructs synthetic mixtures by swapping reflection latents across samples and enforces consistent decomposition via a cycle loss. We further propose a Layer Contrastive Separation (LCS) loss that promotes semantic separation between layers through patch-level contrastive learning, without requiring explicit reflection targets. Experiments on six benchmarks demonstrate that PRISM consistently outperforms state-of-the-art methods by significant margins, with strong generalization to in-the-wild images.

图像去反射潜空间建模无监督分离扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。