arXiv:2505.12641cs.CVcs.AI2025-05被引 1

用物理约束生成传输先验,提升单图反射分离效果

Single Image Reflection Separation via Dual Prior Interaction Transformer

  • 基于物理方程T=SI+B设计轻量传输先验生成网络
  • 通过双流注意力融合通用与传输先验,实现深层互补
  • 在多个数据集上达到当前最优,尤其适合复杂场景

单图反射分离旨在从混合图像中分离出透射层和反射层。现有方法通常结合预训练模型的通用先验与任务特定先验(如文本提示、反射检测),但作为最直接的任务先验,透射先验未被有效建模或充分利用,限制了复杂场景下的性能。为此,我们提出基于轻量透射先验生成与有效先验融合的双先验交互框架。首先,设计局部线性校正网络(LLCN),基于物理约束T=SI+B对预训练模型进行微调,其中S和B分别表示像素级与通道级缩放和偏置变换,高效生成高质量透射先验,参数极少。其次,构建双先验交互变换器(DPIT),采用双流通道重组注意力机制,重新组织通用先验与透射先验的特征进行注意力计算,实现两者深度融合,充分挖掘互补信息。多基准数据集实验表明,该方法达到当前最优性能。

原文摘要 · Abstract (English)

Single image reflection separation aims to separate the transmission and reflection layers from a mixed image. Existing methods typically combine general priors from pre-trained models with task-specific priors such as text prompts and reflection detection. However, the transmission prior, as the most direct task-specific prior for the target transmission layer, has not been effectively modeled or fully utilized, limiting performance in complex scenarios. To address this issue, we propose a dual-prior interaction framework based on lightweight transmission prior generation and effective prior fusion. First, we design a Local Linear Correction Network (LLCN) that finetunes pre-trained models based on the physical constraint T=SI+B, where S and B represent pixel-wise and channel-wise scaling and bias transformations. LLCN efficiently generates high-quality transmission priors with minimal parameters. Second, we construct a Dual-Prior Interaction Transformer (DPIT) that employs a dual-stream channel reorganization attention mechanism. By reorganizing features from general and transmission priors for attention computation, DPIT achieves deep fusion of both priors, fully exploiting their complementary information. Experimental results on multiple benchmark datasets demonstrate that the proposed method achieves state-of-the-art performance.

图像分离先验融合轻量网络物理约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。