基于动态点扩散函数的分阶段去雨网络,提升复杂雨景还原效果。
SD-PSFNet: Sequential and Dynamic Point Spread Function Network for Image Deraining
- 分三阶段序列处理,动态模拟雨痕光学效应并逐步优化去雨过程。
- 在Rain100H等数据集上达33.12dB PSNR,RealRain-1k-H超41dB。
- 适合需要高精度去雨的自动驾驶、监控等视觉系统应用。
图像去雨对视觉应用至关重要,但受雨滴多尺度物理特性及其与场景耦合的影响而面临挑战。为此,提出一种受多阶段图像复原启发的新方法——SD-PSFNet,融合点扩散函数(PSF)机制以揭示图像退化过程,并结合动态物理建模与序列特征融合传递。该网络采用三级级联的序列恢复架构,支持对退化过程的多次动态评估与优化。通过学习型PSF组件动态模拟雨丝光学特性,实现有效雨背景分离,并在每阶段引入新颖的PSF模块逐步增强输出。此外,采用自适应门控融合实现跨阶段特征最优整合,完成从粗略去雨到细节修复的逐级优化。模型在Rain100H(33.12dB/0.9371)、RealRain-1k-L(42.28dB/0.9872)和RealRain-1k-H(41.08dB/0.9838)上达到当前最优性能。结果表明,该方法在复杂场景与密集降雨条件下具备卓越能力,为图像去雨提供了新的物理感知范式。
原文摘要 · Abstract (English)
Image deraining is crucial for vision applications but is challenged by the complex multi-scale physics of rain and its coupling with scenes. To address this challenge, a novel approach inspired by multi-stage image restoration is proposed, incorporating Point Spread Function (PSF) mechanisms to reveal the image degradation process while combining dynamic physical modeling with sequential feature fusion transfer, named SD-PSFNet. Specifically, SD-PSFNet employs a sequential restoration architecture with three cascaded stages, allowing multiple dynamic evaluations and refinements of the degradation process estimation. The network utilizes components with learned PSF mechanisms to dynamically simulate rain streak optics, enabling effective rain-background separation while progressively enhancing outputs through novel PSF components at each stage. Additionally, SD-PSFNet incorporates adaptive gated fusion for optimal cross-stage feature integration, enabling sequential refinement from coarse rain removal to fine detail restoration. Our model achieves state-of-the-art PSNR/SSIM metrics on Rain100H (33.12dB/0.9371), RealRain-1k-L (42.28dB/0.9872), and RealRain-1k-H (41.08dB/0.9838). In summary, SD-PSFNet demonstrates excellent capability in complex scenes and dense rainfall conditions, providing a new physics-aware approach to image deraining.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。