提出EMResformer模型,高效去除单张图像雨痕并提升视觉测量精度。
Iterative Optimal Attention and Local Model for Single Image Rain Streak Removal
- 基于期望最大化机制的注意力块,聚焦关键特征增强局部信息。
- 在合成与真实数据集上均超越现有方法,实现更优去雨效果。
- 适合需要高精度成像的视觉测量系统应用,如智能交通监控。
高质量成像是视觉测量系统(VBMS)安全监控与智能部署的关键,但恶劣天气尤其是降雨会导致图像模糊、对比度下降,增加误判风险。为此,本文提出期望最大化重建变换器(EMResformer),通过保留关键自注意力值增强特征聚合能力,提升局部特征表现,实现更优图像重建。具体地,设计了无缝集成于去雨网络的期望最大化模块,有效剔除冗余信息并还原清晰背景;同时引入局部模型残差块,结合双局部模型结构与卷积序列,协同提取更相关特征。大量实验表明,该方法在合成与真实世界数据集上均优于当前最优方法,在模型复杂度与去雨性能间取得更好平衡。此外,在VBMS场景中验证了其有效性,证明高质量成像显著提升任务准确率与可靠性。
原文摘要 · Abstract (English)
High-fidelity imaging is crucial for the successful safety supervision and intelligent deployment of vision-based measurement systems (VBMS). It ensures high-quality imaging in VBMS, which is fundamental for reliable visual measurement and analysis. However, imaging quality can be significantly impaired by adverse weather conditions, particularly rain, leading to blurred images and reduced contrast. Such impairments increase the risk of inaccurate evaluations and misinterpretations in VBMS. To address these limitations, we propose an Expectation Maximization Reconstruction Transformer (EMResformer) for single image rain streak removal. The EMResformer retains the key self-attention values for feature aggregation, enhancing local features to produce superior image reconstruction. Specifically, we propose an Expectation Maximization Block seamlessly integrated into the single image rain streak removal network, enhancing its ability to eliminate superfluous information and restore a cleaner background image. Additionally, to further enhance local information for improved detail rendition, we introduce a Local Model Residual Block, which integrates two local model blocks along with a sequence of convolutions and activation functions. This integration synergistically facilitates the extraction of more pertinent features for enhanced single image rain streak removal. Extensive experiments validate that our proposed EMResformer surpasses current state-of-the-art single image rain streak removal methods on both synthetic and real-world datasets, achieving an improved balance between model complexity and single image deraining performance. Furthermore, we evaluate the effectiveness of our method in VBMS scenarios, demonstrating that high-quality imaging significantly improves the accuracy and reliability of VBMS tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。