统一网络提升恶劣天气下交通影像质量,支持雾霾雨雪多种退化场景。
USRNet: Unified Scene Recovery Network for Enhancing Traffic Imaging under Multiple Adverse Weather Conditions
- 设计统一架构,融合编码器、注意力节点学习与边缘解码机制。
- 在多个真实数据集上超越现有方法,显著改善复杂退化图像恢复效果。
- 适合自动驾驶与智能监控系统,应对多类天气干扰的视觉重建需求。
计算机视觉技术的进步推动了智能交通与视觉监控系统的广泛应用,涵盖自动驾驶、公共安全与环境监测等领域。然而,雾霾、雨雪及更复杂的混合退化等恶劣天气会严重降低图像质量,影响系统准确性与可靠性。为应对多类型退化场景下的适应性建模挑战,本文提出统一场景恢复网络(USRNet),可同时处理多种图像退化问题。其架构包含场景编码器、注意力驱动的节点独立学习机制(NILM)、边缘解码器与场景恢复模块。场景编码器通过先进残差块逐级提取深层特征,充分编码退化信息;引入NILM增强模型在不同天气条件下的适应能力;边缘解码器精准提取边缘特征,保障图像清晰度。实验表明,USRNet在多个复杂退化场景下优于现有方法,显著提升视觉系统的准确性和可靠性。相关代码已开源:https://github.com/LouisYxLu/USRNet。
原文摘要 · Abstract (English)
Advancements in computer vision technology have facilitated the extensive deployment of intelligent transportation systems and visual surveillance systems across various applications, including autonomous driving, public safety, and environmental monitoring. However, adverse weather conditions such as haze, rain, snow, and more complex mixed degradation can significantly degrade image quality. The degradation compromises the accuracy and reliability of these systems across various scenarios. To tackle the challenge of developing adaptable models for scene restoration, we introduce the unified scene recovery network (USRNet), capable of handling multiple types of image degradation. The USRNet features a sophisticated architecture consisting of a scene encoder, an attention-driven node independent learning mechanism (NILM), an edge decoder, and a scene restoration module. The scene encoder, powered by advanced residual blocks, extracts deep features from degraded images in a progressive manner, ensuring thorough encoding of degradation information. To enhance the USRNet's adaptability in diverse weather conditions, we introduce NILM, which enables the network to learn and respond to different scenarios with precision, thereby increasing its robustness. The edge decoder is designed to extract edge features with precision, which is essential for maintaining image sharpness. Experimental results demonstrate that USRNet surpasses existing methods in handling complex imaging degradations, thereby improving the accuracy and reliability of visual systems across diverse scenarios. The code resources for this work can be accessed in https://github.com/LouisYxLu/USRNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。