用风格特征实时识别天气,三模型提升准确率与泛化能力。
Style-Based Neural Architectures for Real-Time Weather Classification

- 基于多尺度块判别器和截断残差网络提取图像风格特征。
- 在多个公开数据集上超越当前最佳方法,尤其擅长捕捉细微风格差异。
- 适合需外观分类的场景,如动物识别、医学影像疾病检测等。
本文提出三种神经网络架构,用于从图像中实时分类天气状况(晴天、雨天、雪天、雾天)。受近期风格迁移技术启发,这些模型旨在捕捉图像中的风格元素。其中,“Multi-PatchGAN”基于Pix2Pix和CycleGAN中使用的PatchGAN,但引入多尺度块以适配检测任务;“Truncated ResNet50”是仅保留ResNet50前九层的简化版本,其结构由进化算法优化,利于提取高频特征以捕获细微风格细节;最后提出的“Truncated ResNet50 with Gram Matrix and Attention”在训练中计算各层的格拉姆矩阵,并通过注意力机制自动加权,从而优化最具判别性的风格表达提取。后两种模型在多个公开数据库上表现优异,显著优于现有方法,且具备强大泛化能力。尽管专为天气检测设计,其架构同样适用于其他基于外观的分类任务,如动物种类识别、纹理分类、医学影像疾病检测或工业缺陷识别。
原文摘要 · Abstract (English)
In this paper, we present three neural network architectures designed for real-time classification of weather conditions (sunny, rain, snow, fog) from images. These models, inspired by recent advances in style transfer, aim to capture the stylistic elements present in images. One model, called "Multi-PatchGAN", is based on PatchGANs used in well-known architectures such as Pix2Pix and CycleGAN, but here adapted with multiple patch sizes for detection tasks. The second model, "Truncated ResNet50", is a simplified version of ResNet50 retaining only its first nine layers. This truncation, determined by an evolutionary algorithm, facilitates the extraction of high-frequency features essential for capturing subtle stylistic details. Finally, we propose "Truncated ResNet50 with Gram Matrix and Attention", which computes Gram matrices for each layer during training and automatically weights them via an attention mechanism, thus optimizing the extraction of the most relevant stylistic expressions for classification. These last two models outperform the state of the art and demonstrate remarkable generalization capability on several public databases. Although developed for weather detection, these architectures are also suitable for other appearance-based classification tasks, such as animal species recognition, texture classification, disease detection in medical imaging, or industrial defect identification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。