通过自适应筛选关键区域,提升低质量图像的场景识别鲁棒性
Less yet robust: crucial region selection for scene recognition
- 设计可学习掩码动态筛选高阶特征中的重要区域
- 在两个数据集上显著优于现有方法,尤其在劣质图像下表现更稳
- 适用于无人机与水下场景识别,可无缝集成到现有网络中
航拍与水下图像常因模糊或过曝导致场景识别困难。尽管卷积神经网络能提取全景语义特征,但低质量图像仍会干扰模型性能,主要源于对高阶语义特征的不当使用。为此,本文提出一种自适应选择机制,识别最具判别力且鲁棒的特征区域,使模型仅在这些区域学习以规避干扰。通过在神经网络中引入可学习掩码,对特征矩阵的不同区域分配权重,实现对关键区域的聚焦。同时加入正则化项,进一步强化核心特征区域的重要性。与以往方法不同,该机制特别关注跨类别重要但易导致误判的区域,并施加约束以降低其影响。所提结构为即插即用设计,可灵活扩展至其他方法。此外,我们构建了水下地质场景分类数据集(Underwater Geological Scene Classification dataset)用于评估。大量实验表明,该方法在两个数据集上均显著优于当前最优技术,展现出更强的鲁棒性。
原文摘要 · Abstract (English)
Scene recognition, particularly for aerial and underwater images, often suffers from various types of degradation, such as blurring or overexposure. Previous works that focus on convolutional neural networks have been shown to be able to extract panoramic semantic features and perform well on scene recognition tasks. However, low-quality images still impede model performance due to the inappropriate use of high-level semantic features. To address these challenges, we propose an adaptive selection mechanism to identify the most important and robust regions with high-level features. Thus, the model can perform learning via these regions to avoid interference. implement a learnable mask in the neural network, which can filter high-level features by assigning weights to different regions of the feature matrix. We also introduce a regularization term to further enhance the significance of key high-level feature regions. Different from previous methods, our learnable matrix pays extra attention to regions that are important to multiple categories but may cause misclassification and sets constraints to reduce the influence of such regions.This is a plug-and-play architecture that can be easily extended to other methods. Additionally, we construct an Underwater Geological Scene Classification dataset to assess the effectiveness of our model. Extensive experimental results demonstrate the superiority and robustness of our proposed method over state-of-the-art techniques on two datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。