通过空间分解捕捉细微视觉特征,提升细粒度图像分类精度
Beyond Frequency: Seeing Subtle Cues Through the Lens of Spatial Decomposition for Fine-Grained Visual Classification
- 在空间域动态增强细节与语义,突破频域固定尺度限制
- 在四个主流数据集上达到最新最佳性能,显著提升分类准确率
- 适合关注细粒度识别中细微差异建模的研究者与应用开发者
细粒度视觉分类(FGVC)的核心在于捕捉对应细微视觉特征的判别性线索。近年来,基于频率分解/变换的方法因具备判别性线索挖掘能力而受到广泛关注。然而,这些方法依赖固定基函数,缺乏对图像内容的自适应性,无法根据不同图像的判别需求动态调整特征提取。为此,本文提出一种新型方法——微妙线索感知引擎(SCOPE),在空间域自适应增强低层细节与高层语义表征,突破频域固定尺度局限,提升多尺度融合灵活性。其核心由两个模块构成:浅层特征中动态增强边缘、纹理等细微细节的微妙细节提取器(SDE),以及基于增强浅层特征引导、学习语义一致且结构感知的高阶特征重构的显著语义精炼器(SSR)。SDE与SSR逐级级联,逐步融合局部细节与全局语义。大量实验表明,该方法在四个主流细粒度图像分类基准上均取得新的最优结果。
原文摘要 · Abstract (English)
The crux of resolving fine-grained visual classification (FGVC) lies in capturing discriminative and class-specific cues that correspond to subtle visual characteristics. Recently, frequency decomposition/transform based approaches have attracted considerable interests since its appearing discriminative cue mining ability. However, the frequency-domain methods are based on fixed basis functions, lacking adaptability to image content and unable to dynamically adjust feature extraction according to the discriminative requirements of different images. To address this, we propose a novel method for FGVC, named Subtle-Cue Oriented Perception Engine (SCOPE), which adaptively enhances the representational capability of low-level details and high-level semantics in the spatial domain, breaking through the limitations of fixed scales in the frequency domain and improving the flexibility of multi-scale fusion. The core of SCOPE lies in two modules: the Subtle Detail Extractor (SDE), which dynamically enhances subtle details such as edges and textures from shallow features, and the Salient Semantic Refiner (SSR), which learns semantically coherent and structure-aware refinement features from the high-level features guided by the enhanced shallow features. The SDE and SSR are cascaded stage-by-stage to progressively combine local details with global semantics. Extensive experiments demonstrate that our method achieves new state-of-the-art on four popular fine-grained image classification benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。