arXiv:2510.27155cs.CV2025-10

融合局部与全局视觉特征,提升遥感图像场景分类精度。

Hierarchical Fusion of Local and Global Visual Features with Mixture-of-Experts for Remote Sensing Image Scene Classification

  • 双路并行编码:分别提取多尺度局部特征和高效全局特征。
  • 分层融合模块实现跨层级动态交互,显著提升特征判别力。
  • 专家路由分类器适配细粒度识别,适合遥感图像分析任务。

遥感图像场景分类因地物复杂空间结构和多尺度特性仍具挑战。尽管基于CNN的方法擅长捕捉局部归纳偏置,Mamba类方法能高效建模全局序列上下文,但单一范式难以兼顾细粒度纹理与复杂空间结构。为此,我们提出一种并行异构编码器,包含局部视觉编码器(提取多尺度局部特征)与全局视觉编码器(捕捉高效全局特征)。核心创新在于分层融合模块,逐步聚合双路径特征,实现动态跨层级特征交互与上下文重建,生成高判别性表示。这些融合特征通过混合专家分类头自适应路由,动态分配至最优专家进行细粒度场景识别。在AID、NWPU-RESISC45和UC Merced数据集上,准确率分别达到93.72%、95.54%和96.92%,超越现有最先进方法,在性能与效率间取得最优平衡。代码已公开于https://anonymous.4open.science/r/classification-41DF。

原文摘要 · Abstract (English)

Remote sensing image scene classification remains a challenging task, primarily due to the complex spatial structures and multi-scale characteristics of ground objects. Although CNN-based methods excel at extracting local inductive biases, and Mamba-based approaches demonstrate impressive capabilities in efficiently capturing global sequential context, relying on a single paradigm restricts the model's ability to simultaneously characterize fine-grained textures and complex spatial structures. To tackle this, we propose a parallel heterogeneous encoder, a hierarchical fusion module designed to achieve effective local-global co-representation. It consists of two parallel pathways: a local visual encoder for extracting multi-scale local visual features, and a global visual encoder for capturing efficient global visual features. The core innovation lies in its hierarchical fusion module, which progressively aggregates multi-scale features from both pathways, enabling dynamic cross-level feature interaction and contextual reconstruction to produce highly discriminative representations. These fused features are then adaptively routed through a mixture-of-experts classifier head, which dynamically dispatches them to the most suitable experts for fine-grained scene recognition. Experiments on AID, NWPU-RESISC45, and UC Merced show that our model achieves 93.72%, 95.54%, and 96.92% accuracy, surpassing SOTA methods with an optimal balance of performance and efficiency. Code is available at https://anonymous.4open.science/r/classification-41DF.

遥感图像特征融合混合专家场景分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。