arXiv:2507.10381cs.CVcs.LG2025-07被引 1

用拓扑分析增强遥感图像分类,提升精度并突破模型规模限制。

Improving Remote Sensing Classification using Topological Data Analysis and Convolutional Neural Networks

  • 将拓扑数据分析与卷积神经网络结合,提取几何特征补足纹理依赖缺陷。
  • 在EuroSAT上达99.33%准确率,比ResNet50高1.44%,超越更大模型表现。
  • 首次将拓扑特征用于卫星图像分类,适合关注模型效率与泛化性的研究者。

拓扑数据分析(TDA)是一种新兴领域,因其对复杂数据集的鲁棒性及量化几何信息的能力而迅速普及。在图像分析中,TDA通常将数据建模为过滤立方复形,并通过持久同调提取判别性特征。相比之下,卷积神经网络(CNN)往往依赖局部纹理特征,存在偏差。为此,我们提出一种TDA特征工程流程,以及一种简单方法将拓扑特征融合进深度学习模型,用于遥感图像分类。该方法使ResNet18在EuroSAT数据集上的准确率达到99.33%,较此前所有单模型记录更高,甚至优于两倍大的ResNet50和197倍大的XL Vision Transformers。在RESISC45数据集上,准确率也比基线提升1.82%。据我们所知,这是首次将TDA特征应用于卫星场景分类的深度学习模型。结果表明,即使在无明确拓扑结构的数据集中,拓扑特征也可有效融入深度学习,拓展了TDA的应用范围。代码将在发表后公开。

原文摘要 · Abstract (English)

Topological data analysis (TDA) is a relatively new field that is gaining rapid adoption due to its robustness and ability to effectively describe complex datasets by quantifying geometric information. In imaging contexts, TDA typically models data as filtered cubical complexes from which we can extract discriminative features using persistence homology. Meanwhile, convolutional neural networks (CNNs) have been shown to be biased towards texture based local features. To address this limitation, we propose a TDA feature engineering pipeline and a simple method to integrate topological features with deep learning models on remote sensing classification. Our method improves the performance of a ResNet18 model on the EuroSAT dataset by 1.44% achieving 99.33% accuracy, which surpasses all previously reported single-model accuracies, including those with larger architectures, such as ResNet50 (2x larger) and XL Vision Transformers (197x larger). We additionally show that our method's accuracy is 1.82% higher than our ResNet18 baseline on the RESISC45 dataset. To our knowledge, this is the first application of TDA features in satellite scene classification with deep learning. This demonstrates that TDA features can be integrated with deep learning models, even on datasets without explicit topological structures, thereby increasing the applicability of TDA. A clean implementation of our method will be made publicly available upon publication.

遥感分类拓扑分析深度学习特征融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。