arXiv:2409.03901cs.CVeess.SP2024-09被引 18

对比14种模型,找出最适合卫星实时图像分类的高效低耗方案。

Onboard Satellite Image Classification for Earth Observation: A Comparative Study of ViT Models

  • 采用地面训练、星上推理流程,测试多种模型在真实干扰下的表现。
  • EfficientViT-M2在欧空局数据集上达98.76%准确率,功耗比MobileViTV2低63%
  • 适合对精度、能耗和抗干扰性有高要求的星载遥感应用

遥感图像分类是地球观测的核心,但星上部署需兼顾准确性、效率与抗传感器及传输退化能力。基于‘地面训练、星上推理’流程,我们在EuroSAT和PatternNet数据集上评估了14种骨干网络,包括CNN、ResNets、从零训练的小型Transformer以及预训练的Vision Transformers。测试涵盖干净数据性能、计算开销、功耗,以及高斯噪声、运动模糊和端到端的DVB-S2(X)传输链(含信道损伤与JPEG压缩)下的鲁棒性。结果表明,预训练Vision Transformers普遍优于从零训练模型,兼具更高效率与更强抗扰能力。MobileViTV2在干净EuroSAT上取得最高准确率99.09%,而EfficientViT-M2展现最佳综合平衡:在EuroSAT上达到98.76%准确率、精确率与召回率,在PatternNet上达99.52%准确率,仅需203.53 MFLOPs、38.19 MB存储空间,鲁棒性评分为0.79。其在传输损失下退化最平缓,功耗较MobileViTV2降低63.35%,较Swin Transformer降低73.33%。代码已公开,涵盖数据增强、扰动生成、训练与推理。

原文摘要 · Abstract (English)

Remote sensing (RS) image classification is central to Earth observation, but onboard deployment requires models that are accurate, efficient, and robust to sensor and transmission degradation. Following a train-on-ground, infer-onboard workflow, we evaluate 14 backbones, including CNNs, ResNets, compact Transformers trained from scratch, and pre-trained Vision Transformers, on EuroSAT and PatternNet. We assess clean-data performance, computational cost, power consumption, and robustness to Gaussian noise, motion blur, and an end-to-end DVB-S2(X) transmission chain with channel impairments and JPEG compression. Pre-trained Vision Transformers generally outperform models trained from scratch while providing better efficiency and corruption resilience. MobileViTV2 achieves the highest clean EuroSAT accuracy at 99.09%, whereas EfficientViT-M2 provides the strongest overall trade-off. It attains 98.76% accuracy, precision, and recall on EuroSAT and 99.52% accuracy on PatternNet, with 203.53 MFLOPs, a 38.19 MB footprint, and the best overall robustness score of 0.79. It also degrades most gracefully under transmission loss and consumes 63.35% less power than MobileViTV2 and 73.33% less than Swin Transformer. These results identify EfficientViT-M2 as a strong backbone for reliable, energy-efficient onboard RS image classification. Code for data augmentation, corruption generation, training, and inference is publicly available.

遥感图像星载模型视觉Transformer能效优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。