arXiv:2410.04546cs.CV2024-10NeurIPS被引 7

解决遥感图像分类中少数类别特征被压制的问题,提升模型对小类别的识别能力。

Learning De-Biased Representations for Remote-Sensing Imagery

  • 通过聚类提取共性特征,无监督地增强少数类的表示多样性。
  • 在遥感图像迁移任务中,对尾部类别性能提升最高达4.7个百分点。
  • 适用于各类LoRA方法,适合遥感领域数据不平衡场景下的模型优化。

遥感图像因数据稀缺和特定波段类别不平衡,导致训练大规模模型困难且迁移模型易产生偏差。本文提出debLoRA,一种通用无监督训练方法,可与任意LoRA变体结合,生成去偏特征。该方法基于主要类别与次要类别的共享属性(通过聚类获得),增强少数类特征的多样性。我们在自然图像到光学遥感、光学遥感到多光谱遥感两种迁移场景下进行评估,在DOTA(光学遥感)和FUSRS(SAR)数据集上完成目标分类与定向检测任务。结果表明,debLoRA在各类适应设置中均优于现有方法,分别在自然→光学遥感和光学→多光谱遥感迁移中对尾部类别提升3.3%和4.7%,同时保持头部类性能稳定,验证了其有效性与适应性。

原文摘要 · Abstract (English)

Remote sensing (RS) imagery, requiring specialized satellites to collect and being difficult to annotate, suffers from data scarcity and class imbalance in certain spectrums. Due to data scarcity, training any large-scale RS models from scratch is unrealistic, and the alternative is to transfer pre-trained models by fine-tuning or a more data-efficient method LoRA. Due to class imbalance, transferred models exhibit strong bias, where features of the major class dominate over those of the minor class. In this paper, we propose debLoRA, a generic training approach that works with any LoRA variants to yield debiased features. It is an unsupervised learning approach that can diversify minor class features based on the shared attributes with major classes, where the attributes are obtained by a simple step of clustering. To evaluate it, we conduct extensive experiments in two transfer learning scenarios in the RS domain: from natural to optical RS images, and from optical RS to multi-spectrum RS images. We perform object classification and oriented object detection tasks on the optical RS dataset DOTA and the SAR dataset FUSRS. Results show that our debLoRA consistently surpasses prior arts across these RS adaptation settings, yielding up to 3.3 and 4.7 percentage points gains on the tail classes for natural to optical RS and optical RS to multi-spectrum RS adaptations, respectively, while preserving the performance on head classes, substantiating its efficacy and adaptability.

遥感图像去偏学习LoRA小样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。