通过局部一致性增强,提升小样本遥感图像分类精度
Locally Consistent Transductive Information Maximization for Few-Shot Remote Sensing Scene Classification

- 引入局部一致性正则项,强制查询样本与邻居预测一致
- 在低样本场景下准确率领先,最高提升达12.3%
- 适合遥感图像批量推理任务,尤其小样本场景
遥感场景分类日益依赖在大规模地球观测数据上预训练的基础模型。同时,归纳推理(transductive inference)利用整个无标签查询集的统计结构,天然契合遥感处理流程中将大图像切分为块并批量推理的模式。本文提出LC-TIM(局部一致的归纳信息最大化),在现有最先进的少样本CLIP归纳信息最大化(TIM++)目标基础上,加入局部一致性正则项,强制每个查询样本与其κ个最近邻在特征空间中的预测保持一致。该正则项以单一乘法因子形式融入闭式q更新,计算开销极低。进一步提出多源融合方法,整合多个遥感基础模型的亲和图,显著提升分类精度。为评估方法性能,我们建立了首个全面的开源基准,涵盖十种不同遥感数据集、两种视觉-语言模型及多种少样本设置,对比LP++、TransCLIP、TIM++和LC-TIM。实验表明,归纳方法持续优于零样本基线,且LC-TIM达到当前最优性能,在低样本场景下增益最大(最高提升12.3%)。代码已公开于:https://github.com/elkhouryk/LC-TIM
原文摘要 · Abstract (English)
Remote sensing scene classification is increasingly relying on foundation models pre-trained on large-scale Earth-observation data. Moreover, transductive inference, which exploits the collective statistical structure of the entire unlabeled query set, appears to naturally match remote sensing pipelines where large images are routinely split into patches and inferred as a batch. In this work, we introduce LC-TIM (Locally Consistent Transductive Information Maximization), which extends the state-of-the-art Transductive Information Maximization for Few-Shot CLIP (TIM++) objective with a local consistency regularizer that enforces prediction agreement between each query sample and its $κ$ nearest feature-space neighbors. The regularizer enters as a single multiplicative factor in the closed-form $q$-update, adding negligible computational overhead. We further propose a multi-source extension that fuses the affinity graph from multiple remote sensing foundation model, further boosting classification accuracy. To assess these methods, we establish the first comprehensive, open-source benchmark for transductive few-shot RS scene classification, evaluating LP++, TransCLIP, TIM++, and LC-TIM across ten diverse datasets, two remote sensing vision-language models, and across various few-shot settings. Our experiments show that transductive methods consistently outperform zero-shot baselines, and that LC-TIM achieves state-of-the-art accuracy, with the largest gains in the low-shot regime where neighborhood cues are most informative. Code is publicly available at: https://github.com/elkhouryk/LC-TIM
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。