无需预训练,小模型快速实现高精度遥感图像分割
Deep Global Clustering for Hyperspectral Image Segmentation: Concepts, Applications, and Open Challenges
- 通过重叠小块局部观察学习全局聚类结构
- 在消费级硬件上30分钟内完成训练,内存恒定
- 适合农业病害等特定场景的无监督分割应用
高光谱成像(HSI)分析因数据量庞大面临计算瓶颈,现有大模型在近距农业监测等特定场景中迁移效果差。本文提出深度全局聚类(DGC)框架,无需预训练即可从局部图像块学习全局聚类结构。该方法通过重叠区域保证一致性,在消费级硬件上训练时间小于30分钟,且内存使用恒定。在叶部病害数据集上,实现了背景-组织分离(平均IoU 0.925),并支持可导航的语义粒度无监督病害检测。然而,由于多目标损失平衡问题,模型存在优化不稳定性:特征空间中聚类易过度合并导致表示退化。本工作定位为概念性支撑框架,其设计思想有价值,但稳定实现需解决动态损失平衡问题。代码与数据已公开于 https://github.com/b05611038/HSI_global_clustering。
原文摘要 · Abstract (English)
Hyperspectral imaging (HSI) analysis faces computational bottlenecks due to massive data volumes that exceed available memory. While foundation models pre-trained on large remote sensing datasets show promise, their learned representations often fail to transfer to domain-specific applications like close-range agricultural monitoring where spectral signatures, spatial scales, and semantic targets differ fundamentally. This report presents Deep Global Clustering (DGC), a conceptual framework for memory-efficient HSI segmentation that learns global clustering structure from local patch observations without pre-training. DGC operates on small patches with overlapping regions to enforce consistency, enabling training in under 30 minutes on consumer hardware while maintaining constant memory usage. On a leaf disease dataset, DGC achieves background-tissue separation (mean IoU 0.925) and demonstrates unsupervised disease detection through navigable semantic granularity. However, the framework suffers from optimization instability rooted in multi-objective loss balancing: meaningful representations emerge rapidly but degrade due to cluster over-merging in feature space. We position this work as intellectual scaffolding - the design philosophy has merit, but stable implementation requires principled approaches to dynamic loss balancing. Code and data are available at https://github.com/b05611038/HSI_global_clustering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。