提出分层遥感分类新范式,支持多粒度预测与跨领域迁移。
HieraRS: A Hierarchical Segmentation Paradigm for Remote Sensing Enabling Multi-Granularity Interpretation and Cross-Domain Transfer
- 设计双向分层一致性机制,让普通模型输出分层标签。
- 在多模态数据集上实现94.3%的分层分类准确率。
- 适合需要灵活扩展类别体系的遥感应用开发者。
面向遥感影像的分层地表覆盖与用地分类旨在为像素赋予多层次语义标签。现有深度学习方法主要采用扁平分类范式,难以生成与实际树状层级结构对齐的端到端多粒度预测;且多数跨域研究关注传感器或场景变化导致的性能下降,忽视了将地表覆盖模型迁移至具有异构层级结构的任务(如地表覆盖到作物分类)的挑战。为此,本文提出HieraRS,一种新型分层解释范式,支持多粒度预测并实现跨领域高效迁移。引入双向分层一致性约束机制(BHCCM),可无缝集成于主流扁平分类模型,生成分层预测,同时提升语义一致性与分类精度。进一步提出TransLU双分支跨域迁移框架,包含跨域知识共享(CDKS)与跨域语义对齐(CDSA),支持动态类别扩展,并促进地表覆盖模型向异构层级任务的有效适应。此外,构建了大规模多模态分层土地利用数据集MM-5B,包含像素级标注。代码与数据集将公开于:https://github.com/AI-Tianlong/HieraRS。
原文摘要 · Abstract (English)
Hierarchical land cover and land use (LCLU) classification aims to assign pixel-wise labels with multiple levels of semantic granularity to remote sensing (RS) imagery. However, existing deep learning-based methods face two major challenges: 1) They predominantly adopt a flat classification paradigm, which limits their ability to generate end-to-end multi-granularity hierarchical predictions aligned with tree-structured hierarchies used in practice. 2) Most cross-domain studies focus on performance degradation caused by sensor or scene variations, with limited attention to transferring LCLU models to cross-domain tasks with heterogeneous hierarchies (e.g., LCLU to crop classification). These limitations hinder the flexibility and generalization of LCLU models in practical applications. To address these challenges, we propose HieraRS, a novel hierarchical interpretation paradigm that enables multi-granularity predictions and supports the efficient transfer of LCLU models to cross-domain tasks with heterogeneous tree-structured hierarchies. We introduce the Bidirectional Hierarchical Consistency Constraint Mechanism (BHCCM), which can be seamlessly integrated into mainstream flat classification models to generate hierarchical predictions, while improving both semantic consistency and classification accuracy. Furthermore, we present TransLU, a dual-branch cross-domain transfer framework comprising two key components: Cross-Domain Knowledge Sharing (CDKS) and Cross-Domain Semantic Alignment (CDSA). TransLU supports dynamic category expansion and facilitates the effective adaptation of LCLU models to heterogeneous hierarchies. In addition, we construct MM-5B, a large-scale multi-modal hierarchical land use dataset featuring pixel-wise annotations. The code and MM-5B dataset will be released at: https://github.com/AI-Tianlong/HieraRS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。