统一路由框架实现跨模态遥感变化检测,自适应选择最佳融合方式。
UniRoute: Unified Routing Mixture-of-Experts for Modality-Adaptive Remote Sensing Change Detection
- 将特征提取与融合转化为条件路由,动态分配局部细节与全局语义
- 在五个数据集上达到领先性能,统一部署下兼顾精度与效率
- 适合需要跨模态、低资源变化检测的科研与应用人员
当前遥感变化检测方法多依赖专用模型,难以扩展至跨模态地球观测场景。同源检测需精细空间线索和像素级交互,异源检测则需更广上下文以抑制斑点噪声和几何畸变。差异算子(如减法)在图像对齐时有效,但在跨模态或几何错位场景中引入伪影。现有基于固定骨干网络或固定差异操作的专用模型往往不足。为此,我们提出UniRoute,通过将特征提取与融合重构为条件路由问题,实现模态自适应学习。引入自适应感受野路由MoE(AR2-MoE)模块,分离局部空间细节与全局语义上下文;设计模态感知差异路由MoE(MDR-MoE)模块,逐像素自适应选择最优融合算子。此外,提出一致性感知自蒸馏(CASD)策略,在数据稀缺的异源设置下通过多层级一致性约束稳定统一训练。在五个公开数据集上的大量实验表明,UniRoute在统一部署设置下取得优异整体性能,具备良好的精度-效率权衡。
原文摘要 · Abstract (English)
Current remote sensing change detection (CD) methods mainly rely on specialized models, which limits the scalability toward modality-adaptive Earth observation. For homogeneous CD, precise boundary delineation relies on fine-grained spatial cues and local pixel interactions, whereas heterogeneous CD instead requires broader contextual information to suppress speckle noise and geometric distortions. Moreover, difference operator (e.g., subtraction) works well for aligned homogeneous images but introduces artifacts in cross-modal or geometrically misaligned scenarios. Across different modality settings, specialized models based on static backbones or fixed difference operations often prove insufficient. To address this challenge, we propose UniRoute, a unified framework for modality-adaptive learning by reformulating feature extraction and fusion as conditional routing problems. We introduce an Adaptive Receptive Field Routing MoE (AR2-MoE) module to disentangle local spatial details from global semantic context, and a Modality-Aware Difference Routing MoE (MDR-MoE) module to adaptively select the most suitable fusion primitive at each pixel. In addition, we propose a Consistency-Aware Self-Distillation (CASD) strategy that stabilizes unified training under data-scarce heterogeneous settings by enforcing multi-level consistency. Extensive experiments on five public datasets demonstrate that UniRoute achieves strong overall performance, with a favorable accuracy-efficiency trade-off under a unified deployment setting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。