轻量级遥感超分辨率模型,提升细节连续性与泛化能力
NGram-MoSE: Efficient Remote Sensing Super-Resolution via N-Gram Context and Mixture-of-Experts

- 引入N-Gram上下文注入与专家混合架构,增强局部一致性
- 在跨区域测试集上达31.68dB PSNR,计算量降低14倍
- 适合资源受限场景,对滑坡等下游任务有显著性能提升
遥感环境监测与灾害管理常面临时空权衡:高空间分辨率图像获取频率低,而高频观测则通常分辨率较粗。单图超分辨可在不改变采集周期的前提下提升图像质量,但许多基于Transformer的模型计算开销大,且对有限或地理分布偏倚的训练数据敏感,导致分布外泛化能力差。本文提出NGram-MoSE,一种轻量级Transformer架构,兼顾效率与纹理连续性。通过N-Gram上下文注入强化窗口间局部一致性,减少边界伪影;采用专家混合(MoE)前馈设计,在保持稀疏激活的前提下扩展模型容量,避免推理成本线性增长。在地理上分离的分布外测试集上,NGram-MoSE达到31.68 dB PSNR,相比重型Transformer参考模型降低14倍浮点运算量。在滑坡分割基准上的下游评估显示,将退化输入恢复至检测器训练尺度后,相较于双三次插值提升4.47% mAP@50,且在跨尺度外推下表现出更强的一致性。结果表明,NGram-MoSE为资源受限的遥感流水线提供了高效可靠的超分辨模块。
原文摘要 · Abstract (English)
Remote sensing applications for environmental monitoring and disaster management are frequently constrained by a spatial--temporal trade-off: imagery with fine spatial detail is often acquired less frequently, whereas more temporally available observations are typically coarser. Single-image super-resolution provides a practical means to enhance coarse imagery without changing acquisition schedules, yet many Transformer-based SR models remain computationally expensive and can be sensitive to limited or geographically biased training data, which degrades robustness under out-of-distribution conditions. This paper presents NGram-MoSE, a lightweight Transformer architecture designed to improve both efficiency and texture continuity. NGram-MoSE introduces N-Gram Context Injection to strengthen cross-window local consistency and mitigate window-boundary artifacts, and incorporates a Mixture-of-Experts (MoE) feed-forward design to scale capacity through sparse activation without proportional growth in inference cost. Experiments on a geographically disjoint OOD test set show that NGram-MoSE achieves 31.68\,dB PSNR while reducing FLOPs by \(14\times\) relative to a heavyweight Transformer reference. Downstream evaluation on a landslide segmentation benchmark further demonstrates that restoring degraded inputs to the detector training scale improves performance, yielding a 4.47\% absolute gain in mAP@50 over bicubic upsampling, and exhibits stronger cross-scale consistency under scale extrapolation. These results indicate that NGram-MoSE provides an effective SR module for resource-constrained remote sensing pipelines requiring robust generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。