用提示词技术让低分辨率土地覆盖图自动变高清,无需大量标注。
MapSR: Prompt-Driven Land Cover Map Super-Resolution via Vision Foundation Models

- 用冻结的视觉模型提取类别提示,实现无训练映射
- 在切萨皮克湾数据集上达59.64% mIoU,超越全监督基线
- 参数量减少万倍,训练从小时级缩至分钟级,适合资源受限场景
高分辨率(HR)土地覆盖制图常受密集高分辨率标注成本高昂限制。本文从地图超分辨率视角重新审视该问题,将粗粒度低分辨率(LR)土地覆盖产品提升至与输入影像同分辨率的高分辨率地图。现有弱监督方法虽可利用LR标签,但通常需重训密集预测器,计算开销大。本文提出MapSR,一种提示驱动的框架,将监督与模型训练解耦。MapSR仅一次使用LR标签,通过轻量级线性探测器从冻结视觉基础模型特征中提取类别提示;随后通过无训练度量推理和基于图的预测优化完成高分辨率制图。具体而言,类别提示通过线性探测器识别的高置信度高分辨率特征聚合获得,高分辨率预测通过余弦相似度匹配并结合图传播进行空间优化。在切萨皮克湾数据集上的实验表明,MapSR在未使用任何高分辨率标签的情况下达到59.64% mIoU,性能媲美最强弱监督基线,并超越全监督基线。显著地,MapSR将可训练参数减少四个数量级,训练时间从数小时缩短至数分钟,实现了在标注和算力受限条件下的可扩展高分辨率制图。代码已开源。
原文摘要 · Abstract (English)
High-resolution (HR) land-cover mapping is often constrained by the high cost of dense HR annotations. We revisit this problem from the perspective of map super-resolution, which enhances coarse low-resolution (LR) land-cover products into HR maps at the resolution of the input imagery. Existing weakly supervised methods can leverage LR labels, but they typically use them to retrain dense predictors with substantial computational cost. We propose MapSR, a prompt-driven framework that decouples supervision from model training. MapSR uses LR labels once to extract class prompts from frozen vision foundation model features through a lightweight linear probe, after which HR mapping proceeds via training-free metric inference and graph-based prediction refinement. Specifically, class prompts are estimated by aggregating high-confidence HR features identified by the linear probe, and HR predictions are obtained by cosine-similarity matching followed by graph-based propagation for spatial refinement. Experiments on the Chesapeake Bay dataset show that MapSR achieves 59.64% mIoU without any HR labels, remaining competitive with the strongest weakly supervised baseline and surpassing a fully supervised baseline. Notably, MapSR reduces trainable parameters by four orders of magnitude and shortens training time from hours to minutes, enabling scalable HR mapping under limited annotation and compute budgets. The code is available at https://github.com/rikirikirikiriki/MapSR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。