arXiv:2411.06971cs.CV2024-11被引 16

用少量数据让AI自动识别历史地图上的地理特征

MapSAM: Adapting Segment Anything Model for Automated Feature Detection in Historical Maps

  • 通过参数高效微调让SAM模型无需人工提示即可工作
  • 仅用10张样本就实现良好性能,适合稀缺数据场景
  • 专为历史地图设计,可自动检测线状与面状地理要素

历史地图的自动化特征检测能显著加速地理时空重建,但受限于高质量标注数据的耗时手动标注。视觉基础模型如分割一切模型(SAM)具备强大泛化能力,但直接零样本应用于历史地图时存在地理特征识别差、依赖人工提示等问题。为此,我们提出MapSAM,一种参数高效的微调策略,使SAM变为无需提示、适用于多种下游任务的通用解决方案。具体包括:采用权重分解低秩适应(DoRA)注入领域知识到图像编码器;设计自动提示生成机制;将位置提示升级为更高级别的语义位置提示;修改掩码解码器中的交叉注意力机制,引入掩码注意力以增强特征聚合。在两个不同历史地图分割任务中,该框架表现优异,即使在极小样本(如10次射击)下也展现出良好适应性。

原文摘要 · Abstract (English)

Automated feature detection in historical maps can significantly accelerate the reconstruction of the geospatial past. However, this process is often constrained by the time-consuming task of manually digitizing sufficient high-quality training data. The emergence of visual foundation models, such as the Segment Anything Model (SAM), offers a promising solution due to their remarkable generalization capabilities and rapid adaptation to new data distributions. Despite this, directly applying SAM in a zero-shot manner to historical map segmentation poses significant challenges, including poor recognition of certain geospatial features and a reliance on input prompts, which limits its ability to be fully automated. To address these challenges, we introduce MapSAM, a parameter-efficient fine-tuning strategy that adapts SAM into a prompt-free and versatile solution for various downstream historical map segmentation tasks. Specifically, we employ Weight-Decomposed Low-Rank Adaptation (DoRA) to integrate domain-specific knowledge into the image encoder. Additionally, we develop an automatic prompt generation process, eliminating the need for manual input. We further enhance the positional prompt in SAM, transforming it into a higher-level positional-semantic prompt, and modify the cross-attention mechanism in the mask decoder with masked attention for more effective feature aggregation. The proposed MapSAM framework demonstrates promising performance across two distinct historical map segmentation tasks: one focused on linear features and the other on areal features. Experimental results show that it adapts well to various features, even when fine-tuned with extremely limited data (e.g. 10 shots).

历史地图目标检测SAM少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。