arXiv:2506.21826cs.CVcs.AI2025-06中稿 · ICDAR2025被引 2

用少量标注数据精准分割历史地图,靠大模型语义能力+高效微调。

Few-Shot Segmentation of Historical Maps via Linear Probing of Vision Foundation Models

  • 利用视觉大模型嵌入+参数高效微调实现少样本分割。
  • 10样本下葡萄园与铁路分割mIoU提升5%~13%,5样本下提升20%。
  • 仅需68.9万可训练参数,适合低数据场景的图像分割任务。

作为历史的重要载体,地图提供了丰富的历史变迁信息,但其多样的视觉表现和有限的标注数据给自动化处理带来挑战。本文提出一种简单而有效的少样本历史地图分割方法,利用大规模视觉基础模型的丰富语义嵌入,并结合参数高效的微调策略。在Siegfried基准数据集上,该方法在10样本场景下对葡萄园和铁路分割的mIoU分别提升5%和13%,在更困难的5样本设置下相对提升达20%。此外,在ICDAR 2021竞赛数据集上,尽管未针对形状敏感指标优化,仍取得67.3%的平均PQ用于建筑块分割,体现出良好泛化性。本方法在极低数据条件下(10-、5样本)保持高性能,且仅需68.9万可训练参数,占总模型规模的0.21%。该方法大幅降低人工标注需求,推动历史地图的自动化分析。代码已公开:https://github.com/RafaelSterzinger/few-shot-map-segmentation。

原文摘要 · Abstract (English)

As rich sources of history, maps provide crucial insights into historical changes, yet their diverse visual representations and limited annotated data pose significant challenges for automated processing. We propose a simple yet effective approach for few-shot segmentation of historical maps, leveraging the rich semantic embeddings of large vision foundation models combined with parameter-efficient fine-tuning. Our method outperforms the state-of-the-art on the Siegfried benchmark dataset in vineyard and railway segmentation, achieving +5% and +13% relative improvements in mIoU in 10-shot scenarios and around +20% in the more challenging 5-shot setting. Additionally, it demonstrates strong performance on the ICDAR 2021 competition dataset, attaining a mean PQ of 67.3% for building block segmentation, despite not being optimized for this shape-sensitive metric, underscoring its generalizability. Notably, our approach maintains high performance even in extremely low-data regimes (10- & 5-shot), while requiring only 689k trainable parameters - just 0.21% of the total model size. Our approach enables precise segmentation of diverse historical maps while drastically reducing the need for manual annotations, advancing automated processing and analysis in the field. Our implementation is publicly available at: https://github.com/RafaelSterzinger/few-shot-map-segmentation.

少样本分割历史地图视觉模型参数高效

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。