arXiv:2506.15010cs.CV2025-06KDD被引 13

针对古地图文字识别难题,提出端到端检测与识别模型PALETTE。

Hyper-Local Deformable Transformers for Text Spotting on Historical Maps

  • 设计超局部采样模块,精准捕捉文字边界点与字符特征。
  • 引入超局部位置嵌入,增强文字组件间空间关系建模能力。
  • 自动生成合成古地图数据集SynthMap+,解决训练数据稀缺问题。

古地图上的文字蕴含丰富的地理、历史与文化信息,但其文字提取面临有效方法和训练数据匮乏的挑战。以往方法依赖特定地图风格的定制步骤,而近期基于机器学习的文字定位器虽具灵活性,却难以精确捕捉长且高度旋转的文字实例中每个子组件(边界点与字符)的图像特征。本文提出PALETTE,一种适用于扫描古地图的端到端文字定位器。该模型引入新型超局部采样模块,显式学习目标边界点与字符周围的局部图像特征;同时支持超局部位置嵌入,以建模文本实例内及跨实例的边界点与字符间空间交互。此外,本文提出SynthMap+,一种自动构建合成古地图图像的新方法,用于训练古地图文字定位器。实验表明,结合SynthMap+的PALETTE在两个新古地图基准数据集上超越现有最先进方法,尤其对长文本和倾斜文本表现优异。目前,已用PALETTE与SynthMap+处理超过6万张大卫·伦西历史地图馆藏地图,生成超1亿条文字标签,支撑地图搜索功能。项目开源地址:https://github.com/kartta-foundation/mapkurator-palette-doc。

原文摘要 · Abstract (English)

Text on historical maps contains valuable information providing georeferenced historical, political, and cultural contexts. However, text extraction from historical maps is challenging due to the lack of (1) effective methods and (2) training data. Previous approaches use ad-hoc steps tailored to only specific map styles. Recent machine learning-based text spotters (e.g., for scene images) have the potential to solve these challenges because of their flexibility in supporting various types of text instances. However, these methods remain challenges in extracting precise image features for predicting every sub-component (boundary points and characters) in a text instance. This is critical because map text can be lengthy and highly rotated with complex backgrounds, posing difficulties in detecting relevant image features from a rough text region. This paper proposes PALETTE, an end-to-end text spotter for scanned historical maps of a wide variety. PALETTE introduces a novel hyper-local sampling module to explicitly learn localized image features around the target boundary points and characters of a text instance for detection and recognition. PALETTE also enables hyper-local positional embeddings to learn spatial interactions between boundary points and characters within and across text instances. In addition, this paper presents a novel approach to automatically generate synthetic map images, SynthMap+, for training text spotters for historical maps. The experiment shows that PALETTE with SynthMap+ outperforms SOTA text spotters on two new benchmark datasets of historical maps, particularly for long and angled text. We have deployed PALETTE with SynthMap+ to process over 60,000 maps in the David Rumsey Historical Map collection and generated over 100 million text labels to support map searching. The project is released at https://github.com/kartta-foundation/mapkurator-palette-doc.

文字定位古地图超局部合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。