用原型对齐技术还原楔形文字内部结构,提升识别准确率。
ProtoSnap: Prototype Alignment for Cuneiform Signs
- 基于骨架模板与生成模型,对齐楔形文字原型结构。
- 在多种复杂形态下实现高精度对齐,尤其提升稀有符号识别效果。
- 适用于古文字研究者及需要结构化数据的数字人文项目。
楔形文字系统在古代近东使用超过三千年,其符号内部结构复杂,蕴含书写与文化演变的历史信息。以往自动化方法多将符号类型视为离散类别,未显式建模其多样化内部构型。本文提出无监督方法ProtoSnap,利用强大的生成模型和原型字体图像的外观与结构作为先验,通过深度图像特征匹配并强制结构一致性,将基于骨架的模板“对齐”至拍摄的楔形文字符号。我们构建了新的专家标注基准并进行评估,结果表明该方法能有效对齐各类楔形文字符号。此外,基于该方法生成的结构正确合成数据显著提升了楔形文字识别性能,尤其在稀有符号上表现突出。代码、数据与训练模型已公开于项目页面:https://tau-vailab.github.io/ProtoSnap/
原文摘要 · Abstract (English)
The cuneiform writing system served as the medium for transmitting knowledge in the ancient Near East for a period of over three thousand years. Cuneiform signs have a complex internal structure which is the subject of expert paleographic analysis, as variations in sign shapes bear witness to historical developments and transmission of writing and culture over time. However, prior automated techniques mostly treat sign types as categorical and do not explicitly model their highly varied internal configurations. In this work, we present an unsupervised approach for recovering the fine-grained internal configuration of cuneiform signs by leveraging powerful generative models and the appearance and structure of prototype font images as priors. Our approach, ProtoSnap, enforces structural consistency on matches found with deep image features to estimate the diverse configurations of cuneiform characters, snapping a skeleton-based template to photographed cuneiform signs. We provide a new benchmark of expert annotations and evaluate our method on this task. Our evaluation shows that our approach succeeds in aligning prototype skeletons to a wide variety of cuneiform signs. Moreover, we show that conditioning on structures produced by our method allows for generating synthetic data with correct structural configurations, significantly boosting the performance of cuneiform sign recognition beyond existing techniques, in particular over rare signs. Our code, data, and trained models are available at the project page: https://tau-vailab.github.io/ProtoSnap/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。