用扩散模型统一修复古希腊文,支持断句、标调、补字等多任务。
Stoicheia: Character-Level Masked Diffusion for Ancient Greek Textual Restoration, Parsing, and Metrical Scansion
- 字符级掩码扩散架构,五维独立掩码处理字母、标点等特征。
- 在残缺铭文修复上错误率降低5.6点,语法解析准确率提升12.9点。
- 适合古文字复原、语言学研究者使用,提供无污染训练版本。
我们提出Stoicheia,一个405M参数的古希腊语字符级掩码扩散编码器,其输入包含五个对齐且可独立掩码的维度:字母、词与句边界、变音符号、大写和标点。单一主干模型即可在无需特定任务分词的情况下完成文本缺失修复、重新分段、重加变音符号和标点。该模型在3.8亿词的开放修订锁定语料库上预训练,并发布十一个检查点:十个去污染轮换折叠版本,确保任意文学文本至少有一个模型未见过;一个完全未接触文献文本的版本。三项实验——破损铭文与纸草文修复、形态句法标注与依存分析、长音化与韵律划分——均设有随机初始化对照组,以隔离字符级扩散预训练带来的贡献:铭文修复中字符错误率降低5.6点,依存分析提升12.9点LAS,长音化平衡准确率提升6.0点。在Ithaca自身测试集上,以相同冻结样本和严格评分标准,Stoicheia将字符错误率从24.6(Ithaca)和23.5(2025年Aeneas框架后继系统)降至15.5,并将顶1准确率从63.0和64.0提升至74.5。
原文摘要 · Abstract (English)
We introduce Stoicheia, a 405M-parameter character-level masked-diffusion encoder for Ancient Greek whose input factors into five aligned, independently maskable planes: letters, word and sentence boundaries, diacritics, capitalization, and punctuation. A single backbone can therefore restore lacunae, re-segment, accentuate, and punctuate unspaced text without task-specific retokenization. We pretrain it on an open, revision-pinned corpus of 380M words and release eleven checkpoints: ten rotated, decontaminated folds, guaranteeing that for any given literary passage at least one released model has never seen its text, and one with no exposure to documentary texts. Three experiments - reconstruction of damaged inscriptions and papyri, morphosyntactic tagging and dependency parsing, and macronization with metrical scansion - each carry a matched random-initialization control, isolating what character-level diffusion pretraining contributes: 5.6 CER points on inscription reconstruction, 12.9 LAS on parsing, and 6.0 points of balanced accuracy on macronization. On Ithaca's own test split, with identical frozen samples and strict scoring, Stoicheia reduces character error relative to both prior state-of-the-art systems, from 24.6 (Ithaca) and 23.5 (its 2025 Aeneas-framework successor) to 15.5, and raises top-1 accuracy from 63.0 and 64.0 to 74.5.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。