arXiv:2506.17603cs.CLcs.CY2025-06

用神经模型验证维基词典对拉丁语和意大利语动词缺陷性的记录,发现其可靠性差异显著。

Mind the Gap: Assessing Wiktionary's Crowd-Sourced Linguistic Knowledge on Morphological Gaps in Two Related Languages

  • 构建神经形态分析器,自动标注拉丁语与意大利语语料库中的动词变形
  • 7%的拉丁语缺陷动词在语料中实际存在对应变形,说明维基词典有误报
  • 为稀有语言现象的数据质量评估提供可扩展的计算方法,适合语言学家和NLP研究者

形态缺陷性是语言学中一个引人注目但研究不足的现象。弥补形态缺陷(即预期的变位形式缺失)对提升形态丰富语言的自然语言处理工具准确性至关重要。然而,传统语言资源往往缺乏对形态空缺的覆盖,因这类知识需大量人力与专业知识来记录和验证。对于研究较少的语言,维基百科和维基词典常是唯一可获取的资源。尽管覆盖广泛,其可靠性一直存疑。本研究定制了一种新型神经形态分析器,用于标注拉丁语和意大利语语料库。基于大规模标注数据,对维基词典中用户贡献的缺陷动词列表进行计算验证。结果表明,维基词典对意大利语形态空缺的记录高度可靠,但7%的拉丁语词根被列为缺陷动词,却在语料中显示出明确的变位证据,说明其存在误判。这一差异揭示了众包维基在罕见语言现象上的局限性,尽管其仍具价值。本研究通过提供可扩展的质量评估工具,推进了计算形态学发展,并拓展了非英语、形态丰富的语言中缺陷性的认知。

原文摘要 · Abstract (English)

Morphological defectivity is an intriguing and understudied phenomenon in linguistics. Addressing defectivity, where expected inflectional forms are absent, is essential for improving the accuracy of NLP tools in morphologically rich languages. However, traditional linguistic resources often lack coverage of morphological gaps as such knowledge requires significant human expertise and effort to document and verify. For scarce linguistic phenomena in under-explored languages, Wikipedia and Wiktionary often serve as among the few accessible resources. Despite their extensive reach, their reliability has been a subject of controversy. This study customizes a novel neural morphological analyzer to annotate Latin and Italian corpora. Using the massive annotated data, crowd-sourced lists of defective verbs compiled from Wiktionary are validated computationally. Our results indicate that while Wiktionary provides a highly reliable account of Italian morphological gaps, 7% of Latin lemmata listed as defective show strong corpus evidence of being non-defective. This discrepancy highlights potential limitations of crowd-sourced wikis as definitive sources of linguistic knowledge, particularly for less-studied phenomena and languages, despite their value as resources for rare linguistic features. By providing scalable tools and methods for quality assurance of crowd-sourced data, this work advances computational morphology and expands linguistic knowledge of defectivity in non-English, morphologically rich languages.

形态学众包数据语言学拉丁语

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。