构建首个大规模他加禄语依存句法树库，助力低资源语言研究
The UD-NewsCrawl Treebank: Reflections and Challenges from a Large-scale Tagalog Syntactic Annotation Project
- 基于通用依存框架人工标注15.6千棵树
- 多模型基线评估显示当前解析器在菲律宾语上表现有限
- 揭示他加禄语语法特性对标注的挑战，适合语言技术研究者
本文介绍目前最大的他加禄语树库UD-NewsCrawl，包含15.6千个依据通用依存框架（Universal Dependencies）手动标注的句法树。文章详述了树库开发流程，包括数据收集、预处理、人工标注与质量保障。通过多种基于Transformer的模型进行基线评估，检验了当前最先进的依存句法解析器在他加禄语上的表现。同时，文章指出由于他加禄语独特的语法特征，在句法分析中存在诸多挑战，并讨论其对本树库标注工作的具体影响。我们预期UD-NewsCrawl及配套基线模型将为推动如他加禄语等低资源语言的计算语言学研究提供重要支持。
原文摘要 · Abstract (English)
This paper presents UD-NewsCrawl, the largest Tagalog treebank to date, containing 15.6k trees manually annotated according to the Universal Dependencies framework. We detail our treebank development process, including data collection, pre-processing, manual annotation, and quality assurance procedures. We provide baseline evaluations using multiple transformer-based models to assess the performance of state-of-the-art dependency parsers on Tagalog. We also highlight challenges in the syntactic analysis of Tagalog given its distinctive grammatical properties, and discuss its implications for the annotation of this treebank. We anticipate that UD-NewsCrawl and our baseline model implementations will serve as valuable resources for advancing computational linguistics research in underrepresented languages like Tagalog.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。