用解析表达式语法自动构建阿拉伯语-英语词典的结构化数据
Towards Structuring an Arabic-English Machine-Readable Dictionary Using Parsing Expression Grammars
- 分步解析词典文本，将字面流转为层级结构
- 成功提取词条、定义短语、领域标签等组件
- 适合语言工程与词典数字化研究者参考
词典是自然语言处理和人机交互技术中不可或缺的词汇信息来源。然而，出版商制作的印刷词典面向人类阅读，并非为机器处理设计。本文提出一种方法，对阿拉伯语-英语《Al-Mawrid》词典的部分条目进行结构化处理，将原始文本流（单词与标点）转换为具有层次关系的结构。每个词条包含子条目，每个子条目又由定义短语、领域标签、交叉引用及翻译对应项构成。方法采用级联步骤，以解析表达式语法（Parsing Expression Grammars）实现核心解析过程。尽管阿拉伯语词典缺乏统一的微观结构标准，本研究证明：通过推导其内部结构，可实现自动或半自动的结构化处理，且具备合理准确率。
原文摘要 · Abstract (English)
Dictionaries are rich sources of lexical information about words that is required for many applications of natural language processing and human language technology. However, publishers prepare printed dictionaries for human usage not for machine processing. This paper presented a method to structure partly a machine-readable version of the Arabic-English Al-Mawrid dictionary. The method converted the entries of Al-Mawrid from a stream of words and punctuation marks into hierarchical structures. The hierarchical structure expresses the components of each dictionary entry in explicit format. A dictionary entry is composed of subentries and each subentry consists of defining phrases, domain labels, cross-references, and translation equivalences. We designed the proposed method as cascaded steps where parsing is the main step. We implemented the parser using the parsing expression grammars formalism. In conclusion, although Arabic dictionaries do not have microstructure standardization, this study demonstrated that it is possible to structure them automatically or semi-automatically with plausible accuracy after inducing their microstructure.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。