用计算方法测出罗曼语族语言间的相互理解度。
Measuring cross-language intelligibility between Romance languages with computational tools
- 基于词汇表层与语义相似性构建新评估指标
- 五种主要罗曼语间理解度得分与人类实验高度相关
- 结果揭示语言间理解不对称性,适合语言学与NLP研究者
我们对罗曼语族相关语言的相互理解度进行了分析,提出一种基于词汇表层和语义相似性的新型计算度量方法,用于评估法语、意大利语、葡萄牙语、西班牙语和罗马尼亚语这五种主要罗曼语之间的相互理解度。通过比较词形与语音形式,以及不同平行语料库和词向量模型下的表现,得出的智能度分数与人类闭合测试结果显著相关,验证了语言间理解不对称性的直觉认知。
原文摘要 · Abstract (English)
We present an analysis of mutual intelligibility in related languages applied for languages in the Romance family. We introduce a novel computational metric for estimating intelligibility based on lexical similarity using surface and semantic similarity of related words, and use it to measure mutual intelligibility for the five main Romance languages (French, Italian, Portuguese, Spanish, and Romanian), and compare results using both the orthographic and phonetic forms of words as well as different parallel corpora and vectorial models of word meaning representation. The obtained intelligibility scores confirm intuitions related to intelligibility asymmetry across languages and significantly correlate with results of cloze tests in human experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。