用深度学习模型分析芬兰语词形变化类别的真实性和学习机制。
Analyzing Finnish Inflectional Classes through Discriminative Lexicon and Deep Learning Models
- 用判别性词典模型直接学习词形变化,不预先设定词形类别。
- 模型在高频词和活跃类上表现更好,低频与生僻词更难处理。
- 使用频率信息的模型更接近真实语言学习过程,适合语言习得研究。
复杂名词或动词系统的描述依赖于词形变化类。词形变化类将具有相似词干变化和相同词形标记的词归为一类。尽管这些分类对语言教学和有限状态形态系统构建有帮助,但它们在认知上是否真实仍不清楚——母语者是否需要发现这些类别才能正确变形。本研究通过判别性词典模型(DLM)探究芬兰语词形变化类别的可学习性,使用包含49个词形类、2000个高频词、共55,271个变体的语料库。设置了多种理解与生成模型,部分模型未考虑使用频率(无限暴露假设),另一些则引入词频信息(基于使用的学习)。训练数据上模型准确率极高;测试集上准确率下降但仍可接受。多数模型在类型多、低频词多、生僻词多的词形类上表现更佳,反映了这些类别的活跃程度。模型对非活跃类的新型形式处理较差,而对活跃类的新形式表现优异。然而,基于使用频率的生成模型中,频率是性能的主要预测因子,与活跃度指标相关性微弱或不存在。
原文摘要 · Abstract (English)
Descriptions of complex nominal or verbal systems make use of inflectional classes. Inflectional classes bring together nouns which have similar stem changes and use similar exponents in their paradigms. Although inflectional classes can be very useful for language teaching as well as for setting up finite state morphological systems, it is unclear whether inflectional classes are cognitively real, in the sense that native speakers would need to discover these classes in order to learn how to properly inflect the nouns of their language. This study investigates whether the Discriminative Lexicon Model (DLM) can understand and produce Finnish inflected nouns without setting up inflectional classes, using a dataset with 55,271 inflected nouns of 2000 high-frequency Finnish nouns from 49 inflectional classes. Several DLM comprehension and production models were set up. Some models were not informed about frequency of use, and provide insight into learnability with infinite exposure (endstate learning). Other models were set up from a usage based perspective, and were trained with token frequencies being taken into consideration (frequency-informed learning). On training data, models performed with very high accuracies. For held-out test data, accuracies decreased, as expected, but remained acceptable. Across most models, performance increased for inflectional classes with more types, more lower-frequency words, and more hapax legomena, mirroring the productivity of the inflectional classes. The model struggles more with novel forms of unproductive and less productive classes, and performs far better for unseen forms belonging to productive classes. However, for usage-based production models, frequency was the dominant predictor of model performance, and correlations with measures of productivity were tenuous or absent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。