模型能学会西语不规则形态,但学得和人不一样。
Transformers over-extend what humans underlearn: the case of Spanish L-shaped morphome
- 用神经网络测试西语不规则形态是否可从统计中习得
- 模型正确生成词干比例43%-49%,高于人类的33%
- 模型更倾向不规则形式,且受发音相似性影响
不规则形态的认知本质争论多年:说话者是否会将其扩展到新形式,还是仅为词汇残留?通过在分布输入上训练的神经网络进行可学习性检验:若模型能复现模式,则说明仅凭输入统计即可习得。我们以西班牙语的L形形态组为例,其第一人称单数现在时词干出现在所有现在虚拟式格中,缺乏明显的语音或语义动机。我们进一步考察输入中不规则动词频率对泛化的影响,评估了三种频率条件(10%、50%、90%不规则)下的变压器模型,并与人类行为数据对比。在伪词输入的全形生成任务中,所有模型表现不佳,但在正确生成词干方面均优于人类(43%–49%比33%)。响应偏好显示明显分歧:人类始终偏好规则变形,而模型随训练中不规则形式占比增加,更倾向于不规则形式。在自然与平衡条件下,模型对伪词与真实不规则动词的发音相似性敏感,而人类无此效应。因此,该形态组可仅从分布输入中习得,但模型的泛化方式与人类有本质差异。
原文摘要 · Abstract (English)
The cognitive reality of irregular morphological patterns has been debated for decades: do speakers extend them to novel forms, or are they lexical artifacts? A neural network trained on distributional input offers a learnability test: if it recovers the pattern, the pattern is learnable from input statistics alone. We apply this test to the Spanish L-shaped morphome, where the first-person singular indicative stem appears in every present subjunctive cell despite lacking apparent phonological or semantic motivation. We further ask whether the frequency of irregular verbs in the input modulates generalization, evaluating transformers under three frequency conditions (10%, 50%, 90% irregular) and comparing them to human behavioral data. On full-form production from pseudoword inputs all models performed poorly, but all three conditions produced the correct stem more often than humans (43--49% vs. 33%). Response preferences revealed a clear divergence: humans consistently favored regular inflections, whereas models preferred irregular forms more as their proportion in training grew. Models in the naturalistic and balanced conditions were also sensitive to phonological similarity between pseudowords and real Spanish irregular verbs, an effect absent in humans. The L-shaped morphome is thus learnable from distributional input alone, but models generalize it qualitatively differently from humans.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。