arXiv:2503.18702cs.CLcs.AI2025-03被引 1

无监督学习下,模型通过分析母语样本自动发现语法类别。

Unsupervised Acquisition of Discrete Grammatical Categories

  • 用双代理系统模拟语言习得,女儿模型仅靠母体输出样本学习。
  • 聚类分析从母体生成语料中提取出离散的语法规则。
  • 结果可复现,适合对语言结构自动发现感兴趣的学者。

本文在计算实验室环境中开展语言习得实验,构建包含一个成年语言模型与一个试图学习母语的女儿语言模型的多智能体系统。关键在于,女儿模型无法访问母模型的内部知识,仅能获取母模型生成的语言实例。实验表明,通过统计分析输入数据中对应于语法类别的模式,可推导出离散的语法规则,并将其加入女儿模型的语法知识库中。为此,采用层次聚合聚类分析方法处理母模型连续生成的语句。研究认为该流程可用于获取类似于自然语言学家提出的语法类别结构,证明了非平凡语法知识的成功获取。此外,基于母模型生成训练数据配置的参数,在第二组测试集上验证有效,同样实现了非平凡类别的习得。

原文摘要 · Abstract (English)

This article presents experiments performed using a computational laboratory environment for language acquisition experiments. It implements a multi-agent system consisting of two agents: an adult language model and a daughter language model that aims to learn the mother language. Crucially, the daughter agent does not have access to the internal knowledge of the mother language model but only to the language exemplars the mother agent generates. These experiments illustrate how this system can be used to acquire abstract grammatical knowledge. We demonstrate how statistical analyses of patterns in the input data corresponding to grammatical categories yield discrete grammatical rules. These rules are subsequently added to the grammatical knowledge of the daughter language model. To this end, hierarchical agglomerative cluster analysis was applied to the utterances consecutively generated by the mother language model. It is argued that this procedure can be used to acquire structures resembling grammatical categories proposed by linguists for natural languages. Thus, it is established that non-trivial grammatical knowledge has been acquired. Moreover, the parameter configuration of this computational laboratory environment determined using training data generated by the mother language model is validated in a second experiment with a test set similarly resulting in the acquisition of non-trivial categories.

语言模型无监督学习语法分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。