arXiv:2412.06095cs.CLcs.FL2024-12被引 2

提出新指标衡量小语料库语法多样性,突破传统方法局限。

Measuring Grammatical Diversity from Small Corpora: Derivational Entropy Rates, Mean Length of Utterances, and Annotation Invariance

  • 用生成句长与推导熵率关联,建立语法复杂性新度量
  • 小语料库下仍可准确估算语法多样性,误差可控
  • 适合语言习得、神经语言学等研究者使用

在语言习得、语言神经心理学、老龄化研究和历史语言学等领域,常需通过语料库评估个体、群体或说话类型在特定时期产生的语法结构多样性。此时,树库被视为可能遇到的句法结构的代表性样本。从有限的小规模代表性子语料中推断潜在的句法多样性,需谨慎外推,其准确性受限于样本规模。本文从理论和实证两方面证明:语法的推导熵与生成句的平均长度(MLU)存在根本关联,由此提出新的度量——推导熵率。平均句长不再是简单代理变量,而是语法多样性的基础指标。结合推导熵率,可实现无需理论假设的语法复杂性评估。推导熵率还反映不同语法标注框架对树库复杂性的判定差异。本文引入平滑诱导树库熵(SITE)工具,可在极小树库上实现高精度估计。最后讨论了这些结果对自然语言处理与人类语言加工的重要启示。

原文摘要 · Abstract (English)

In many fields, such as language acquisition, neuropsychology of language, the study of aging, and historical linguistics, corpora are used for estimating the diversity of grammatical structures that are produced during a period by an individual, community, or type of speakers. In these cases, treebanks are taken as representative samples of the syntactic structures that might be encountered. Generalizing the potential syntactic diversity from the structures documented in a small corpus requires careful extrapolation whose accuracy is constrained by the limited size of representative sub-corpora. In this article, I demonstrate -- theoretically, and empirically -- that a grammar's derivational entropy and the mean length of the utterances (MLU) it generates are fundamentally linked, giving rise to a new measure, the derivational entropy rate. The mean length of utterances becomes the most practical index of syntactic complexity; I demonstrate that MLU is not a mere proxy, but a fundamental measure of syntactic diversity. In combination with the new derivational entropy rate measure, it provides a theory-free assessment of grammatical complexity. The derivational entropy rate indexes the rate at which different grammatical annotation frameworks determine the grammatical complexity of treebanks. I introduce the Smoothed Induced Treebank Entropy (SITE) as a tool for estimating these measures accurately, even from very small treebanks. I conclude by discussing important implications of these results for both NLP and human language processing.

语法多样性小语料库推导熵率句长分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。