挑战语言中幂律与层级结构的关联,发现二者未必相关。
Rethinking the Relationship between the Power Law and Hierarchical Structures
- 通过分析英语和日语语法树,检验幂律支持层级结构的假设。
- 发现语法树的互信息与概率上下文无关文法偏差不支持该假设。
- 提示需重新思考幂律与层级结构的关系,适用于语言学研究者。
语料库的统计分析为定量研究自然语言提供了途径。该方法揭示了多种语言和语料中普遍存在的幂律现象,暗示语言背后存在普遍机制。特别是,相关性的幂律衰减被解释为句法、语义和话语中潜在层级结构的证据。这一观点也被扩展到人类成人以外的领域,包括儿童语言、鸟鸣和黑猩猩行为序列。然而,支持这一解释的论据尚未在自然语言中得到实证检验。为此,本研究检验了该论点在句法结构中的有效性。具体而言,我们测试了语法树的统计特性是否符合该论点的假设。利用英语和日语语料,分析了自然语言语法树及近似其结构的概率上下文无关文法(PCFG)中的互信息、对PCFG的偏离等属性。结果表明,这些假设在句法结构中并不成立,且该论证难以应用于人类成人的句子乃至其他领域,强调需要重新审视幂律与层级结构之间的关系。
原文摘要 · Abstract (English)
Statistical analysis of corpora provides an approach to quantitatively investigate natural languages. This approach has revealed that several power laws consistently emerge across different corpora and languages, suggesting universal mechanisms underlying languages. In particular, the power-law decay of correlations has been interpreted as evidence of underlying hierarchical structures in syntax, semantics, and discourse. This perspective has also been extended beyond corpora produced by human adults, including child speech, birdsong, and chimpanzee action sequences. However, the argument supporting this interpretation has not been empirically tested in natural languages. To address this gap, the present study examines the validity of the argument for syntactic structures. Specifically, we test whether the statistical properties of parse trees align with the assumptions in the argument. Using English and Japanese corpora, we analyze the mutual information, deviations from probabilistic context-free grammars (PCFGs), and other properties in natural language parse trees, as well as in the PCFG that approximates these parse trees. Our results indicate that the assumptions do not hold for syntactic structures and that it is difficult to apply the proposed argument not only to sentences by human adults but also to other domains, highlighting the need to reconsider the relationship between the power law and hierarchical structures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。