用信息论量化语音与语法的关联，发现语音能减少10.2%的语法不确定性。
Using Prosody to Predict Syntactic Structure
- 通过互信息衡量语音特征与句法结构的关联强度。
- 在自然对话中，语音特征使句法不确定性降低最多10.2%。
- 框架通用可扩展，适合研究各类语音或句法成分的影响。
尽管语音携带句法结构的关键线索已广为认可，但两者之间的对应程度和性质仍存争议。本文从信息论角度研究句法-语音界面，将语音特征与句法表示间的相互信息作为量化指标。提出一种通用框架，利用多模态语言模型在大规模语音-文本语料上估计该量。该框架不依赖特定结构且模块化，可分别评估单一语音特征或结构成分的贡献。我们在英语读物和自然对话两个领域，对词持续时间与词间停顿两项特征进行了评估。结果表明，语音确实包含可测量的句法信息，在自然对话中，语音特征使句法不确定性最高降低10.2%。研究为多个句法-语音接口的理论提供了新的实证支持。
原文摘要 · Abstract (English)
While it is well-established that prosody carries crucial cues for syntactic structure, the degree and nature of correspondence between these two domains remains contested. We investigate the syntax-prosody interface through an information-theoretic lens, quantifying the interaction between prosodic features and syntactic representations as their mutual information. We provide a general-purpose framework for estimating this quantity over large speech-text corpora using multimodal language models. Our framework is structure-agnostic and modular, insofar as it can be used to measure the contributions of individual prosodic features or components of structure. We evaluate the syntax-prosody relationship for two features (word duration and inter-word pauses) across two domains--read audiobooks and spontaneous conversations--both in English. Our results demonstrate that prosody contains measurable syntactic information, with prosodic features reducing syntactic uncertainty in spontaneous conversations by up to 10.2%. Our findings offer new empirical support for several theoretical accounts of the syntax-prosody interface.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。