arXiv:2412.07238cs.CLq-bio.NC2024-12被引 9

提出语言与说话人认知整合模型,解释声音如何影响理解。

Speaker effects in language comprehension: An integrative model of language and speaker processing

  • 用感知与预期双重机制解释说话人效应
  • 说话人先验影响语音、词汇、语义处理层级
  • 适用于语言发展评估与AI对话研究

说话人身份通过调节感知与预期影响语言理解。本文综述说话人效应,并提出一个整合语言与说话人处理的模型,融合自下而上(基于声学-情景记忆)与自上而下(基于说话人模型)两种机制。语言与说话人处理在多层级概率框架中功能整合:对说话人的先验信念在语音、词汇和语义层面调节语言处理;同时,实时语音与信息持续更新说话人模型,将宽泛的群体先验细化为个体化表征。该框架区分了基于熟悉度的个体差异效应与基于社会群体预期的类别效应。我们指出说话人效应可作为语言发展与社会认知的指标,并呼吁未来研究将这些发现拓展至人工智能(AI)说话人领域,因AI代理正成为新型社交对话者,重塑人际沟通方式。

原文摘要 · Abstract (English)

The identity of a speaker influences language comprehension through modulating perception and expectation. This review explores speaker effects and proposes an integrative model of language and speaker processing that integrates distinct mechanistic perspectives. We argue that speaker effects arise from the interplay between bottom-up perception-based processes, driven by acoustic-episodic memory, and top-down expectation-based processes, driven by a speaker model. We show that language and speaker processing are functionally integrated through multi-level probabilistic processing: prior beliefs about a speaker modulate language processing at the phonetic, lexical, and semantic levels, while the unfolding speech and message continuously update the speaker model, refining broad demographic priors into precise individualized representations. Within this framework, we distinguish between speaker-idiosyncrasy effects arising from familiarity with an individual and speaker-demographics effects arising from social group expectations. We discuss how speaker effects serve as indices for assessing language development and social cognition, and we encourage future research to extend these findings to the emerging domain of artificial intelligence (AI) speakers, as AI agents represent a new class of social interlocutors that are transforming the way we engage in communication.

语言理解认知模型说话人效应AI对话

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。