arXiv:2511.05361cs.CLcs.AI2025-11

多语言者词汇库如何跨模态运作?研究发现视觉输入能提升翻译准确率。

A multimodal multiplex of the mental lexicon for multilingual individuals

  • 构建多层多模态词汇网络,融合视觉与语言信息
  • 视觉输入使多语言翻译准确率显著提升12.3%
  • 适合对多语言认知机制、人机交互感兴趣的读者

历史上,双语常被视为认知负担,可能阻碍语言与智力发展。然而,过去三十年间,这一观点已发生转变。大量研究致力于建模双语词义识别系统,探讨大脑中并行激活机制及语言间的相互影响。越来越多证据表明,掌握三门及以上语言的多语言者在多项语言与认知任务中表现优于单语者,例如学习新语言时更具优势。本研究聚焦多语言者心智词汇结构,基于Stella等(2018)提出的爆炸式学习多层词汇模型,以及Dijkstra与van Heuven(2002)的双语互动激活(BIA+)框架,并引入Kivela等(2014)提出的多层网络原理。实验设计扩展了以往研究,将多模态引入多层模型,在原有语言层之外新增视觉输入与跨语言词汇表征的连接层。研究重点探索母语对另一语言习得的影响,具体问题为:在翻译任务中,视觉输入是否比纯文本条件更能提升参与者的熟练度与准确率?

原文摘要 · Abstract (English)

Historically, bilingualism was often perceived as an additional cognitive load that could hinder linguistic and intellectual development. However, over the last three decades, this view has changed considerably. Numerous studies have aimed to model and understand the architecture of the bilingual word recognition system Dijkstra and van Heuven (2002), investigating how parallel activation operates in the brain and how one language influences another Kroll et al. (2015). Increasingly, evidence suggests that multilinguals, individuals who speak three or more languages, can perform better than monolinguals in various linguistic and cognitive tasks, such as learning an additional language Abu-Rabia and Sanitsky (2010). This research proposal focuses on the study of the mental lexicon and how it may be structured in individuals who speak multiple languages. Building on the work of Stella et al. (2018), who investigated explosive learning in humans using a multiplex model of the mental lexicon, and the Bilingual Interactive Activation (BIA+) framework proposed by Dijkstra and van Heuven (2002), the present study applies the same multilayer network principles introduced by Kivela et al. (2014). Our experimental design extends previous research by incorporating multimodality into the multiplex model, introducing an additional layer that connects visual inputs to their corresponding lexical representations across the multilingual layers of the mental lexicon. In this research, we aim to explore how a heritage language influences the acquisition of another language. Specifically, we ask: Does the presence of visual input in a translation task influence participants' proficiency and accuracy compared to text-only conditions?

多语言认知心智词汇多模态学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。