对比大模型与儿童描述图片的语言,发现大模型文本更长但词汇更贫乏。
Can Large Language Models (LLMs) Describe Pictures Like Children? A Comparative Corpus Study
- 用图文提示让大模型模仿儿童描述图片
- 大模型文本更长但词汇多样性低、名词少、高频词多
- 即使使用少样本提示,仍难复制儿童语言特征,适合教育应用审慎评估
大型语言模型在教育中的作用日益重要,但其生成文本是否接近儿童语言尚缺乏研究。本研究通过比较德国儿童对图片故事的描述与大模型生成文本,评估了大模型模仿儿童语言的能力。使用相同图片故事和两种提示方式(零样本与少样本提示指定儿童年龄范围),生成两个大模型语料库。分析涵盖词频、词汇丰富度、句长、词性标签及词嵌入语义相似性等心理语言学特征。结果显示,大模型生成文本更长但词汇丰富度较低,依赖高频词,名词使用不足;语义向量空间分析显示两组语料在整体语义上相似度低。少样本提示虽略微提升与儿童文本的相似性,但仍无法复制词汇与语义模式。研究揭示了大模型通过图文提示模拟儿童语言的局限性,为心理语言学研究和教育应用提供了启示,也警示了其在面向儿童的教育工具中使用的适当性问题。
原文摘要 · Abstract (English)
The role of large language models (LLMs) in education is increasing, yet little attention has been paid to whether LLM-generated text resembles child language. This study evaluates how LLMs replicate child-like language by comparing LLM-generated texts to a collection of German children's descriptions of picture stories. We generated two LLM-based corpora using the same picture stories and two prompt types: zero-shot and few-shot prompts specifying a general age from the children corpus. We conducted a comparative analysis across psycholinguistic text properties, including word frequency, lexical richness, sentence and word length, part-of-speech tags, and semantic similarity with word embeddings. The results show that LLM-generated texts are longer but less lexically rich, rely more on high-frequency words, and under-represent nouns. Semantic vector space analysis revealed low similarity, highlighting differences between the two corpora on the level of corpus semantics. Few-shot prompt increased similarities between children and LLM text to a minor extent, but still failed to replicate lexical and semantic patterns. The findings contribute to our understanding of how LLMs approximate child language through multimodal prompting (text + image) and give insights into their use in psycholinguistic research and education while raising important questions about the appropriateness of LLM-generated language in child-directed educational tools.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。