arXiv:2503.00330cs.CL2025-03被引 2

探究大模型如何理解抽象与具体概念的大小感知,揭示其类人认知机制。

How Deep is Love in LLMs' Hearts? Exploring Semantic Size in Human-like Cognition

  • 通过比喻推理对比人类与大模型对抽象词与具体物体大小的关联。
  • 多模态训练使大模型更接近人类对语义大小的理解,尤其在真实购物场景中。
  • 发现大模型易受标题大小影响,可能被误导,适合关注认知偏见的研究者参考。

人类认知能力的形成机制长期吸引研究者关注,但测量这些复杂过程仍具挑战。随着大型语言模型(LLMs)在多个领域达到甚至超越人类水平,它们成为研究人类认知的新视角。本文聚焦语义大小——即抽象与具体词汇或概念的感知规模——探讨大模型是否具备类似人类的理解倾向。研究首先分析大模型与人类在比喻推理中对抽象词与不同尺寸具体物体的关联;接着考察大模型内部表征与人类认知过程的一致性。结果表明,多模态训练对实现类人语义理解至关重要,暗示现实世界的多模态经验对人类认知发展同样关键。最后,在真实网络购物场景中,研究发现多模态大模型在决策中更具情感投入,但也更易受标题大小影响,存在被点击诱饵操纵的风险。该研究为理解大模型如何从最小具体物到最深层抽象概念(如爱)内化语言提供了新视角,既深化了对大模型的认知理解,也为探索人类智能的核心能力开辟了新路径。

原文摘要 · Abstract (English)

How human cognitive abilities are formed has long captivated researchers. However, a significant challenge lies in developing meaningful methods to measure these complex processes. With the advent of large language models (LLMs), which now rival human capabilities in various domains, we are presented with a unique testbed to investigate human cognition through a new lens. Among the many facets of cognition, one particularly crucial aspect is the concept of semantic size, the perceived magnitude of both abstract and concrete words or concepts. This study seeks to investigate whether LLMs exhibit similar tendencies in understanding semantic size, thereby providing insights into the underlying mechanisms of human cognition. We begin by exploring metaphorical reasoning, comparing how LLMs and humans associate abstract words with concrete objects of varying sizes. Next, we examine LLMs' internal representations to evaluate their alignment with human cognitive processes. Our findings reveal that multi-modal training is crucial for LLMs to achieve more human-like understanding, suggesting that real-world, multi-modal experiences are similarly vital for human cognitive development. Lastly, we examine whether LLMs are influenced by attention-grabbing headlines with larger semantic sizes in a real-world web shopping scenario. The results show that multi-modal LLMs are more emotionally engaged in decision-making, but this also introduces potential biases, such as the risk of manipulation through clickbait headlines. Ultimately, this study offers a novel perspective on how LLMs interpret and internalize language, from the smallest concrete objects to the most profound abstract concepts like love. The insights gained not only improve our understanding of LLMs but also provide new avenues for exploring the cognitive abilities that define human intelligence.

语义理解大模型认知多模态学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。