arXiv:2508.19004cs.AI2025-08被引 1

大模型仅靠语言统计学习,就能超越人类预测日常社交规范。

AI Models Exceed Individual Human Accuracy in Predicting Everyday Social Norms

  • 用语言数据统计学习,让大模型掌握社会规范理解能力。
  • GPT-4.5在预测集体判断上超越所有人类(100分位),其他模型超96%以上。
  • 模型虽强但存在系统性错误,揭示了语言学习的边界与潜力。

认知科学的核心问题之一是社会规范如何习得与表征。尽管人类通常通过具身社会经验学习规范,我们考察了大型语言模型是否仅通过统计学习即可获得复杂的规范理解。在两项研究中,我们系统评估了多个AI系统对555个日常场景的社会恰当性判断的预测能力,比较其与每位人类参与者的预测一致性。研究1显示,GPT-4.5在连续尺度上预测集体判断的准确率超过所有人类参与者(100分位)。研究2重复该结果:Gemini 2.5 Pro超越98.7%的人类,GPT-5超越97.8%,Claude Sonnet 4超越96.0%。尽管具备强大预测力,所有模型均表现出系统性、相关性错误。研究结果表明,仅通过语言数据的统计学习即可生成复杂社会认知模型,挑战了强调具身经验对文化能力不可或缺性的理论。不同架构模型的系统性局限提示基于模式的社会理解存在边界,而其在预测任务中普遍超越个体人类的表现,则表明语言是文化知识传递的极丰富载体。

原文摘要 · Abstract (English)

A fundamental question in cognitive science concerns how social norms are acquired and represented. While humans typically learn norms through embodied social experience, we investigated whether large language models can achieve sophisticated norm understanding through statistical learning alone. Across two studies, we systematically evaluated multiple AI systems' ability to predict human social appropriateness judgments for 555 everyday scenarios by examining how closely they predicted the average judgment compared to each human participant. In Study 1, GPT-4.5's accuracy in predicting the collective judgment on a continuous scale exceeded that of every human participant (100th percentile). Study 2 replicated this, with Gemini 2.5 Pro outperforming 98.7% of humans, GPT-5 97.8%, and Claude Sonnet 4 96.0%. Despite this predictive power, all models showed systematic, correlated errors. These findings demonstrate that sophisticated models of social cognition can emerge from statistical learning over linguistic data alone, challenging strong versions of theories emphasizing the exclusive necessity of embodied experience for cultural competence. The systematic nature of AI limitations across different architectures indicates potential boundaries of pattern-based social understanding, while the models' ability to outperform nearly all individual humans in this predictive task suggests that language serves as a remarkably rich repository for cultural knowledge transmission.

社会认知大模型语言学习规范预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。