对比大模型与人类在社会互动中的信念演化,发现高阶模型更趋近人性宽容。
Are LLMs Socially Adaptive? Contrasting Belief Evolution in Large Language Models and Humans
- 设计动态经济博弈模拟,用信念-奖励权衡模型分析决策过程
- 中等能力模型过度惩罚,前沿模型随推理提升趋向人类式克制
- 提出可解释框架,适合研究AI伦理演化与心理机制的学者
随着大语言模型(LLMs)越来越多参与复杂社会互动,确保其行为与人类伦理原则和意图一致(即价值对齐)已成为关键科学挑战。现有基准多依赖静态评估,难以捕捉决策的长期动态或驱动行为的潜在认知过程。本文提出FairMindSim,一个基于社会心理学的真实模拟基准,通过连续经济游戏评估对齐程度。为突破黑箱观察,引入信念-奖励对齐行为演化模型(BREM),将决策形式化为外在奖励与内在信念之间的动态权衡。我们开展了大规模对比研究,涵盖1,017名人类参与者和十种LLM(包括GPT-5和Gemini-3-Pro)。实验结果揭示第三方惩罚(TPP)游戏中存在非线性能力趋势:中等能力模型表现出僵化且算法化的攻击性,表现为过度惩罚;而前沿模型则呈现克制收敛,逐渐向人类式宽恕转变。借助BREM,我们分解了代理的长期决策动态,发现更先进的模型通过降低信念与行动不一致性,更好地平衡了冲突目标。本研究提供了标准化的心理压力测试协议,并为可控社会困境中AI对齐的纵向演化提供了可解释机制。
原文摘要 · Abstract (English)
As large language models (LLMs) increasingly engage in complex social interactions, ensuring that their behaviors align with human ethical principles and intentions, known as value alignment, has become a critical scientific challenge. Existing benchmarks often rely on static assessments and fail to capture the longitudinal dynamics of decision-making or the latent cognitive processes driving agent behavior. In this work, we propose FairMindSim, a realistic simulation benchmark rooted in social psychology that evaluates alignment through continuous economic games. To move beyond black-box observations, we introduce the Belief-Reward Alignment Behavior Evolution Model (BREM), a probabilistic framework that formalizes decision-making as a dynamic trade-off between maximizing extrinsic rewards and upholding intrinsic beliefs. We conducted a large-scale comparative study involving 1,017 human participants and ten LLMs, including GPT-5 and Gemini-3-Pro. Our experimental results reveal a capability linked non linear empirical trend in the Third Party Punishment (TPP) game. Mid capability models exhibit rigid and algorithmic aggression that is characterized by over punishment, while frontier models show a convergence of restraint and a shift toward human like leniency as reasoning capabilities scale. Furthermore, using BREM, we decompose agents longitudinal decision dynamics and find that more advanced models better balance conflicting objectives by reducing belief action inconsistency. Our contributions provide a standardized protocol for psychological stress testing and an interpretable mechanism for analyzing the longitudinal evolution of AI alignment in controlled social dilemma settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。