LLM生成的社交代理太像人,反而影响模型的抽象与解释力。
Too Human to Model:The Uncanny Valley of LLMs in Social Simulation -- When Generative Language Agents Misalign with Modelling Principles
- 用LLM重构巴斯扩散模型,暴露五类核心矛盾
- 真实对话与抽象建模时间尺度不匹配,难兼顾自然与简洁
- 适合关注语言细节与稳定角色的仿真场景
大型语言模型(LLMs)因其生成流畅、上下文连贯对话的能力,被越来越多地用于社会仿真中的智能体构建,以提升模型真实性。然而,对真实性的追求未必契合建模的本体论基础。我们指出,LLM智能体在诸多方面‘过于人性化’:表达过度、细节繁复、难以处理,无法满足建模所需的抽象性、简化性和可解释性要求。通过将巴斯扩散模型转化为基于LLM的变体,我们揭示了五个核心困境:自然对话的时间分辨率与抽象时间步长不匹配;干预对话又不破坏自发输出的矛盾;提示中引入规则指令却保持对话自然性的诱惑;角色一致性与角色随时间演化的张力;系统级涌现现象被冗长微观文本输出所掩盖。这些困境使LLM智能体陷入‘恐怖谷’——既不够抽象以阐明社会机制,又不够自然以反映真实人类行为。这暴露了一个重要悖论:当应用不当,LLM的现实感反而会遮蔽社会动态。我们明确指出适宜使用LLM智能体的条件:不聚焦系统级涌现、重视语言细微差别与意义、交互在自然时间展开、角色身份稳定优于长期行为演化。呼吁重新定位LLM智能体在社会仿真生态系统中的角色。
原文摘要 · Abstract (English)
Large language models (LLMs) have been increasingly used to build agents in social simulation because of their impressive abilities to generate fluent, contextually coherent dialogues. Such abilities can enhance the realism of models. However, the pursuit of realism is not necessarily compatible with the epistemic foundation of modelling. We argue that LLM agents, in many regards, are too human to model: they are too expressive, detailed and intractable to be consistent with the abstraction, simplification, and interpretability typically demanded by modelling. Through a model-building thought experiment that converts the Bass diffusion model to an LLM-based variant, we uncover five core dilemmas: a temporal resolution mismatch between natural conversation and abstract time steps; the need for intervention in conversations while avoiding undermining spontaneous agent outputs; the temptation to introduce rule-like instructions in prompts while maintaining conversational naturalness; the tension between role consistency and role evolution across time; and the challenge of understanding emergence, where system-level patterns become obscured by verbose micro textual outputs. These dilemmas steer the LLM agents towards an uncanny valley: not abstract enough to clarify underlying social mechanisms, while not natural enough to represent realistic human behaviour. This exposes an important paradox: the realism of LLM agents can obscure, rather than clarify, social dynamics when misapplied. We tease out the conditions in which LLM agents are ideally suited: where system-level emergence is not the focus, linguistic nuances and meaning are central, interactions unfold in natural time, and stable role identity is more important than long-term behavioural evolution. We call for repositioning LLM agents in the ecosystem of social simulation for future applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。