arXiv:2602.04674cs.SIcs.AI2026-02AAAI被引 2

LLM模拟谣言易感性时夸大态度影响,忽略社交网络作用。

Overstating Attitudes, Ignoring Networks: LLM Biases in Simulating Misinformation Susceptibility

  • 用真实调查数据构建人物画像,让LLM模拟回答
  • LLM结果与人类数据相关性中等,但高估信念与传播关联
  • 模型偏爱态度特征,忽视社交网络,适合检测偏差而非替代人类

大型语言模型(LLMs)在计算社会科学中被越来越多地用作人类判断的代理,但其再现谣言易感性模式的能力尚不明确。我们测试了基于社会调查数据中网络、人口统计、态度和行为特征构建的人物画像,通过提示让LLM生成模拟受访者回答,能否复现人类在谣言信念和传播上的真实模式。以三项线上调查为基线,评估LLM输出是否匹配实际响应分布,并恢复原始数据中的特征-结果关联。结果显示,LLM生成的回答捕捉到大致的分布趋势,与人类响应存在中等程度相关性,但持续夸大信念与传播之间的关联。拟合于模拟数据的线性模型解释方差显著更高,过度强调态度与行为特征,而几乎忽略个人网络特征,相较于拟合人类数据的模型表现明显不同。对模型推理过程及训练数据的分析表明,这些偏差源于谣言相关概念在训练数据中的系统性表征问题。研究提示,基于LLM的调查模拟更适用于诊断与人类判断的系统性差异,而非直接替代人类判断。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly used as proxies for human judgment in computational social science, yet their ability to reproduce patterns of susceptibility to misinformation remains unclear. We test whether LLM-simulated survey respondents, prompted with participant profiles drawn from social survey data measuring network, demographic, attitudinal and behavioral features, can reproduce human patterns of misinformation belief and sharing. Using three online surveys as baselines, we evaluate whether LLM outputs match observed response distributions and recover feature-outcome associations present in the original survey data. LLM-generated responses capture broad distributional tendencies and show modest correlation with human responses, but consistently overstate the association between belief and sharing. Linear models fit to simulated responses exhibit substantially higher explained variance and place disproportionate weight on attitudinal and behavioral features, while largely ignoring personal network characteristics, relative to models fit to human responses. Analyses of model-generated reasoning and LLM training data suggest that these distortions reflect systematic biases in how misinformation-related concepts are represented. Our findings suggest that LLM-based survey simulations are better suited for diagnosing systematic divergences from human judgment than for substituting it.

LLM偏差谣言传播社会模拟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。