发现大模型在风险决策中会像人类一样受前景理论影响。
An analysis of AI Decision under Risk: Prospect theory emerges in Large Language Models
- 用前景理论测试大模型的决策行为,发现其与人类相似。
- 军事场景下模型的风险偏好受框架影响更大,比民用场景显著更强。
- 研究揭示语言模型内嵌人类认知偏差,且偏差具情境依赖性。
风险判断是不确定环境下决策的核心。丹尼尔·卡尼曼和阿莫斯·特沃斯基曾通过实验发现,人类在面临损失时更愿承担风险,而非追求收益,这一现象违背数学理性。本文首次将这一开创性理论应用于大型语言模型,包括当前最先进的链式思维推理模型。结果显示,在多种情景下,模型的风险决策行为与前景理论预测高度一致。此外,我证明情境对风险偏好有关键影响:相较于民用场景,军事场景引发更显著的‘框架效应’。这表明语言模型并非机械计算,而是通过语言语境捕捉人类启发式与偏见。‘框架’概念远超简单的得失对立,其复杂性可由维特根斯坦的‘语言游戏’理论解释。最后,本研究为大模型中推理与记忆的争议提供了新视角。
原文摘要 · Abstract (English)
Judgment of risk is key to decision-making under uncertainty. As Daniel Kahneman and Amos Tversky famously discovered, humans do so in a distinctive way that departs from mathematical rationalism. Specifically, they demonstrated experimentally that humans accept more risk when they feel themselves at risk of losing something than when they might gain. I report the first tests of Kahneman and Tversky's landmark 'prospect theory' with Large Language Models, including today's state of the art chain-of-thought 'reasoners'. In common with humans, I find that prospect theory often anticipates how these models approach risky decisions across a range of scenarios. I also demonstrate that context is key to explaining much of the variance in risk appetite. The 'frame' through which risk is apprehended appears to be embedded within the language of the scenarios tackled by the models. Specifically, I find that military scenarios generate far larger 'framing effects' than do civilian settings, ceteris paribus. My research suggests, therefore, that language models the world, capturing our human heuristics and biases. But also that these biases are uneven - the idea of a 'frame' is richer than simple gains and losses. Wittgenstein's notion of 'language games' explains the contingent, localised biases activated by these scenarios. Finally, I use my findings to reframe the ongoing debate about reasoning and memorisation in LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。