arXiv:2607.20441cs.CLcs.LG2026-07中稿 · UNLP 2026

用预测市场测大模型对地缘信息的偏见,发现英文新闻常误导判断。

Belief Propagation in LLM World Models: Measuring Strategic Information Bias with Prediction Markets

  • 用大模型提取文本隐含信念,预测市场价格作为真实参考校准偏差。
  • 英文新闻使领土预测错误率高达64%至72%,且与实际结果无关。
  • 偏见来自信息源而非模型,跨架构普遍存在,影响下游决策。

每个信息生态系统都会产生影响战略决策的信念。人类分析师和AI系统都继承了其信息来源的盲点。本文展示,结合大语言模型(LLM)与预测市场的机制可作为校准工具,衡量生态系统信念与外部参考之间的偏离程度:LLM从文本语料中提取隐含信念,而以实际结果锚定的预测市场价格轨迹提供校准基准。通过消融实验,在固定模型的情况下改变信息上下文,并使用知晓真实结果的污染模型作为对照,我们发现,在111个与乌克兰相关的预测市场(共约93,000条预测,覆盖四个模型)中,英文新闻语境系统性地导致领土预测偏差,使预测错误率达到64%至72%,当新闻倾向支持领土占领时尤为明显。已知真实结果的污染模型也表现出相同错误率,表明偏差主要源自文本本身。补充乌克兰军事分析类来源可降低所有纯净模型的偏差,但绝对误差改善有限且因模型而异。研究证明,这种扭曲主要源于信息源,而非模型处理过程。该现象在四种模型架构中均一致存在,将在任何处理此类信息的系统中持续传播,并影响后续决策。

原文摘要 · Abstract (English)

Every information ecosystem produces beliefs that shape strategic decisions. Both human analysts and AI systems inherit the blind spots of their information sources. We show that LLMs, combined with prediction markets, function as a calibrated instrument for measuring how far ecosystem-induced beliefs deviate from an external reference: LLMs extract the beliefs a text corpus implies, and prediction market price trajectories, anchored at resolution by realised outcomes, provide the calibration reference against which to quantify the deviation. We isolate the bias contribution of specific text through ablation: varying information context while holding the model fixed, with a contaminated model that knows actual outcomes as control. Applied to 111 Ukraine-related prediction markets, comprising approximately 93,000 predictions across four models, we find that English news context systematically biases territorial predictions, wrong 64 to 72 percent of the time when it pushes predictions toward territorial capture. A contaminated model that knows actual outcomes shows the same error rate, indicating that the bias originates primarily in the text. Supplementing with Ukrainian military-analytical sources reduces the bias for all clean models, while absolute-error gains are partial and model-dependent. We show that the distortion originates primarily in the sources, not the models. Consistent across four architectures, it will persist in any system that processes them and propagate into downstream decisions.

大模型信息偏见预测市场地缘分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。