arXiv:2502.04426cs.CLcs.AI2025-02被引 66

LLM评估判断依赖表面线索,易误把语言形式当可信度。

The simulation of judgment in LLMs

  • 用统一框架让模型和人类按相同步骤评新闻
  • 模型常选错误标准,政治偏见与语言表象影响判断
  • 适合关注AI评估缺陷的从业者和研究者

大型语言模型(LLMs)越来越多地参与评价过程,如信息过滤、解释与可信度判断。我们以新闻领域为基准,对比六种LLMs与专家评分(NewsGuard和Media Bias/Fact Check)及受控实验中的人类判断。通过结构化代理框架,确保模型与非专业人士遵循相同的评估流程:选择标准、检索内容、生成理由。尽管输出一致,模型在可观察到的评判标准上存在系统性差异,表明词汇关联与统计先验可能影响判断,其方式不同于情境推理。这种依赖导致政治不对称性和将语言形式误认为知识可靠性——我们称之为“认知幻觉”(epistemia),即表面合理性替代实际验证。将判断权交给此类系统,可能导致评价机制从规范性推理转向基于模式的近似,引发关于LLMs在评估中角色的深层问题。

原文摘要 · Abstract (English)

Large Language Models (LLMs) are increasingly embedded in evaluative processes, from information filtering to assessing and addressing knowledge gaps through explanation and credibility judgments. This raises the need to examine how such evaluations are built, what assumptions they rely on, and how their strategies diverge from those of humans. We benchmark six LLMs against expert ratings--NewsGuard and Media Bias/Fact Check--and against human judgments collected through a controlled experiment. We use news domains purely as a controlled benchmark for evaluative tasks, focusing on the underlying mechanisms rather than on news classification per se. To enable direct comparison, we implement a structured agentic framework in which both models and nonexpert participants follow the same evaluation procedure: selecting criteria, retrieving content, and producing justifications. Despite output alignment, our findings show consistent differences in the observable criteria guiding model evaluations, suggesting that lexical associations and statistical priors could influence evaluations in ways that differ from contextual reasoning. This reliance is associated with systematic effects: political asymmetries and a tendency to confuse linguistic form with epistemic reliability--a dynamic we term epistemia, the illusion of knowledge that emerges when surface plausibility replaces verification. Indeed, delegating judgment to such systems may affect the heuristics underlying evaluative processes, suggesting a shift from normative reasoning toward pattern-based approximation and raising open questions about the role of LLMs in evaluative processes.

大模型评估认知幻觉可信度判断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。