arXiv:2510.14665cs.AIcs.HC2025-10被引 3

提出认知框架,破解人机推理中误判的根源。

Beyond "Hallucinations": A Framework for Stable Human-AI Reasoning

  • 构建三重认知陷阱框架,识别人机协作中的思维盲区。
  • 实证显示语言模型会放大人类直觉偏差,导致错误累积。
  • 强调通过反思提示等交互设计提升人类监督能力。

随着大语言模型(LLMs)融入日常与高风险决策场景,它们继承了人类语言的模糊性与偏见。尽管输出流畅连贯,但其依赖统计模式预测而非基于现实的推理,易产生看似合理实则错误的结果。本文认为此类失败不仅是技术问题,更是认知层面的。LLMs复现了类似人类直觉的联想模式,在与人类用户结合时会放大系统性误读。为此,我们提出Rose-Frame认知-认识论框架,用于诊断人机交互中的失效。该框架识别出三个常见陷阱:(i) 图像与领土之分,区分表征与现实;(ii) 直觉与理性之别,分离快速联想判断与反思性推理;(iii) 冲突与确认之辨,考察观点是否被批判检验或相互强化。这些机制在人机推理互动中可叠加为认知漂移。我们展示了这些失败在实践中的表现,并提出人类侧干预措施,包括解释性提示、反思性提问和结构化分歧机制,以稳定推理过程。框架不聚焦于模型修改,而在于规范交互方式。核心主张是:流畅性可能制造理解假象。因此,实现AI对齐不仅需技术改进,更需建立支持反思与可证伪的人类监督机制。

原文摘要 · Abstract (English)

As large language models (LLMs) become integrated into everyday and high-stakes decision-making, they inherit the ambiguity and biases of human language. While they produce fluent and coherent outputs, they rely on statistical pattern prediction rather than grounded reasoning, creating a risk of outputs that are plausible but incorrect. This paper argues that these failures are not only technical but cognitive. LLMs reproduce associative patterns similar to intuitive human reasoning, amplifying systematic misinterpretations when combined with human users. To analyse this, we introduce the Rose-Frame, a cognitive-epistemological framework for diagnosing breakdowns in human-AI interaction. The framework identifies three recurrent traps: (i) map vs territory, distinguishing representations from reality; (ii) intuition vs reason, separating fast associative judgments from reflective reasoning; and (iii) conflict vs confirmation, examining whether ideas are critically tested or mutually reinforced. These mechanisms can compound into epistemic drift when human and model reasoning interact. We show how these failures emerge in practice and propose human-side interventions, including interpretive cues, reflective prompts, and structured disagreement, to stabilise reasoning. Rather than modifying models, the framework focuses on governing interaction. The central claim is that fluency can create an illusion of understanding. Aligning AI therefore requires not only technical improvements but structures that enable reflective and falsifiable human oversight.

人机交互认知框架推理安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。