arXiv:2506.13990cs.AI2025-06被引 1

揭示智能系统认知异常现象,推动其系统化定义与评估。

Machine Mirages: Defining the Undefined

  • 提出'机器幻象'概念,归纳多种智能系统认知错误
  • 指出这些错误虽似人类失误但本质不同且危害深远
  • 强调需建立评估体系以保障智能系统的可靠性与伦理安全

随着多模态机器智能系统在图像、语言和声音处理任务中达到平均动物级和人类级表现,它们开始表现出一类新型认知异常:机器幻象。这些包括错觉、幻想、编造、幻觉、误归因错误、语义漂移、语义压缩、夸大、因果推理失败、感知诡异谷效应、伪装性胡说、认知刻板化、语用误解、过度象征化、语义重热、模拟权威效应、错误归纳跳跃、上下文漂移、指代幻觉、符号弗兰肯斯坦效应、校准失败、虚假相关、偏见放大、概念漂移敏感性、不确定性下的误分类、对抗脆弱性、过拟合、语调误判、口音偏见、话语边界失败、语义边界混淆、噪声过拟合、延迟导致的决策漂移、模糊性坍塌等,这些错误模仿但不复制人类或动物的认知缺陷。本文呈现部分错误并主张必须明确定义与系统评估。理解机器幻象不仅对提升机器智能可靠性至关重要,也关乎构建一个尊重多样生命、认知与表达形式的多尺度伦理共进化智能生态。

原文摘要 · Abstract (English)

As multimodal machine intelligence systems started achieving average animal-level and average human-level fluency in many measurable tasks in processing images, language, and sound, they began to exhibit a new class of cognitive aberrations: machine mirages. These include delusion, illusion, confabulation, hallucination, misattribution error, semantic drift, semantic compression, exaggeration, causal inference failure, uncanny valley of perception, bluffing-patter-bullshitting, cognitive stereotypy, pragmatic misunderstanding, hypersignification, semantic reheating-warming, simulated authority effect, fallacious abductive leap, contextual drift, referential hallucination, semiotic Frankenstein effect, calibration failure, spurious correlation, bias amplification, concept drift sensitivity, misclassification under uncertainty, adversarial vulnerability, overfitting, prosodic misclassification, accent bias, turn boundary failure, semantic boundary confusion, noise overfitting, latency-induced decision drift, ambiguity collapse and other forms of error that mimic but do not replicate human or animal fallibility. This article presents some of the errors and argues that these failures must be explicitly defined and systematically assessed. Understanding machine mirages is essential not only for improving machine intelligence reliability but also for constructing a multiscale ethical, co-evolving intelligence ecosystem that respects the diverse forms of life, cognition, and expression it will inevitably touch.

认知异常机器幻象多模态智能伦理评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。