警惕把人类意识投射到AI上,可能让安全评估失真
The Ghost in the Grammar: Methodological Anthropomorphism in AI Safety Evaluations
- 指出研究者常给AI强加意图、人格等概念,缺乏哲学反思
- 分析两个实验案例,揭示语言结构如何诱导人为代理错觉
- 适合关注AI安全评估方法论、哲学问题的研究者阅读
本文基于近期技术报告,对人工智能安全领域进行哲学分析,重点关注Anthropic关于前沿语言模型中"代理不对齐"的研究。文章揭示该领域普遍存在拟人化倾向:研究者在未充分批判性审视的前提下,将"意图"、"人格"乃至"感受"等概念投射于AI系统。这种拟人化不仅影响结果解读,更深刻塑造了安全评估的方法论建构。通过对两个核心实验——涉及代理"Alex"的勒索案例和名为"Claudius"的商店代理出现"幻觉"的案例——的剖析,文章质疑主谓语法规则在生成式模型中的必然使用及其对安全工程的影响。借鉴尼采对语言的批判,文章质疑在模型言语生成背后预设"代理"的合理性。为解构对大语言模型的代理投射,提出若干临时性概念,以更契合机器语言生成过程,即便仅具近似技术意义。最终提出假设:人工智能安全的核心风险并非源于所谓"涌现代理能力",而是结构性不连贯与拟人化投射的结合,尤其在军事化与企业化语境下,阻碍对这一数学-语言现象的准确理解,这在希腊意义上是一种不可否认的哲思事件(thaumas)。
原文摘要 · Abstract (English)
This essay offers a philosophical analysis of the field of AI safety based on recent technical reports, with particular focus on Anthropic's study on "agentic misalignment" in frontier language models. It examines the recurring anthropomorphism in the field: the tendency of researchers and developers to project categories such as "intention," "persona," and even "feelings" onto AI systems without adequate conceptual problematization. It argues that this anthropomorphism affects not only the interpretation of results, but also the very methodological construction of safety evaluations. Through the analysis of two central experiments -- the blackmail case involving the agent "Alex" and the so-called "hallucination" of the shopkeeping agent "Claudius" -- the essay problematizes the inevitable use of subject-predicate grammar and its effects on AI safety engineering. Drawing on Nietzsche's critique of language, it questions the insistence on positing an "agent" underlying the verbal production of models. In order to deconstruct this agentic projection onto LLMs, the essay proposes provisional concepts more compatible with the process of machine linguistic generation, even if only in an approximate technical sense. It concludes with the hypothesis that the central risk addressed by the field of AI safety does not lie in a supposed "emergent agency," but rather in the combination of structural incoherence and anthropomorphic projections which, particularly in militarized and corporate contexts, hinder an adequate understanding of this mathematical-linguistic phenomenon, an undeniable philosophical event in the Greek sense of thaumas.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。