用推理主义框架解读大模型如何无外部表征生成语言意义
Do Large Language Models Advocate for Inferentialism?
- 以推理主义视角分析大模型的语言处理机制
- 发现大模型具备反表征性特征,不依赖外部世界对应
- 适合哲学与AI交叉研究者阅读
大语言模型(如ChatGPT、Claude)的兴起对语言哲学提出了新挑战,尤其涉及语言意义与表征的本质。本文探索罗伯特·布兰登的推理语义学作为理解此类系统的新基础框架。通过分析Transformer架构下的推理、替换、回指(ISA)机制,表明大模型在语言处理中表现出根本性的反表征性。我们进一步提出一种基于交互与规范性的共识真理论,其根基在于强化学习人类反馈(RLHF)等机制。尽管推理主义的哲学主张与大模型的子符号式处理存在张力,本文认为推理语义学为理解大模型如何在无外部表征的情况下生成意义提供了重要洞见。分析暗示大模型可能挑战传统语言哲学中的严格组合性与语义外在论,但需更多实证研究支持。
原文摘要 · Abstract (English)
The emergence of large language models (LLMs) such as ChatGPT and Claude presents new challenges for philosophy of language, particularly regarding the nature of linguistic meaning and representation. While LLMs have traditionally been understood through distributional semantics, this paper explores Robert Brandom's inferential semantics as an alternative foundational framework for understanding these systems. We examine how key features of inferential semantics -- including its anti-representationalist stance, logical expressivism, and quasi-compositional approach -- align with the architectural and functional characteristics of Transformer-based LLMs. Through analysis of the ISA (Inference, Substitution, Anaphora) approach, we demonstrate that LLMs exhibit fundamentally anti-representationalist properties in their processing of language. We further develop a consensus theory of truth appropriate for LLMs, grounded in their interactive and normative dimensions through mechanisms like RLHF. While acknowledging significant tensions between inferentialism's philosophical commitments and LLMs' sub-symbolic processing, this paper argues that inferential semantics provides valuable insights into how LLMs generate meaning without reference to external world representations. Our analysis suggests that LLMs may challenge traditional assumptions in philosophy of language, including strict compositionality and semantic externalism, though further empirical investigation is needed to fully substantiate these theoretical claims.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。