大模型靠上下文引导从训练数据中推断,非随机鹦鹉也非具备人类级推理。
Neither Stochastic Parroting nor AGI: LLMs Solve Tasks through Context-Directed Extrapolation from Training Data Priors
- 通过上下文引导,模型从训练数据先验中进行可预测推断。
- 推理能力超越简单模仿,但不具人类认知水平或无限扩展性。
- 适合关注模型机制与可控性研究的从业者参考。
本文提出一种介于极端观点之间的现实视角:大语言模型既非随机鹦鹉,也未涌现出类似人类的高级推理能力。模型通过上下文引导,从训练数据的先验信息中进行推断,称为‘上下文导向外推’。基础模型中的示例实现上下文学习,而指令微调使模型仅凭提示即可完成相似任务。尽管推理能力远超机械复制,但其表现具有可预测性、可控性,且不会随训练无限增强。因此,对模型自主性的担忧可被缓解,研究应聚焦于上下文导向外推过程及其与训练数据的交互机制。未来工作可探索不依赖高级推理的替代增强方法。
原文摘要 · Abstract (English)
In this position paper we raise critical awareness of a realistic view of LLM capabilities that eschews extreme alternative views that LLMs are either 'stochastic parrots' or in possession of 'emergent' advanced reasoning capabilities, which, due to their unpredictable emergence, constitute an existential threat. Our middle-ground view is that LLMs extrapolate from priors from their training data while using context to guide the model to the appropriate priors; we call this "context-directed extrapolation." Specifically, this context direction is achieved through examples in base models, leading to in-context learning, while instruction tuning allows LLMs to perform similarly based on prompts rather than explicit examples. Under this view, substantiated though existing literature, while reasoning capabilities go well beyond stochastic parroting, such capabilities are predictable, controllable, not indicative of advanced reasoning akin to high-level cognitive capabilities in humans, and not infinitely scalable with additional training. As a result, fears of uncontrollable emergence of agency are allayed, while research advances are appropriately refocused on the processes of context-directed extrapolation and how this interacts with training data to produce valuable capabilities in LLMs. Future work can therefore explore alternative augmenting techniques that do not rely on inherent advanced reasoning in LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。