通过优化语言表达方式,提升大模型解决问题能力
Shaping Schema via Language Representation as the Next Frontier for LLM Intelligence Expanding

- 设计更精细的语言表达形式来构建任务认知结构
- 相同任务用不同语言表述,模型表现和内部激活差异显著
- 无需改模型也能通过语言设计大幅提升性能,适合模型优化研究者
尽管自然语言是大语言模型(LLM)的默认交互媒介,但其表达能力有限,已成为复杂问题求解的核心瓶颈。当前人工智能的发展虽依赖于规模扩展,但单纯内化知识并不等于有效应用。本文将语言表示定义为用于映射和建模现实世界的语言与符号结构,提出:通过高级语言表示塑造认知模式(schema),是拓展大模型智能的下一前沿。我们论证,大模型的知识激活与组织——即其认知结构——高度依赖于任务所用语言在结构与符号层面的复杂度。本文不仅对这一观点进行了形式化,还提供了实证支持:第一,回顾了近期实践与新兴方法,表明仅通过精心设计语言表示即可实现显著性能提升,无需修改模型参数或规模;第二,通过受控实验发现,同一任务采用不同语言表达时,大模型的性能及内部特征激活存在明显差异。这些结果凸显语言表示设计作为未来研究的重要方向。
原文摘要 · Abstract (English)
Although natural language is the default medium for Large Language Models (LLMs), its limited expressive capacity creates a profound bottleneck for complex problem-solving. While recent advancements in AI have relied heavily on scaling, merely internalizing knowledge does not guarantee its effective application. Defining language representation as the linguistic and symbolic constructs used to map and model the real world, this paper argues that shaping schemas through advanced language representation is the next frontier for expanding LLM intelligence. We posit that an LLM's knowledge activation and organization -- its schema -- depends heavily on the structural and symbolic sophistication of the language used to represent a given task. This paper contributes both a formalization of this claim and the empirical evidence to support it. With a new formalization, we present multiple lines of evidence to support our position: Firstly, we review recent empirical practices and emerging methodologies that demonstrate the substantial performance gains achievable through deliberate language representation design, even without modifying model parameters or scale. Secondly, we conduct controlled experiments showing that LLM performance and its internal feature activations vary under different language representations of the same underlying task. Together, these findings highlight language representation design as a promising direction for future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。