状态表示方式影响大模型动态推理,选对形式能显著提升表现。
State Design Matters: How Representations Shape Dynamic Reasoning in Large Language Models
- 通过调整状态粒度、结构和空间表征方式,系统测试其对推理的影响。
- 摘要式状态可降噪并稳定长程推理,文本空间编码比图像更有效。
- 适合研究长序列决策、多任务协同的智能体设计与模型优化者阅读。
随着大语言模型从静态推理转向动态环境,其性能依赖于在推理过程中应对变化环境的能力。本文在模型参数固定的前提下,系统考察了三种关键状态表示因素:(1)状态粒度(长文本与摘要),(2)结构形式(自然语言与符号化),(3)空间定位(纯文本与图像或文本地图编码),在序列决策基准上进行实验。结果表明,轨迹摘要可降低噪声并稳定长时推理;自然语言表示在各类模型中表现最稳健,而结构化编码仅对具备代码或结构输出先验的模型(如支持JSON模式的模型)有益;虽然图像输入略有优势,但文本空间编码最为有效——其优势并非来自空间信息本身,而是构造过程促使模型主动进行空间推理,这是静态输入无法激发的。总体而言,状态表示的设计是决定性能的关键因素,独立于信息量本身。然而,即便优化表示,当前大模型与视觉语言模型在长周期任务中仍显脆弱,尤其在需整合多子任务达成目标时表现不佳。
原文摘要 · Abstract (English)
As large language models (LLMs) move from static reasoning tasks toward dynamic environments, their success depends on the ability to navigate and respond to an environment that changes as they interact at inference time. An underexplored factor in these settings is the representation of the state. Holding model parameters fixed, we systematically vary three key aspects: (1) state granularity (long form versus summary), (2) structure (natural language versus symbolic), and (3) spatial grounding (text-only versus images or textual map encodings) across sequential decision-making benchmarks. We find that trajectory summarisation improves performance by reducing noise and stabilising long-horizon reasoning. Second, natural language representations are the most robust across models, whereas structured encodings help mainly for models with strong code or structured output priors, such as JSON schemas. Third, while image-inputs show some benefit, text-based spatial encodings prove most effective. This advantage stems not from the spatial information itself, but from the act of construction, which compels the model to perform the spatial reasoning that static input does not elicit. Overall, we demonstrate that design choices for representing state are a decisive factor in performance, distinct from the availability of information itself. We note, however, that even with improved representations, current LLMs and VLMs remain brittle over long horizons, particularly when they must synthesise information to manage multiple subtasks to reach a goal.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。