arXiv:2604.02029cs.AI2026-04被引 34

揭示语言模型隐空间的演进与核心能力,为下一代智能系统奠基。

The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlook

论文配图:The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlook
图 1 · 摘自论文原文
  • 从显式文本生成转向连续隐空间计算,突破语言冗余与离散瓶颈。
  • 系统梳理隐空间在推理、规划、记忆等七大能力上的支撑机制。
  • 适合关注大模型底层机制与未来发展方向的研究者阅读。

隐空间正迅速成为基于语言模型的原生计算基础。尽管现代系统仍常通过显式的词元级生成理解,越来越多研究显示,许多关键内部过程在连续隐空间中比在人类可读的语义痕迹中更自然高效。这一转变源于显式空间计算的结构性局限,包括语言冗余、离散化瓶颈、序列效率低下和语义损失。本文旨在提供语言模型中隐空间的统一且最新的全景图。我们按五个递进视角组织内容:基础、演进、机制、能力与展望。首先界定隐空间范畴,区分其与显式/语言空间及生成视觉模型中常见隐空间的不同。接着追溯领域从早期探索到当前大规模扩展的演变历程。为梳理技术脉络,我们从机制与能力双重视角切入:机制方面,识别出四大发展主线——架构、表示、计算与优化;能力方面,展现隐空间支持推理、规划、建模、感知、记忆、协作与具身化等广泛能力谱系。在整合总结基础上,讨论关键开放挑战,并提出未来研究的有前景方向。期望本综述不仅作为现有工作的参考,更能为理解隐空间作为下一代智能的通用计算与系统范式奠定基础。

原文摘要 · Abstract (English)

Latent space is rapidly emerging as a native substrate for language-based models. While modern systems are still commonly understood through explicit token-level generation, an increasing body of work shows that many critical internal processes are more naturally carried out in continuous latent space than in human-readable verbal traces. This shift is driven by the structural limitations of explicit-space computation, including linguistic redundancy, discretization bottlenecks, sequential inefficiency, and semantic loss. This survey aims to provide a unified and up-to-date landscape of latent space in language-based models. We organize the survey into five sequential perspectives: Foundation, Evolution, Mechanism, Ability, and Outlook. We begin by delineating the scope of latent space, distinguishing it from explicit or verbal space and from the latent spaces commonly studied in generative visual models. We then trace the field's evolution from early exploratory efforts to the current large-scale expansion. To organize the technical landscape, we examine existing work through the complementary lenses of mechanism and ability. From the perspective of Mechanism, we identify four major lines of development: Architecture, Representation, Computation, and Optimization. From the perspective of Ability, we show how latent space supports a broad capability spectrum spanning Reasoning, Planning, Modeling, Perception, Memory, Collaboration, and Embodiment. Beyond consolidation, we discuss the key open challenges, and outline promising directions for future research. We hope this survey serves not only as a reference for existing work, but also as a foundation for understanding latent space as a general computational and systems paradigm for next-generation intelligence.

隐空间大模型系统范式语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。