arXiv:2604.03679cs.CLcs.AI2026-04被引 1

让大模型动态压缩思考过程,减少内存占用并提升长期推理性能。

LightThinker++: From Reasoning Compression to Memory Management

  • 动态压缩中间思考,用紧凑语义表示替代长推理链。
  • 峰值令牌使用量降低70%,长任务中性能平均提升14.8%。
  • 适合需要持续推理的复杂智能体任务,如多轮对话或规划。

大型语言模型(LLMs)在复杂推理中表现优异,但其效率受制于长推理链条带来的认知开销。本文提出LightThinker,使模型能够动态将中间思考压缩为紧凑的语义表示。然而,静态压缩在复杂推理中常因关键细节丢失导致逻辑瓶颈。为此,我们升级为LightThinker++,引入显式自适应记忆管理机制,通过专用轨迹合成管道训练有目的的记忆调度策略。大量实验验证了该框架在三个维度上的通用性:(1) LightThinker将峰值令牌使用量降低70%,推理时间减少26%,且精度损失极小;(2) 在标准推理中,LightThinker++在相同上下文预算下,峰值令牌使用量降低69.9%,准确率提升2.42%;(3) 最关键的是,在长时程代理任务中,其内存足迹稳定维持在80轮以上(相比原方案减少60%-70%),跨不同复杂场景平均性能提升14.8%。整体而言,本工作为实现大模型在长时推理中的高效可持续运行提供了可扩展方向。

原文摘要 · Abstract (English)

Large language models (LLMs) excel at complex reasoning, yet their efficiency is limited by the surging cognitive overhead of long thought traces. In this paper, we propose LightThinker, a method that enables LLMs to dynamically compress intermediate thoughts into compact semantic representations. However, static compression often struggles with complex reasoning where the irreversible loss of intermediate details can lead to logical bottlenecks. To address this, we evolve the framework into LightThinker++, introducing Explicit Adaptive Memory Management. This paradigm shifts to behavioral-level management by incorporating explicit memory primitives, supported by a specialized trajectory synthesis pipeline to train purposeful memory scheduling. Extensive experiments demonstrate the framework's versatility across three dimensions. (1) LightThinker reduces peak token usage by 70% and inference time by 26% with minimal accuracy loss. (2) In standard reasoning, LightThinker++ slashes peak token usage by 69.9% while yielding a +2.42% accuracy gain under the same context budget for maximum performance. (3) Most notably, in long-horizon agentic tasks, it maintains a stable footprint beyond 80 rounds (a 60%-70% reduction), achieving an average performance gain of 14.8% across different complex scenarios. Overall, our work provides a scalable direction for sustaining deep LLM reasoning over extended horizons with minimal overhead.

大模型推理记忆管理思维压缩长时推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。