arXiv:2602.03249cs.AIcs.LG2026-02被引 4

让大模型自动压缩推理步骤,提速三倍还保持准确。

Accordion-Thinking: Self-Regulated Step Summaries for Efficient and Readable LLM Reasoning

  • 模型自学习动态总结推理过程,减少历史依赖。
  • 折叠模式下吞吐量提升3倍,精度几乎不降。
  • 生成可读的结构化推理摘要,适合调试和解释。

通过延长思维链(Chain-of-Thought)提升推理能力虽有效,但受限于键值缓存线性增长与注意力复杂度的平方增长。本文提出Accordion-Thinking框架,让大模型通过动态摘要自主调节推理粒度。该机制支持折叠推理模式,即定期总结并丢弃旧思考,降低对历史令牌的依赖。我们采用强化学习进一步激励此能力,发现折叠模式与完整展开模式的准确率差距随训练逐渐缩小直至消失。这表明模型能将关键推理信息压缩至紧凑摘要中,实现有效的上下文压缩。实验显示,该方法在48GB GPU配置下实现三倍吞吐提升,同时保持精度,且结构化步骤摘要提供可读的推理记录。

原文摘要 · Abstract (English)

Scaling test-time compute via long Chain-of-Thought unlocks remarkable gains in reasoning capabilities, yet it faces practical limits due to the linear growth of KV cache and quadratic attention complexity. In this paper, we introduce Accordion-Thinking, an end-to-end framework where LLMs learn to self-regulate the granularity of the reasoning steps through dynamic summarization. This mechanism enables a Fold inference mode, where the model periodically summarizes its thought process and discards former thoughts to reduce dependency on historical tokens. We apply reinforcement learning to incentivize this capability further, uncovering a critical insight: the accuracy gap between the highly efficient Fold mode and the exhaustive Unfold mode progressively narrows and eventually vanishes over the course of training. This phenomenon demonstrates that the model learns to encode essential reasoning information into compact summaries, achieving effective compression of the reasoning context. Our Accordion-Thinking demonstrates that with learned self-compression, LLMs can tackle complex reasoning tasks with minimal dependency token overhead without compromising solution quality, and it achieves a three times throughput while maintaining accuracy on a 48GB GPU memory configuration, while the structured step summaries provide a human-readable account of the reasoning process.

推理优化思维链自压缩高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。