arXiv:2605.09346cs.CLcs.AI2026-05

用规则先验压缩大模型推理链,单步完成且准确率提升11.1%

RuPLaR : Efficient Latent Compression of LLM Reasoning Chains with Rule-Based Priors From Multi-Step to One-Step

论文配图:RuPLaR : Efficient Latent Compression of LLM Reasoning Chains with Rule-Based Priors From Multi-Step to One-Step
图 1 · 摘自论文原文
  • 用规则先验引导单阶段训练,生成连续隐空间推理码
  • 准确率比现有方法高11.1%,仅用极少推理词元
  • 适合需要高效推理的部署场景,尤其看重精度与速度

Chain-of-Thought(CoT)虽提升了大语言模型的可解释性,但受限于自然语言的低效与表达力不足。隐空间推理(latent CoT)在连续隐空间中运行,是潜在替代方案,但现有多步或多模型范式存在结构复杂、误差传播和协调开销等问题。本文提出一种名为RuPLaR的新压缩框架,实现「一模型一阶段」的隐式推理。该方法通过规则先验概率分布指导单一训练阶段,使模型自主生成隐式推理码,消除级联过程与跨模型依赖。为保障推理质量,设计联合训练目标:通过交叉熵强制答案一致性,利用KL散度对齐软码与规则先验(软思考约束),并在表示空间引入问题-思考语义对齐约束。大量实验表明,该框架在准确率上较现有潜空间方法提升11.1%,同时仅需极少量词元,验证其高效性与可扩展性。

原文摘要 · Abstract (English)

The Chain-of-Thought (CoT) paradigm, while enhancing the interpretability of Large Language Models (LLMs), is constrained by the inefficiencies and expressive limits of natural language. Latent Chain-of-Thought (latent CoT) reasoning, which operates in a continuous latent space, offers a promising alternative but faces challenges from structural complexities in existing multi-step or multi-model paradigms, such as error propagation and coordination overhead. In this paper, we introduce One-Model One-Step, a novel compression framework for Latent Reasoning with Rule-Based Priors(RuPLaR) to address this challenge. Our method trains an LLM to autonomously generate latent reasoning tokens in a single training stage, guided by rule-based prior probability distributions, thereby eliminating cascaded processes and inter-model dependencies. To ensure reasoning quality, we design a joint training objective that enforces answer consistency via cross-entropy, aligns soft tokens with rule-based priors via KL divergence (the Soft Thinking constraint), and adds a problem-thought semantic alignment constraint in the representation space. Extensive experiments show that our compression framework not only improves accuracy by 11.1% over existing latent CoT methods but also achieves this with minimal token usage, underscoring its effectiveness and extensibility. Code: https://github.com/xiaocen-luo/RuPLaR.

大模型推理隐空间压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。