arXiv:2512.15358cs.CL2025-12

用高低密度语言分别处理推理和回答,节省62%计算量

Dual-Density Inference for Efficient Language Model Reasoning

  • 分阶段使用不同信息密度:推理用压缩符号,回答用人可读语言
  • 在多轮推理任务中减少62%令牌消耗,准确率不降反升
  • 适合需要高效推理的复杂问答场景,如数学、逻辑题

大型语言模型在复杂推理任务中表现优异,但现有方法对中间推理和最终答案采用统一语言密度,导致计算效率低下。我们发现,推理过程是模型自身的计算功能,而回答则是面向人类理解的沟通功能。这一差异使我们能够对中间计算使用压缩、符号密集的语言,同时保持最终答案的人类可读性。为此,我们提出Denser:一种新型双密度推理框架,通过三个模块实现:输入问题分析模块、高密度压缩推理机制和答案生成组件,将压缩推理结果转化为可读解答。在多个推理问答基准上的实验表明,Denser相比标准思维链方法最多减少62%的令牌消耗,同时保持或提升准确率。这一效率优势在需要多步推理的复杂问题中尤为显著。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have shown impressive capabilities in complex reasoning tasks. However, current approaches employ uniform language density for both intermediate reasoning and final answers, leading to computational inefficiency. Our observation found that reasoning process serves a computational function for the model itself, while answering serves a communicative function for human understanding. This distinction enables the use of compressed, symbol-rich language for intermediate computations while maintaining human-readable final explanations. To address this inefficiency, we present Denser: \underline{D}ual-d\underline{ens}ity inf\underline{er}ence, a novel framework that optimizes information density separately for reasoning and answering phases. Our framework implements this through three components: a query processing module that analyzes input problems, a high-density compressed reasoning mechanism for efficient intermediate computations, and an answer generation component that translates compressed reasoning into human-readable solutions. Experimental evaluation across multiple reasoning question answering benchmarks demonstrates that Denser reduces token consumption by up to 62\% compared to standard Chain-of-Thought methods while preserving or improving accuracy. These efficiency gains are particularly significant for complex multi-step reasoning problems where traditional methods generate extensive explanations.

推理优化语言密度高效生成大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。