arXiv:2602.11639cs.CL2026-02ACL被引 2

提出双层压缩框架,让模型推理更短更准

PACE: Prefix-Protected and Difficulty-Aware Compression for Efficient Reasoning

  • 分层控制推理长度:保留关键步骤,动态调整压缩强度
  • 数学题上减少55.7% token,准确率还提升4.1%
  • 适合需要高效推理的复杂任务场景

语言推理模型(LRMs)通过增加推理计算量获得强性能,但常出现过度思考,导致推理过程过长,增加延迟和内存消耗。现有方法通常使用统一长度惩罚来强制简洁,却会过度压缩序列早期的重要推理步骤,并对所有问题一视同仁地施加惩罚。为此,我们提出 extbf{ extmodel},一种在分层监督下的前缀保护与难度感知压缩框架。在序列层面,前缀保护优化采用衰减混合展开策略,在保持有效推理路径的同时促进简洁性;在群体层面,难度感知惩罚根据查询复杂度动态调整长度约束,对难题保持探索性,对简单题抑制冗余。在 DeepSeek-R1-Distill-Qwen(1.5B/7B)上的大量实验表明, extbf{ extmodel} 在数学基准测试中实现高达55.7%的令牌使用量减少,同时准确率提升4.1%,且在代码、科学和通用领域具有泛化能力。

原文摘要 · Abstract (English)

Language Reasoning Models (LRMs) achieve strong performance by scaling test-time computation but often suffer from ``overthinking'', producing excessively long reasoning traces that increase latency and memory usage. Existing LRMs typically enforce conciseness with uniform length penalties, which over-compress crucial early deduction steps at the sequence level and indiscriminately penalize all queries at the group level. To solve these limitations, we propose \textbf{\model}, a dual-level framework for prefix-protected and difficulty-aware compression under hierarchical supervision. At the sequence level, prefix-protected optimization employs decaying mixed rollouts to maintain valid reasoning paths while promoting conciseness. At the group level, difficulty-aware penalty dynamically scales length constraints based on query complexity, maintaining exploration for harder questions while curbing redundancy on easier ones. Extensive experiments on DeepSeek-R1-Distill-Qwen (1.5B/7B) demonstrate that \model achieves a substantial reduction in token usage (up to \textbf{55.7\%}) while simultaneously improving accuracy (up to \textbf{4.1\%}) on math benchmarks, with generalization ability to code, science, and general domains.

推理压缩模型效率数学推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。