arXiv:2607.28966cs.CL2026-07

通过动态检测推理边界,让大模型提前结束计算,节省资源且不丢准确率。

BLADE: Boundary-Expanded and Layer-Adaptive Dynamic Exit for Efficient LLM Reasoning

  • 在句子、自我怀疑和段落等多级边界设置检查点,识别可提前终止的推理阶段。
  • 在两个Qwen3模型上分别减少24.8%和15.8%的生成词数,接近原始准确率。
  • 自动选择关键隐藏层,避免全层计算,适合部署在资源受限场景的推理系统。

大语言模型常通过生成长推理链来提升任务表现,但其中大量计算被冗余验证和修正浪费。现有基于探测的早期退出方法主要依赖显式的自我怀疑表达,难以发现更多提前终止机会。将检测范围扩展至普通推理边界虽提升了覆盖率,却暴露了高度异质的中间状态,其预测信息可能分布在不同隐藏层。本文提出轻量级框架BLADE(Boundary-Expanded and Layer-Adaptive Dynamic Exit),通过评估生成前缀是否足以正确回答问题,实现动态推理终止。BLADE从句子、自我怀疑和段落边界构建多粒度检查点,并通过重复答案补全生成鲁棒训练标签。它进一步学习一个紧凑的有信息量探针层子集,而非依赖固定选择或所有层的高开销表示。推理时,校准预测与检查点特定确认规则结合,平衡响应速度与过早退出风险。在五个基准和两个Qwen3推理模型上的实验表明,BLADE在保持近似基线准确率的同时,使Qwen3-8B生成词数减少24.8%,Qwen3-4B减少15.8%。消融研究进一步验证了多样化检查点与自动层选择的优势,证明其是更高效大模型推理的有效方案。

原文摘要 · Abstract (English)

Large language models often improve task performance by generating long reasoning traces, but the resulting computation is frequently wasted on redundant verification and revision. Existing probe-based early-exit approaches mainly inspect explicit self-doubt expressions, leaving many earlier termination opportunities undetected. Expanding inspection to ordinary reasoning boundaries improves coverage, but also exposes highly diverse intermediate states whose predictive information may reside in different hidden layers. We present Boundary-Expanded and Layer-Adaptive Dynamic Exit for Efficient LLM Reasoning (BLADE), a lightweight framework that dynamically terminates reasoning by estimating whether the generated prefix is sufficient for correct answering. BLADE constructs multi-granular checkpoints from sentence, self-doubt, and paragraph boundaries, and derives robust training labels through repeated answer completions. It further learns a compact subset of informative probe layers instead of relying on fixed choices or expensive representations from all layers. At inference time, calibrated predictions are combined with checkpoint-specific confirmation rules to balance responsiveness and premature-exit risk. Experiments on five benchmarks and two Qwen3 reasoning models show that BLADE preserves near-baseline accuracy while reducing generated tokens by 24.8% on Qwen3-8B and 15.8% on Qwen3-4B. Ablation studies further confirm the benefits of diverse checkpoints and automatic layer selection, demonstrating an effective approach to more efficient LLM reasoning.

大模型推理动态退出效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。