arXiv:2602.17686cs.LGcs.AI2026-02中稿 · SDM 2026

让小模型学会大模型的解题思路,还能更简洁准确。

BRIDGE: Bridging Reasoning In Distillation Gap Elimination via Structure-Aware Masking

  • 用结构感知掩码重建训练小模型理解推理逻辑
  • 在GSM8K上提升11.29%准确率,减少27.4%推理 token
  • 适合需要高效、可解释推理的小模型部署场景

链式思维(CoT)显著提升了大语言模型在数学问题求解上的能力,但将这种能力蒸馏到小型模型仍面临容量不匹配的挑战。直接复制教师模型冗长的推理链会导致小模型过载,出现输出截断或重复错误。现有方法要么牺牲可解释性(如将推理压缩至隐状态),要么破坏逻辑完整性(如随机剪枝)。为此,我们提出BRIDGE,一种分阶段课程框架:首先通过掩码重建建立结构理解,再使用基于GRPO的强化学习引导学生自发现精度与简洁性的最佳平衡,最后在失败案例上通过教师指导重写内化复杂推理。在GSM8K上,BRIDGE使Qwen2.5-3B模型实现11.29%准确率提升和27.4%的token减少,优于指令微调变体与蒸馏基线。零样本迁移实验在SVAMP和MATH-500上进一步验证了内化推理的泛化能力。代码与模型权重已公开于https://github.com/Applied-Machine-Learning-Lab/SDM2026_BRIDGE 和 https://huggingface.co/bowen0815/BRIDGE。

原文摘要 · Abstract (English)

Chain-of-Thought (CoT) reasoning has significantly improved LLMs' mathematical problem-solving capabilities, but distilling such capabilities into smaller models remains challenging due to the capacity mismatch between verbose teachers and compact students. Directly copying teachers' lengthy reasoning chains causes capacity overload, resulting in truncated outputs or repetitive failure. Existing remedies each sacrifice a critical property of CoT: implicit reasoning methods (e.g., compressing reasoning into hidden states) trade away interpretability and verifiability, while heuristic compression strategies (e.g., random step pruning) destroy logical integrity. To address this, we propose BRIDGE, a curriculum framework that first establishes structural understanding via masked reconstruction, then uses GRPO-based reinforcement learning to guide students in self-discovering the optimal balance between accuracy and brevity, and finally internalizes complex reasoning through teacher-guided rewriting on failure cases. On GSM8K, BRIDGE enables Qwen2.5-3B to achieve 11.29% accuracy improvement and 27.4% token reduction over the original model, outperforming instruction-tuned variants and distillation baselines. Zero-shot transfer experiments on SVAMP and MATH-500 further confirm the generalization of internalized reasoning. Our code and model checkpoints are publicly available at https://github.com/Applied-Machine-Learning-Lab/SDM2026_BRIDGE and https://huggingface.co/bowen0815/BRIDGE.

模型蒸馏链式思维小模型推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。