arXiv:2609.07036cs.CLcs.AI2026-09

通过区分两种推理模式,提升大模型解题能力。

Aha-Flow Distillation: Flow Markers Matter in LLM Reasoning

论文配图:Aha-Flow Distillation: Flow Markers Matter in LLM Reasoning
图 1 · 摘自论文原文
  • 用语言标记区分持续推理与顿悟式推理,构建双模式训练信号。
  • 在两个数据集上,解题准确率平均提升1.1个百分点。
  • 适合研究大模型推理机制与自蒸馏方法的学者使用。

我们识别出一种称为Flow Moment的推理模式,其特征是持续、确认过程的口语化表达(如‘我正在做’),与侧重修正和回溯的Aha Moment形成对比。对应的语言表达分别称为Flow Markers和Aha Markers。基于此,我们重构原始推理轨迹中的话语标记,生成Flow-CoT,并作为辅助监督用于在策略自蒸馏(OPSD)中。进一步提出Aha-Flow Distillation(AFD),一种双模式扩展方法,将不同形式的先验信息与对应推理指令配对:Aha分支保留简洁的解法导向监督,Flow分支则在直接且自信的推理指令下引入重写后的Flow-CoT。推理时仅使用标准反思指令,因此Flow式推理仅作为训练信号。在AIME25和HMMT25上的实验显示,相比复现的OPSD基线,AFD使Qwen3-8B的Avg@12从60.8提升至61.3,Qwen3-4B从57.5提升至58.6。受控消融实验表明,在相同内容组成下,双模式训练使Avg@12从59.5提升至60.1,说明收益不仅来自异质推理监督,更源于其在自蒸馏中的组织方式。

原文摘要 · Abstract (English)

We identify the Flow Moment, a reasoning pattern characterized by sustained, process-confirming verbalizations such as I'm doing, in contrast to the revision- and backtracking-oriented Aha Moment. We refer to their corresponding linguistic expressions as Flow Markers and Aha Markers, respectively. Based on this observation, we construct Flow-CoT by rewriting the discourse markers of original reasoning traces while preserving their underlying reasoning content, and use it as auxiliary supervision for on-policy self-distillation (OPSD). We further propose \textbf{Aha-Flow Distillation (AFD)}, a dual-mode extension of OPSD that pairs different forms of privileged information with corresponding reasoning instructions. The Aha branch retains concise solution-based supervision, while the Flow branch introduces rewritten Flow-CoT under a direct and confident reasoning instruction. At inference time, the model uses only the standard reflective instruction, so Flow-style reasoning serves purely as a training signal. Experiments on AIME25 and HMMT25 show consistent improvements across Qwen3-8B and Qwen3-4B: AFD improves Avg@12 from 60.8 to 61.3 on Qwen3-8B and from 57.5 to 58.6 on Qwen3-4B over our reproduced OPSD baselines. Controlled ablations further show that, with the same Flow-CoT/Aha-CoT composition, dual-mode training improves Avg@12 from 59.5 to 60.1, indicating that the benefit comes not only from introducing heterogeneous reasoning supervision, but also from how it is organized during self-distillation. The code is available at https://github.com/Wang-Xiaodong1899/Aha-Flow-Distillation.

大模型推理自蒸馏思维链

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。