让AI推理更省力:用精简思考替代长篇大论,速度提升5倍
Efficient Reasoning via Thought Compression for Language Segmentation
- 先生成精炼理由再补详细解释,训练时学会压缩思维
- 推理时只用精简理由,长度从112降至23词,提速近5倍
- 适合追求高效推理的视觉语言任务应用者
链式思考(CoT)虽显著提升了大模型在语言引导分割中的表现,但因生成冗长推理过程导致计算开销过大,限制了实际应用。我们提出WISE(来自内部自探索的智慧),一种基于‘思考两次——一次学习,一次加速’原则的新范式。该方法训练模型生成结构化序列:简洁理由、最终答案、以及详细解释。通过将简洁理由置于首位,利用自回归条件约束其作为生成详细解释的充分摘要。这一结构由自蒸馏目标强化,同时奖励语义一致性和简洁性,促使模型将详细推理内化为紧凑形式。推理阶段省略详细解释,为应对由此产生的条件分布偏移,我们采用简易提示技术——在用户查询中注入强调简洁性的指令,即WISE-S策略,从而稳健激活已学得的精简推理模式,充分发挥框架优势。大量实验表明,WISE-S在ReasonSeg基准上实现58.3 cIoU的顶尖零样本性能,平均推理长度减少近5倍(从112降至23词)。代码已开源。
原文摘要 · Abstract (English)
Chain-of-thought (CoT) reasoning has significantly improved the performance of large multimodal models in language-guided segmentation, yet its prohibitive computational cost, stemming from generating verbose rationales, limits real-world applicability. We introduce WISE (Wisdom from Internal Self-Exploration), a novel paradigm for efficient reasoning guided by the principle of \textit{thinking twice -- once for learning, once for speed}. WISE trains a model to generate a structured sequence: a concise rationale, the final answer, and then a detailed explanation. By placing the concise rationale first, our method leverages autoregressive conditioning to enforce that the concise rationale acts as a sufficient summary for generating the detailed explanation. This structure is reinforced by a self-distillation objective that jointly rewards semantic fidelity and conciseness, compelling the model to internalize its detailed reasoning into a compact form. At inference, the detailed explanation is omitted. To address the resulting conditional distribution shift, our inference strategy, WISE-S, employs a simple prompting technique that injects a brevity-focused instruction into the user's query. This final adjustment facilitates the robust activation of the learned concise policy, unlocking the full benefits of our framework. Extensive experiments show that WISE-S achieves state-of-the-art zero-shot performance on the ReasonSeg benchmark with 58.3 cIoU, while reducing the average reasoning length by nearly \textbf{5$\times$} -- from 112 to just 23 tokens. Code is available at \href{https://github.com/mrazhou/WISE}{WISE}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。