arXiv:2605.28292cs.CL2026-05

将思维链拆解为可复用的功能单元,提升大模型推理效率与可解释性。

CIRF: Tokenizing Chain-of-Thoughts into Reusable Functional Units for Efficient Latent Reasoning in Large Language Models

  • 将显式思维链切分为语义连贯的功能单元,以离散令牌形式动态执行推理。
  • 在数学、符号和常识推理任务中,准确率与延迟平衡优于现有隐式思维链方法。
  • 生成的函数令牌具有可解释性,适合需要透明推理过程的应用场景。

隐式思维链(CoT)通过内化显式推理过程降低大模型推理成本,但现有方法往往与显式推理不一致,且缺乏对例题复杂度的自适应能力。本文提出CIRF(Chain-of-Thoughts Into Reusable Functional units),一种将推理建模为离散功能令牌动态序列的隐式思维链框架。CIRF为显式思维链中的每个语义连贯推理单元分配一个功能令牌,模型经过微调后可自回归生成这些功能令牌及其可选结果,最后输出答案。该设计使隐式推理与功能单元序列对齐,支持并行训练、显式推理对齐与自适应推理。在数学、符号及常识推理基准上的大量实验表明,相较于最先进的隐式思维链方法,CIRF在准确率-延迟权衡上表现更优。进一步分析显示,CIRF构建了清晰可解释的功能令牌,带来持续性能提升。

原文摘要 · Abstract (English)

Implicit Chain-of-Thought (CoT) reduces the inference cost of large language models by internalizing the explicit rationales. However, existing approaches typically lack alignment with explicit rationales and adaptivity to example complexity. In this work, we propose CIRF (\textit{\underline{C}hain-of-thoughts \underline{I}nto \underline{R}eusable \underline{F}unctional units}), an implicit CoT framework that performs reasoning as a dynamic sequence of discrete functional tokens. CIRF assigns a functional token to each semantically coherent reasoning unit in explicit CoT traces. The model is then fine-tuned to autoregressively generate functional tokens and their optional results, followed by the final answer. This design aligns latent reasoning with a sequence of functional units, facilitating parallel training, explicit rationale alignment, and adaptive reasoning. Extensive experiments on mathematical, symbolic, and commonsense reasoning benchmarks show that CIRF provides a favorable accuracy-latency trade-off compared with state-of-the-art implicit CoT methods. Further analyses demonstrate that CIRF constructs distinct, interpretable functional tokens, leading to consistent performance improvements.

思维链推理优化可解释性大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。