arXiv:2511.05747cs.AI2025-11被引 4

用压缩推理链让小模型也能高效准确地答题。

CoT-X: An Adaptive Framework for Cross-Model Chain-of-Thought Transfer and Optimization

  • 先由大模型生成完整推理链,再压缩成精炼版本供小模型使用。
  • 在日文医学题上,相同字数下准确率比直接截断提升最高40.5%。
  • 适配不同模型对,只需15次评估就找到最佳配置,省下84%成本。

长链式推理(CoT)能提升推理准确性,但对小型或延迟敏感的语言模型重复生成代价高昂。本文提出一种实用替代方案:由能力较强的‘思考’模型一次性生成丰富推理过程,压缩后作为上下文供更廉价的‘回答’模型复用。我们提出CoT-X框架,可将推理链按语义分段,评估其诊断与逻辑重要性,选择符合预算的证据路径,并重构出连贯的压缩推理链供回答模型使用。在涵盖10个专科的7,501道日本医学执照考题上,相同字数预算下,CoT-X相比直接截断准确率最高提升40.5%,尤其在64至256字之间效果最显著。在8个DeepSeek-R1和Qwen3模型(1.5B-32B参数)共64组思维-回答组合中,同模型族内迁移最可靠,但压缩后跨族迁移仍有效。通过高斯过程贝叶斯优化层,仅需15次评估即可找到近优的模型-预算组合,相比全量搜索减少84%评估成本。结果表明,推理质量、字数预算与模型兼容性可协同优化,使CoT式推理在实际部署中更具可行性。

原文摘要 · Abstract (English)

Long Chain-of-Thought (CoT) traces can improve reasoning accuracy, but repeatedly generating them is costly for smaller or latency-constrained language models. This paper studies a practical alternative: produce a rich rationale once with a capable \emph{thinking} model, compress it, and reuse the compressed trace as context for a cheaper \emph{answering} model. We introduce CoT-X, an adaptive framework for cross-model CoT transfer. CoT-X segments reasoning traces into semantic units, scores their diagnostic and logical importance, selects budget-feasible evidence paths, and reconstructs a coherent compressed rationale for the answering model. On $7,501$ Japanese medical licensing questions spanning $10$ specialties, CoT-X improves accuracy over direct truncation by up to $40.5\%$ under the same token budget, with the largest gains at $64$--$256$ tokens. Across $64$ thinking--answering pairs from eight DeepSeek-R1 and Qwen3 models (1.5B--32B parameters), reasoning transfer is most reliable within a model family, yet remains effective across families once compression normalizes the trace. A Gaussian Process Bayesian optimization layer finds near-optimal model--budget configurations with $15$ evaluations rather than an exhaustive search over all $64$ pairs, reducing evaluation cost by $84\%$. These results show that reasoning quality, token budget, and model compatibility can be optimized jointly, making CoT-style reasoning more practical under realistic deployment constraints.

推理链模型压缩多模型协同效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。