arXiv:2605.17088cs.CL2026-05

自动构建推理链,让少样本学习更准确

ACIL: Auto Chain of Thoughts for In-Context Learning

论文配图:ACIL: Auto Chain of Thoughts for In-Context Learning
图 1 · 摘自论文原文
  • 自动生成带中间步骤的推理示例,增强提示信息
  • 在多个推理任务上提升少样本学习准确率
  • 适合需要多步推理的智能问答与逻辑推断场景

大语言模型在复杂推理任务上的表现得益于思维链(Chain-of-Thought, CoT)推理机制。同时,少样本学习(In-Context Learning, ICL)通过提示中提供的示例实现模型适配,无需更新参数。然而,标准ICL在需要多步推理的任务上表现不佳,因示范仅包含输入输出对,缺乏中间推理过程。本文提出自动思维链(Auto-CoT)框架,通过自动生成输入输出示例的推理链,将结构化中间解释加入提示上下文,并通过系统化筛选去除无关或低质量示例。将高质量推理示例融入ICL提示后,显著引导模型进行可靠推理,提升预测准确性。在多个推理任务上的实验表明,该框架通过提供明确的中间推理指导,有效提升了ICL性能。

原文摘要 · Abstract (English)

Recent advances in large language models (LLMs) have shown that Chain-of-Thought (CoT) reasoning can substantially improve performance on complex reasoning tasks. At the same time, In-Context Learning (ICL) has become an important mechanism for adapting LLMs to new tasks without updating model parameters, using only examples provided in the prompt. However, standard ICL often struggles on tasks that require multi-step reasoning, because the demonstrations usually contain only input-output pairs and lack explicit intermediate reasoning steps. This paper introduces an Automatic Chain-of-Thought (Auto-CoT) framework to improve ICL by automatically constructing reasoning-enhanced demonstrations. Auto-CoT generates reasoning chains for input-output examples, augments the prompt context with structured intermediate explanations, and removes irrelevant or low-quality demonstrations through a systematic selection process. By incorporating high-quality reasoning examples into the ICL prompt, Auto-CoT guides the model toward more reliable reasoning and improves prediction accuracy. Experiments across multiple reasoning tasks demonstrate that the proposed framework improves ICL performance by providing explicit intermediate reasoning guidance.

少样本学习思维链推理增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。