用认知需求评估提升大模型自适应推理,无需训练即可跨任务零样本迁移。
Cognitive Demand Steering for Adaptive Meta-Reasoning in Large Language Models
- 基于认知科学设计16维需求评估,实时判断剩余推理难度。
- 在三类大模型上平均提升准确率21.9%,数学与编程任务增益显著。
- 无需训练组件,支持零样本迁移,适合复杂推理场景应用。
近期的元推理框架通过迭代控制环改进大语言模型的思维链生成,实现更有效的回溯、终止推理循环及注入有前景的推理模式等策略调整。尽管效果良好,现有方法常依赖向后看的奖励函数,使用粗粒度搜索动作,或需额外推理控制器训练并依赖多示例监督。本文提出认知需求引导(Cognitive Demand Steering, CDS),一种无需训练的元推理框架,采用残余需求评估机制:每一步由基于LLM的进展评估器刻画达成解所需的剩余推理量,而非仅评价前一步。这使得元控制器能选择包含通用范例和操作(如定量推理的一般指导)的干预措施,直接应对该前瞻需求信号。此转变消除了对任何训练组件的需求,实现了跨模型与任务的零样本迁移。我们采用认知量表设计干预措施,并对初始问题复杂度及残余需求信号进行16维度建模,源自认知科学(如注意力与扫描、学习与抽象、空间物理推理)。在三个前沿大模型和六个推理基准上的平均结果显示,相较于直接调用,准确率提升21.9%;相比标准思维链,提升9%,尤其在高难度数学与编程任务中表现突出。
原文摘要 · Abstract (English)
Recent meta-reasoning frameworks improve LLM reasoning by wrapping chain-of-thought generation in an iterative control loop, allowing more effective backtracking, termination of reasoning loops, and injection of promising reasoning patterns, among other strategy adjustments. Despite promising results, methods often rely on backward-looking reward functions, utilize coarse search actions, or require additional reasoning controller training requiring many-shot supervision. We introduce Cognitive Demand Steering (CDS), a training-free meta-reasoning framework equipped with residual demand assessment: at each step, an LLM-based progress evaluator characterizes the residual reasoning required to arrive at a solution rather than merely evaluating the previous step. This allows a meta-controller to select reasoning interventions comprising both general-purpose exemplars and actions (e.g., general guidance for quantitative reasoning) that directly tackle this forward-looking demand signal. This shift eliminates the need for any trained component while enabling zero-shot transfer across models and tasks with no adaptation. Rather than relying on coarse characterizations, we employ cognitive scales to both design interventions as well as profile initial problem complexity and residual demand signal over 16 dimensions motivated by cognitive science (e.g., attention and scan, learning and abstraction, spatio-physical reasoning), giving the controller a fine-grained vocabulary for diagnosing. Averaged across three frontier LLMs and six reasoning benchmarks, CDS improves accuracy by $21.9\%$ over direct calls and $9\%$ over standard CoT reasoning, with the largest gains on difficult mathematics and coding tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。