arXiv:2602.22508cs.AI2026-02

让大模型学会自我调节,提升多跳问答准确率

Metacognitive Behavioral Tuning of Large Language Models for Multi-Hop Question Answering

  • 引入五阶段元认知结构,规范推理过程
  • 在多个数据集上实现最高准确率与效率平衡
  • 显著缩短回答长度,减少冗余和错误迭代

大型语言模型在多跳问答任务中常因缺乏自我调节能力而给出错误答案,尽管推理链中已包含正确中间结论。本文提出元认知行为调优(MBT),通过注入五阶段元认知结构(理解过滤、规划、执行监控、自我修正、验证)来增强模型自控力。MBT有两种形式:MBT-S从零生成元认知推理链,MBT-R将学生原推理链重构为元认知形式。在HotpotQA、MuSiQue、2WikiMultiHopQA三个数据集上,MBT在不同模型规模下均取得最高准确率-效率得分(AES)。其平均响应长度比基线方法短一个数量级,退化次数也降低近似幅度。对照实验确认提升源于五阶段结构先验。新增两个评估指标:到达冗余度(RRP)与元认知质量指数(MQI),MBT在两者上均表现最优,体现最早达成答案、最少冗余、最完整阶段覆盖。

原文摘要 · Abstract (English)

Large Language Models (LLMs) often produce incorrect answers on multi-hop question answering even when the reasoning trace already contains a correct intermediate conclusion. We attribute this gap to weak self-regulation rather than insufficient reasoning capacity. Without explicit regulation, valid intermediate conclusions are overridden by continued exploration or left unrecognized as logically sufficient. We propose Metacognitive Behavioral Tuning (MBT), a post-training framework that injects a five-phase metacognitive structure into reasoning traces. The five phases are understanding and filtering, planning, execution and monitoring, self-correction, and verification. MBT has two formulations. MBT-S synthesizes new metacognitive traces from scratch, while MBT-R rewrites the student's own traces into a metacognitive form. Across HotpotQA, MuSiQue, and 2WikiMultiHopQA, MBT attains the highest Accuracy-Efficiency Score (AES) across model scales. MBT lifts task accuracy while keeping traces short and stable, with mean response length on MuSiQue an order of magnitude shorter than baseline methods and degeneration counts reduced by a similar margin. A matched-control study further confirms that the gain stems from the five-phase structural prior itself. To qualitatively assess the regulatory behavior of reasoning traces, we introduce two new metrics, the Reach-Redundancy Profile (RRP) and the length-aware Metacognitive Quality Index (MQI). RRP captures when the answer is reached and how much of the trace is redundant, and MQI quantifies how richly the five phases appear. Under both metrics, MBT achieves the earliest answer arrival, the lowest redundancy, and the richest phase-level behavior across model scales.

大模型推理优化元认知问答系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。