用元认知让大模型自我纠错,速度比专用推理模型快得多
Language Models Coupled with Metacognition Can Outperform Reasoning Models
- 用元认知模块监控大模型,动态给反馈和例子来优化答案
- 在图着色和代码调试任务中,准确率接近甚至超过专用推理模型
- 适合追求高速高准确的场景,如实时系统或资源受限环境
大型语言模型(LLM)在多种推理任务中表现出速度快、适应性强的优势,但在需要严格逻辑或约束时表现不佳。相比之下,大型推理模型(LRM)专为复杂、分步推理设计,但计算成本高且推理慢。为此,我们推广并应用了SOFAI(慢速与快速人工智能)认知架构,提出SOFAI-LM,通过元认知机制协调快速的LLM与更强大的慢速LRM。元认知模块主动监测LLM的表现,提供针对性的迭代反馈及示例,使LLM无需额外微调即可逐步改进解题过程。在图着色和代码调试任务上的大量实验表明,该反馈驱动方法显著提升了LLM的问题解决能力。在许多情况下,其性能达到甚至超越独立运行的LRM,同时所需时间明显更少。当仅靠LLM和反馈仍不足时,我们利用反馈循环中收集的信息,向特定问题领域定制的LRM提供支持,进一步提升整体性能。在要求全局一致性的图着色与需局部修复的代码调试两个截然不同的领域中,SOFAI-LM均实现与独立LRM相当或更高的准确率,且推理时间大幅降低。
原文摘要 · Abstract (English)
Large language models (LLMs) excel in speed and adaptability across various reasoning tasks, but they often struggle when strict logic or constraint enforcement is required. In contrast, Large Reasoning Models (LRMs) are specifically designed for complex, step-by-step reasoning, although they come with significant computational costs and slower inference times. To address these trade-offs, we employ and generalize the SOFAI (Slow and Fast AI) cognitive architecture into SOFAI-LM, which coordinates a fast LLM with a slower but more powerful LRM through metacognition. The metacognitive module actively monitors the LLM's performance and provides targeted, iterative feedback with relevant examples. This enables the LLM to progressively refine its solutions without requiring the need for additional model fine-tuning. Extensive experiments on graph coloring and code debugging problems demonstrate that our feedback-driven approach significantly enhances the problem-solving capabilities of the LLM. In many instances, it achieves performance levels that match or even exceed those of standalone LRMs while requiring considerably less time. Additionally, when the LLM and feedback mechanism alone are insufficient, we engage the LRM by providing appropriate information collected during the LLM's feedback loop, tailored to the specific characteristics of the problem domain and leads to improved overall performance. Evaluations on two contrasting domains: graph coloring, requiring globally consistent solutions, and code debugging, demanding localized fixes, demonstrate that SOFAI-LM enables LLMs to match or outperform standalone LRMs in accuracy while maintaining significantly lower inference time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。