无需外部反馈,一次推理完成自我反思,提升大模型可靠性。
Meta-Reflection: A Feedback-Free Reflection Learning Framework
- 将过往反思经验存入代码本,遇到相似问题时自动调用
- 在公开数据集和电商场景中显著减少幻觉与错误推理
- 适合需要高效、低成本可靠推理的工业级应用
尽管大型语言模型在自然语言理解和推理方面表现出色,但常出现幻觉和不忠实推理等不良行为。现有反射机制虽有效,却依赖高质量外部反馈并需多轮迭代推理,限制了实际应用。本文提出Meta-Reflection,一种无需外部反馈的新型反射框架,仅需单次推理即可完成反思。受人类通过记忆过往经验解决相似问题的启发,该方法将反思洞察编码存储于代码本中,实现历史经验的存储、检索与复用,指导模型决策。为验证其在真实场景中的实用性,我们构建了工业级电商客户意图识别基准ECID。在多个公开数据集及ECID上的大量实验表明,该方法在保持高效率的同时显著提升了推理准确性与可靠性。
原文摘要 · Abstract (English)
Despite the remarkable capabilities of large language models (LLMs) in natural language understanding and reasoning, they often display undesirable behaviors, such as generating hallucinations and unfaithful reasoning. A prevalent strategy to mitigate these issues is the use of reflection, which refines responses through an iterative process. However, while promising, reflection heavily relies on high-quality external feedback and requires iterative multi-agent inference processes, thus hindering its practical application. In this paper, we propose Meta-Reflection, a novel feedback-free reflection mechanism that necessitates only a single inference pass without external feedback. Motivated by the human ability to remember and retrieve reflections from past experiences when encountering similar problems, Meta-Reflection integrates reflective insights into a codebook, allowing the historical insights to be stored, retrieved, and used to guide LLMs in problem-solving. To thoroughly investigate and evaluate the practicality of Meta-Reflection in real-world scenarios, we introduce an industrial e-commerce benchmark named E-commerce Customer Intent Detection (ECID). Extensive experiments conducted on both public datasets and the ECID benchmark highlight the effectiveness and efficiency of our proposed approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。