通过自对话机制让大模型自我纠错,提升回答准确性。
A Dialectic Pipeline for Improving LLM Robustness
- 让大模型通过自对话反思并修正错误答案
- 在多个数据集上显著优于标准模型和思维链提示
- 无需微调,保持模型通用性,适合实际应用
评估语言模型减少幻觉、提升输出质量的方法对大规模应用至关重要。然而,基于领域数据微调或训练专用验证器的方法需要大量计算资源(许多用户无法负担),且限制了模型的知识范围。本文提出一种辩证式流水线,在不损害大模型泛化能力的前提下,通过自对话机制使其能反思并修正初步错误答案。我们在不同数据集和模型家族上测试了多种流水线设置,所有阶段均结合上下文信息(在典範-RAG设定下),并研究了摘要与过滤策略的影响。结果表明,该方法显著优于标准模型输出,且在所有测试中均超越仅使用思维链提示的方案。
原文摘要 · Abstract (English)
Assessing ways in which Language Models can reduce their hallucinations and improve the outputs' quality is crucial to ensure their large-scale use. However, methods such as fine-tuning on domain-specific data or the training of a separate \textit{ad hoc} verifier require demanding computational resources (not feasible for many user applications) and constrain the models to specific fields of knowledge. In this thesis, we propose a dialectic pipeline that preserves LLMs' generalization abilities while improving the quality of its answer via self-dialogue, enabling it to reflect upon and correct tentative wrong answers. We experimented with different pipeline settings, testing our proposed method on different datasets and on different families of models. All the pipeline stages are enriched with the relevant context (in an oracle-RAG setting) and a study on the impact of its summarization or its filtering is conducted. We find that our proposed dialectic pipeline is able to outperform by significative margins the standard model answers and that it consistently achieves higher performances than Chain-of-Thought only prompting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。