让两个模型协作生成更优的AI解释,无需额外训练。
Cross-Refine: Improving Natural Language Explanation Generation by Learning in Tandem
- 用生成与批评双模型协同优化解释文本
- 自动与人工评估均显示优于单一模型自反馈
- 适合资源有限场景,且支持中英德多语言
自然语言解释(NLE)对阐明大语言模型(LLM)决策逻辑至关重要。现有方法多依赖LLM生成解释,但如同人类,初始输出未必最优。受人类学习启发,本文提出Cross-Refine:部署两个LLM分别作为生成器和批评者,生成器先输出初版解释,再根据批评者的反馈与建议进行迭代优化。该方法无需监督数据或额外训练。我们在三个NLP任务上,使用三个开源SOTA LLM进行验证,以Self-Refine(Madaan et al., 2023)为基线,结果表明跨模型协作在自动评估与用户研究中均优于自反馈。此外,Cross-Refine在较弱模型上表现良好,而Self-Refine仅在ChatGPT上有效。消融实验证明反馈与建议均关键。我们还在中英文双语数据集上进行了评估。
原文摘要 · Abstract (English)
Natural language explanations (NLEs) are vital for elucidating the reasoning behind large language model (LLM) decisions. Many techniques have been developed to generate NLEs using LLMs. However, like humans, LLMs might not always produce optimal NLEs on first attempt. Inspired by human learning processes, we introduce Cross-Refine, which employs role modeling by deploying two LLMs as generator and critic, respectively. The generator outputs a first NLE and then refines this initial explanation using feedback and suggestions provided by the critic. Cross-Refine does not require any supervised training data or additional training. We validate Cross-Refine across three NLP tasks using three state-of-the-art open-source LLMs through automatic and human evaluation. We select Self-Refine (Madaan et al., 2023) as the baseline, which only utilizes self-feedback to refine the explanations. Our findings from automatic evaluation and a user study indicate that Cross-Refine outperforms Self-Refine. Meanwhile, Cross-Refine can perform effectively with less powerful LLMs, whereas Self-Refine only yields strong results with ChatGPT. Additionally, we conduct an ablation study to assess the importance of feedback and suggestions. Both of them play an important role in refining explanations. We further evaluate Cross-Refine on a bilingual dataset in English and German.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。