让大模型通过生成多个回答并合并优化,提升答案质量。
LLMs Can Generate a Better Answer by Aggregating Their Own Responses
- 让模型生成多个回答后,用自身生成能力合成更优解。
- 在数学推理、代码生成等任务上显著提升准确率。
- 无需模型判断对错,适合开放性问题,通用性强。
大型语言模型(LLMs)在各类任务中表现出色,但在复杂问题上仍需额外提示技巧。尽管自校正和响应选择等方法被广泛采用,但当依赖模型自身提供反馈或评估标准时,效果不佳。我们认为这源于模型后训练缺乏判别性判断的显式监督。本文提出生成式自聚合(GSA),一种无需模型具备判别能力的新提示方法:先从模型采样多个多样回答,再基于这些样本上下文合成新答案。与需要可验证标记以进行多数投票的自一致性(SC)不同,GSA更具普适性,适用于开放式任务。实证表明,该方法在数学推理、知识问答及代码生成、对话生成等任务中均有效提升答案质量。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have shown remarkable capabilities across tasks, yet they often require additional prompting techniques when facing complex problems. While approaches like self-correction and response selection have emerged as popular solutions, recent studies have shown these methods perform poorly when relying on the LLM itself to provide feedback or selection criteria. We argue this limitation stems from the fact that common LLM post-training procedures lack explicit supervision for discriminative judgment tasks. In this paper, we propose Generative Self-Aggregation (GSA), a novel prompting method that improves answer quality without requiring the model's discriminative capabilities. GSA first samples multiple diverse responses from the LLM, then aggregates them to obtain an improved solution. Unlike previous approaches, our method does not require the LLM to correct errors or compare response quality; instead, it leverages the model's generative abilities to synthesize a new response based on the context of multiple samples. While GSA shares similarities with the self-consistency (SC) approach for response aggregation, SC requires specific verifiable tokens to enable majority voting. In contrast, our approach is more general and can be applied to open-ended tasks. Empirical evaluation demonstrates that GSA effectively improves response quality across various tasks, including mathematical reasoning, knowledge-based problems, and open-ended generation tasks such as code synthesis and conversational responses.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。