提出更高效的自洽推理方法,用更少样本达到更好效果。
Optimal Self-Consistency for Efficient Reasoning with Large Language Models
- 动态分配推理样本,按需分配资源提升效率
- 在多个数据集上实现4.8倍样本节省,性能超越现有方法
- 无需调参、支持批量处理,适配各类推理场景
自洽(Self-consistency, SC)是一种广泛用于链式思维推理的测试时推断技术,通过生成多个响应并选择最频繁的答案来提升性能。该过程可视为多数投票或经验众数估计。尽管有效,但传统方法在大规模数据集上计算开销巨大,且缺乏统一的理论分析框架。本文首次系统分析了自洽及其变体的缩放行为,基于众数估计与投票理论,推导出跨数据集的幂律缩放规律,并比较了固定分配与动态分配采样策略的样本效率。在此基础上,提出Blend-ASC——一种动态分配样本的新方法,在平均仅需原方法4.8倍样本量的情况下,超越固定与动态分配基线,实现最优样本效率。相比现有变体,Blend-ASC无需超参数调节、支持批处理,可适配任意样本预算,适用于各类自洽推理任务。
原文摘要 · Abstract (English)
Self-consistency (SC) is a widely used test-time inference technique for improving performance in chain-of-thought reasoning. It consists of generating multiple responses, or ``samples", from a large language model (LLM) and selecting the most frequent answer. This procedure can naturally be viewed as a majority vote or empirical mode estimation. Despite its effectiveness, self-consistency is prohibitively expensive at scale when naively applied to datasets, and it lacks a unified theoretical understanding of sample efficiency and scaling behavior. In this paper, we provide the first comprehensive analysis of SC's scaling behavior and its variants, drawing on mode estimation and voting theory. We derive and empirically validate power law scaling for self-consistency across datasets, and analyze the sample efficiency for fixed-allocation and dynamic-allocation sampling schemes. From these insights, we introduce Blend-ASC, a novel variant of self-consistency that dynamically allocates samples to questions during inference, achieving state-of-the-art sample efficiency. Our approach uses 4.8 times fewer samples than vanilla SC on average, outperforming both fixed- and dynamic-allocation SC baselines, thereby demonstrating the superiority of our approach in terms of efficiency. In contrast to existing variants, we note that Blend-ASC is hyperparameter-free, supports batching, and can fit any budget of samples, ensuring it can be easily applied to any self-consistency application.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。