发现大模型自修正流程中,不同阶段对算力需求差异显著。
Asymmetric Capacity Allocation in Self-Refinement Pipelines
- 分阶段研究模型规模影响,发现生成与修订需大模型,批评可小
- 小批评模型仍优于无批评,但过小修订模型会拖累整体性能
- 适合优化大模型系统资源分配的研究者和工程团队
自修正通常由生成、批判和修订三阶段构成,是提升大语言模型生成质量的核心机制。尽管各阶段认知需求不同,现有方法常忽略模型规模的影响,导致资源浪费。本文首次在5个跨领域基准上,使用Qwen3的6种规模和Gemma 3的4种规模进行分阶段模型规模研究。结果表明:更大的生成器与修订器通常提升性能,而过小的修订器反而损害表现;批判阶段对模型规模不敏感,即使小型批判器也优于无批判。研究揭示模型能力不应均等分配,各阶段具不同缩放特性,为设计更高效的多阶段语言模型系统提供实用指导。
原文摘要 · Abstract (English)
Self-refinement, typically structured as generation, critique, and revision, is a widely adopted paradigm for improving LLM generation and serves as a core mechanism in many LLM agents. While the three stages involve different cognitive demands, most existing approaches conveniently treat the model size as an implementation detail rather than a subject of study, which may lead to a waste of resources. Little work has systematically examined how model size affects each stage or whether effective self-refinement requires equally capable models for generation, critique, and revision. We present the first stage-wise model size study of the self-refinement pipeline on 5 benchmarks from different domains using 6 model sizes of Qwen3 and 4 model sizes of Gemma 3. We conclude that larger generators and refiners generally improve the pipeline, whereas an undersized refiner can even harm performance. Second, performance is highly insensitive to the size of the critic, although including even a small critic consistently outperforms omitting critique altogether. Our findings demonstrate that model capacity should not be allocated uniformly across self-refinement pipelines. Instead, different stages exhibit distinct size scaling characteristics, providing practical guidance for designing more computationally efficient multi-stage language model systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。