arXiv:2604.12634cs.AIcs.CL2026-04

让小模型学会预判自己能否答好题,该求助时就求助,省算力还提效果。

RPRA: Predicting an LLM-Judge for Efficient but Performant Inference

论文配图:RPRA: Predicting an LLM-Judge for Efficient but Performant Inference
图 1 · 摘自论文原文
  • 小模型通过报告卡或微调,提前预测大模型对答案的评分。
  • 报告卡和微调分别使小模型预测准确率提升55%和52%。
  • 适合资源受限场景下的高效智能系统设计。

大型语言模型在计算效率(如参数量)与输出质量间存在根本权衡,尤其在手机、笔记本等计算资源有限设备上。本文探索预测-回答/行动(PA)和推理-预测-再推理-回答/行动(RPRA)范式,让模型在回应前预测一个LLM评判者对其输出的评分。评估了零样本预测、基于上下文报告卡的预测以及监督微调三种方法。结果表明,大模型(尤其是推理型模型)可零样本准确预测通用LLM评判者;而小模型经微调或使用报告卡后,也能可靠预测。两种方法均显著提升小模型预测准确性,报告卡和微调在各数据集上的平均提升分别达55%和52%。这表明模型可学习识别自身能力边界,为构建更高效、自知的AI系统铺路。

原文摘要 · Abstract (English)

Large language models (LLMs) face a fundamental trade-off between computational efficiency (e.g., number of parameters) and output quality, especially when deployed on computationally limited devices such as phones or laptops. One way to address this challenge is by following the example of humans and have models ask for help when they believe they are incapable of solving a problem on their own; we can overcome this trade-off by allowing smaller models to respond to queries when they believe they can provide good responses, and deferring to larger models when they do not believe they can. To this end, in this paper, we investigate the viability of Predict-Answer/Act (PA) and Reason-Predict-Reason-Answer/Act (RPRA) paradigms where models predict -- prior to responding -- how an LLM judge would score their output. We evaluate three approaches: zero-shot prediction, prediction using an in-context report card, and supervised fine-tuning. Our results show that larger models (particularly reasoning models) perform well when predicting generic LLM judges zero-shot, while smaller models can reliably predict such judges well after being fine-tuned or provided with an in-context report card. Altogether, both approaches can substantially improve the prediction accuracy of smaller models, with report cards and fine-tuning achieving mean improvements of up to 55% and 52% across datasets, respectively. These findings suggest that models can learn to predict their own performance limitations, paving the way for more efficient and self-aware AI systems.

模型效率自知智能推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。