arXiv:2608.29856cs.CL2026-08

无需人工标注,自动生成可扩展的评分标准,提升大模型评估一致性。

GenRubric: Self-Evolving Rubric Generation for Scalable LLM Evaluation

论文配图:GenRubric: Self-Evolving Rubric Generation for Scalable LLM Evaluation
图 1 · 摘自论文原文
  • 基于自洽性原理,从无标注查询中迭代优化评分标准。
  • 在多个领域测试中,生成标准与专家标准一致率显著提升。
  • 适合需要大规模、定制化评估的AI研究与应用团队。

大语言模型被越来越多地用作开放式任务的可扩展评估器。然而,许多语言模型评阅者在评分时会生成特定于查询的评判标准,导致评估要求不明确且难以审计。虽然特定查询的评分标准能使要求更清晰,但专家制定的标准成本高,现有自动化方法通常依赖推理时微调或外部监督。我们提出GenRubric,一种无需额外人工标注即可在自演化过程中改进评分标准生成的自进化框架。该方法基于评分标准诱导的自洽性:对同一查询独立采样的多个评分标准提供其潜在评估需求的部分视角,一个全面的评分标准应能诱导出在这些互补视角下均表现良好的回应。我们通过强化学习实现此原则,结合跨标准全面性信号,以及组级和准则级奖励以提升评分标准质量。我们在4B、8B和14B规模上训练了GenRubric模型,覆盖多个领域。在人类标注的评分标准基准上的实验表明,自演化显著提升了由生成标准所诱导的评估与专家标准之间的吻合度。该改进还能推广至未见领域,展示了自进化评分标准生成在可扩展、查询特定的大模型评估中的潜力。代码与模型已公开于https://github.com/foggpoy/GenRubric。

原文摘要 · Abstract (English)

Large language models are increasingly used as scalable evaluators for open-ended tasks. However, many LLM judges derive query-specific criteria during scoring, leaving the evaluation requirements insufficiently specified and their coverage difficult to audit. Query-specific rubrics make these requirements explicit, but expert-written rubrics are costly to construct, while existing automatic methods typically rely on inference-time refinement or external supervision. We introduce GenRubric, a self-evolving framework that improves rubric generation from unlabeled queries without requiring additional human annotations during self-evolution. Our approach is based on rubric-induced self-consistency: independently sampled rubrics for the same query provide partial views of its latent evaluation requirements, and a comprehensive rubric should induce a response that generalizes across these complementary evaluation views. We implement this principle through reinforcement learning, combining a cross-rubric comprehensiveness signal with group-level and criterion-level rewards for rubric quality. We train GenRubric models at 4B, 8B, and 14B scales across multiple domains. Experiments on human-annotated rubric benchmarks show that self-evolution improves the agreement between evaluations induced by generated rubrics and those induced by expert-written rubrics. The improvements further generalize to held-out domains, demonstrating the potential of self-evolving rubric generation for scalable and query-specific LLM evaluation. Code and models are publicly available at https://github.com/foggpoy/GenRubric.

大模型评估自进化评分标准强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。