arXiv:2606.08077cs.CL2026-06被引 1

用支持向量思想让自动生成的评分标准更精准区分相似回答。

Support Vector Rubrics: Closing the Gap Between Self-Generated and Human Rubrics

论文配图:Support Vector Rubrics: Closing the Gap Between Self-Generated and Human Rubrics
图 1 · 摘自论文原文
  • 将评分标准构建转化为偏好数据上的最大间隔边界学习
  • 在RubricBench上将与人工标准差距从24.1降至0.3
  • 可跨评判者迁移,无需重新训练

基于评分标准的评估是衡量大语言模型输出质量的有前景方法,但自动生成的评分标准在复杂样本上仍落后于人工标注标准。我们指出这种差异源于目标不匹配:自生成标准描述优质回答,而有效标准需能区分相近答案。为此,提出SVR(支持向量评分标准)框架,将评分标准构建重构为基于偏好数据的最大间隔边界学习。SVR从偏好对中挖掘对比特征形成评分标准库,联合学习提示条件选择器与全局评分权重,并通过支持对选取和对抗性难负样本探测迭代优化标准库。推理时,仅需输入提示,SVR从库中检索最优评分标准并打分。在RubricBench上,SVR将与人工参考标准的差距从24.1降至0.3,优于强基线;标准库可在不同评判者间迁移,无需重训。在RewardBench 1&2、RM-Bench上,表现媲美专用奖励模型,展现更广奖励建模能力。边界定义型评分标准为缩小大模型评估中的判别差距提供了原则性路径。

原文摘要 · Abstract (English)

Rubric-based evaluation is a promising paradigm for judging large language model (LLM) outputs, yet self-generated rubrics lag human-annotated criteria on hard instances. We argue this discriminative gap reflects an objective mismatch: self-generated rubrics describe good responses, whereas effective criteria must discriminate between close candidates. To close this gap, we introduce SVR (Support Vector Rubrics), a framework that recasts rubric construction as max-margin boundary learning over preference data. SVR mines contrastive features from preference pairs into a rubric bank, learns a prompt-conditioned selector together with global rubric weights, and iteratively refines the bank through support-pair selection and adversarial probing of hard negatives. At inference, given only the prompt, SVR retrieves the top-rubrics from the bank and scores responses. On RubricBench, SVR narrows the gap to human reference rubrics from 24.1 to 0.3 points and outperforms strong self-rubric and judge baselines, and the learned bank transfers across judges without retraining. On RewardBench 1&2, and RM-Bench, it remains competitive with dedicated reward models, demonstrating broader reward modeling capability. Overall, boundary-defining rubrics offer a principled route to closing the discriminative gap in LLM evaluation.

大模型评估评分标准偏好学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。