用检索增强生成评分标准,让大模型评估更透明可解释。
RubricRAG: Towards Interpretable and Reliable LLM Evaluation via Domain Knowledge Retrieval for Rubric Generation
- 推理时检索领域知识生成具体评分标准
- 生成的评分标准与人工标准更接近,评估效果更好
- 适合需要透明评估的模型开发与高风险场景
大语言模型常通过自动化评分系统(如LLM-as-judges)进行评估,但这些系统输出单一分数,缺乏解释性,难以指导模型改进。查询特定的评分标准评估能将质量分解为可检查的明确维度,更具透明性。然而,手动设计高质量的查询特定评分标准成本高且不现实。以往方法虽尝试自动生成中间评分标准,但其对人类用户的可解释性和有效性尚不明确。本文在两个评分基准上系统研究发现,现成的LLM生成的评分标准与人工标准偏差较大。为此提出RubricRAG:在推理时从相关查询中检索领域知识以生成实例化评分标准。实验表明,RubricRAG生成的评分标准在与人工标准相似度和下游评估有效性上均有提升。结果揭示了可扩展、可解释评估的挑战与可行路径。
原文摘要 · Abstract (English)
Large language models (LLMs) are increasingly evaluated and sometimes trained using automated graders such as LLM-as-judges that output scalar scores or preferences. While convenient, these approaches are often opaque: a single score rarely explains why an answer is good or bad, which requirements were missed, or how a system should be improved. This lack of interpretability limits their usefulness for model development, dataset curation, and high-stakes deployment. Query-specific rubric-based evaluation offers a more transparent alternative by decomposing quality into explicit, checkable criteria. However, manually designing high-quality, query-specific rubrics is labor-intensive and cognitively demanding and not feasible for deployment. While previous approaches have focused on generating intermediate rubrics for automated downstream evaluation, it is unclear if these rubrics are both interpretable and effective for human users. In this work, we investigate whether LLMs can generate useful, instance-specific rubrics as compared to human-authored rubrics, while also improving effectiveness for identifying good responses. Through our systematic study on two rubric benchmarks, and on multiple few-shot and post-training strategies, we find that off-the-shelf LLMs produce rubrics that are poorly aligned with human-authored ones. We introduce a simple strategy, RubricRAG, which retrieves domain knowledge via rubrics at inference time from related queries. We demonstrate that RubricRAG can generate more interpretable rubrics both for similarity to human-authored rubrics, and for improved downstream evaluation effectiveness. Our results highlight both the challenges and a promising approach of scalable, interpretable evaluation through automated rubric generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。