LLM评分受历史分数影响,导致评估结果偏移,需警惕。
Anchoring Bias in LLM-as-a-Judge Systems: Prior Scores Compromise Evaluation Independence

- 引入历史评分作为上下文元数据,会系统性锚定后续评分
- 7/8模型在19.2万次评估中评分偏移显著,效应量达0.71
- 即使提示忽略历史分,偏差仍存在,需针对性设计缓解策略
大语言模型(LLMs)越来越多地用于生成内容的评估,形成LLM-as-a-Judge范式。这些系统在生产流水线中评分、过滤内容并控制迭代优化,通常假设每次判断独立。我们通过三种提示条件测试该假设:无元数据、修订语境、含修订、尝试次数和先前评分字段的锚定元数据。结果显示,即使仅作为上下文信息,先前评分也会锚定判断,使评分系统性向其值偏移。在192,000次尝试评估(185,271次成功)中,8个被评估模型中有7个在20个固定文本上的总锚定元数据效应,其95%任务分层置信区间低于零。Cohen's $d$(标准化差异度量)绝对值达0.71。对选定模型-任务探针进行词元级分析显示阈值响应模式:引入锚定元数据会显著重分布输出评分概率,而改变锚定值在测试范围内则引发较小变化。在具有人工标注真实标签的行业分类数据上,锚定元数据阻断了48%的错误修正,并将10.18%的正确判断错误归类,表明该偏差延伸至分类决策。无论采用思维链或元数据忽略提示,总效应均未降低,但提示在行业实验中提升了配对准确率。可靠的LLM评估依赖精细的上下文设计,而非默认公正性。有效缓解措施必须针对特定模型、任务或领域验证。
原文摘要 · Abstract (English)
Large language models (LLMs) increasingly assess generated content, giving rise to the LLM-as-a-Judge paradigm. These systems now score outputs, filter content, and gate iterative refinement in production pipelines, where each judgment is often assumed to be independent of earlier evaluations. We test this assumption using three prompt conditions: no metadata, revision framing, and anchored metadata containing revision, attempt, and prior-score fields. We show that prior scores, even when included only as context metadata, anchor judgments and systematically shift ratings toward their values. Across 192,000 attempted evaluations (185,271 successful), seven out of the eight evaluated models have 95% task-stratified bootstrap intervals below zero for the total anchored-metadata effect on 20 fixed texts. Cohen's $d$, a standardized measure of the difference between score distributions, reaches an absolute value of 0.71. Token-level analysis of selected model-task probes suggests a threshold-like response pattern: introducing anchored metadata produces a marked redistribution of output-score probabilities, while changing the anchor value within the tested below-threshold range produces comparatively little additional variation. On categorical industry data with human-labeled ground truth, anchored metadata blocks 48% of error corrections and flips 10.18% of correct judgments toward an assigned wrong label, demonstrating the bias extends beyond numerical scoring to categorical decisions. Neither Chain-of-Thought nor a metadata-disregard warning reduces the total effect, although the warning improves the paired accuracy effect relative to baseline in the industry experiment. Reliable LLM evaluation demands careful context engineering rather than an assumption of impartiality. Effective mitigation must be validated for the intended model and task or domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。