arXiv:2607.07436cs.AIcs.CL2026-07被引 2

LLM裁判偏见会悄悄关闭技能淘汰机制,导致系统自我进化失效。

The Blind Curator: How a Biased Judge Silently Disables Skill Retirement in Self-Evolving Agents

论文配图:The Blind Curator: How a Biased Judge Silently Disables Skill Retirement in Self-Evolving Agents
图 1 · 摘自论文原文
  • 用错误奖励分析和代码验证测试,发现偏见使技能淘汰机制失效
  • 当误通过率超过0.45时,淘汰机制彻底瘫痪,数据再多也无用
  • 该问题隐蔽无声,适合关注AI安全与评估可靠性的研究者阅读

自演化智能体通过观察技能失败来淘汰劣质技能,但若评判者无法察觉失败会怎样?技能淘汰是防止知识库退化至无技能状态的结构约束,其有效性依赖于无偏奖励,而参考无关任务中的大语言模型裁判恰恰存在偏见。本文证明,偏见并非仅引入噪声,而是‘悄然关闭评审员’。通过受损奖励分析与无参考报告生成测试平台上的行为实验,注入确定性奖励后的扰动以隔离因果路径。对称噪声不影响淘汰,但‘误通过’偏见(失败被误判为成功)在0.45的误通过率阈值处导致基于贡献的淘汰机制崩溃,且无法通过增加数据量弥补。分离真实淘汰与误判引发的频繁更换,证实此机制失效具有普适性,仅在极低误通过率、类似验证器的裁判下幸免。下游效果则取决于评估范式:仅当同一偏见同时抑制技能合成时,评估质量才下降;否则仍保持稳定,表明失效的评审员‘无声’,不体现在聚合指标中。贡献在于揭示一种行为安全缺陷而非性能提升。最后提出低成本缺陷注入审计方法,可在部署前判断裁判是否处于阈值之上。

原文摘要 · Abstract (English)

A self-evolving agent retires its bad skills by watching them fail, so what happens when the judge cannot see the failures? Skill retirement is the structural constraint that keeps a growing library from drifting below the no-skill baseline, but its guarantee assumes an unbiased reward, which is false for the LLM judges that reference-free tasks require. We show that a biased judge does not merely add noise; it \emph{silently switches off the curator}. We make this precise with a corrupted-reward analysis, then a behavioral study on a reference-free report-writing testbed with a code-generation cross-check, injecting corruption on top of a deterministic reward to isolate the causal channel. Symmetric noise leaves retirement intact, but \emph{false-pass} bias (failures slipping through as passes) disables contribution-based retirement past a sharp threshold (here a false-pass rate of $0.45$) that no amount of data can cross. Separating genuine retirement from cap-eviction churn shows this \emph{mechanism} failure is universal, holding across domains and failure rates and sparing only near-zero-false-pass, verifier-like graders. The downstream \emph{outcome}, though, is regime-dependent: eval quality degrades only where the same corruption also starves skill synthesis, and otherwise holds steady, so the disabled curator is \emph{silent}, surfacing in no aggregate metric. The contribution is a behavioral safety result, not a performance one. A cheap defect-injection audit then tells an operator, before deployment, which side of the threshold their judge occupies.

AI安全自演化评估偏见技能淘汰

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。