模型评估不能代表实际部署中的对齐效果,需从系统层面验证。
Deployment-Relevant Alignment Cannot Be Inferred from Model-Level Evaluation Alone

- 区分模型、响应、交互和部署四个层级的对齐证据
- 16个基准均缺乏用户验证支持,且支架效果因模型而异
- 适合关注真实场景对齐的开发者与研究者
机器学习对齐评估主要依赖模型级指标,如事实性、指令遵循或成对偏好评分。本文指出,部署相关的对齐无法仅通过模型级评估推断。对齐证据应对应其收集层级:模型、响应、交互或部署。两项研究支持该观点:一是对11个对齐基准的结构化审计扩展至16个,采用八维评分体系(Cohen's kappa = 0.87),发现所有基准均缺乏用户可见的验证支持,过程可引导性几乎缺失;二是对三个前沿模型在4种支架下进行盲测,180条对话显示同一支架使某模型验证支持达上限,另一模型则无变化,证明支架有效性具有模型依赖性。因此,必须推进系统级评估:建立对齐画像、固定支架协议以实现可比交互评估,并使用报告模板明确评估证据与部署主张间的推断距离。
原文摘要 · Abstract (English)
Alignment evaluation in machine learning has largely become evaluation of models. Influential benchmarks score model outputs under fixed inputs, such as truthfulness, instruction following, or pairwise preference, and these scores are often used to support claims about deployed alignment. This paper argues that deployment-relevant alignment cannot be inferred from model-level evaluation alone. Alignment claims should instead be indexed to the level at which evidence is collected: model-level, response-level, interaction-level, or deployment-level. Two studies support this position. First, a structured audit of eleven alignment benchmarks, extended to a sixteen-benchmark corpus, dual-coded against an eight-dimension rubric with Cohen's kappa = 0.87, finds that user-facing verification support is absent across every benchmark examined, while process steerability is nearly absent. The few interactional benchmarks identified, including tau-bench, CURATe, Rifts, and Common Ground, remain fragmented in coverage, and benchmark construction rather than data source determines what is measured. Second, a blinded cross-model stress test using 180 transcripts across three frontier models and four scaffolds finds that the same verification scaffold raises one model's verification support to ceiling while leaving another categorically unchanged. This shows that scaffold efficacy is model-dependent and that the gap identified by the audit cannot be closed at the model level alone. We propose a system-level evaluation agenda: alignment profiles instead of single scores, fixed-scaffolding protocols for comparable interactional evaluation, and reporting templates that make the inferential distance between evaluation evidence and deployment claims explicit.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。