arXiv:2604.25200cs.CRcs.AI2026-04

用可信执行环境让AI评资助项目可审计,又不泄露模型和评分逻辑。

Making AI-Assisted Grant Evaluation Auditable without Exposing the Model

  • 通过远程证明机制,验证AI评估所用模型、评分标准和输入格式。
  • 生成带签名的时间戳记录包,包含申请哈希与评估结果的完整链路。
  • 适合需要透明又保密的政府资助评审场景,防止恶意诱导攻击。

公共机构正考虑将大语言模型(LLMs)作为资助项目评审的决策辅助工具。这带来一个治理难题:模型与评分标准不应暴露,以免申请人针对性优化,但评审过程又必须可审计、可申诉、可问责。我们提出一种基于可信执行环境(TEE)的架构,通过远程证明实现平衡。该架构允许外部验证者检查使用了哪个模型、评分规则、提示模板和输入表示,而无需向申请人或基础设施操作员披露模型权重、专有评分逻辑或中间推理过程。核心成果是经过认证的评估包:一个带有签名和时间戳的记录,关联原始提交哈希、规范输入哈希、模型与评分规则的测量值及评估输出。论文还考虑了特定风险——申请人控制的文档可能包含隐藏或间接指令以影响LLM评价。为此,我们引入规范化与净化层,对文档表示进行标准化,并在推理前记录可疑转换。该设计与保密AI推理、可验证AI审计、零知识机器学习、算法问责及AI辅助同行评审相对比。结论明确:远程证明并不保证评估公平或科学正确,但能使评审过程的部分环节对外可验证。

原文摘要 · Abstract (English)

Public agencies are beginning to consider large language models (LLMs) as decision-support tools for grant evaluation. This creates a practical governance problem: the model and scoring rubric should not be exposed in a way that allows applicants to optimize against them, yet the evaluation process must remain auditable, contestable, and accountable. We propose a TEE-based architecture that helps reconcile these requirements through remote attestation. The architecture allows an external verifier to check which model, rubric, prompt template, and input representation were used, without exposing model weights, proprietary scoring logic, or intermediate reasoning to applicants or infrastructure operators. The main artifact is an attested evaluation bundle: a signed, timestamped record linking the original submission hash, the canonical input hash, the model-and-rubric measurement, and the evaluation output. The paper also considers a scenario-specific prompt injection risk: applicant-controlled documents may contain hidden or indirect instructions intended to influence the LLM evaluator. We therefore include a canonicalization and sanitization layer that normalizes document representations and records suspicious transformations before inference. We position the design relative to confidential AI inference, attestable AI audits, zero-knowledge machine learning, algorithmic accountability, and AI-assisted peer review. The resulting claim is deliberately narrow: remote attestation does not prove that an evaluation is fair or scientifically correct, but it can make part of the evaluation process externally verifiable.

AI评审可信计算可审计性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。