arXiv:2606.21045cs.CRcs.LG2026-06

用梯度信号验证外包训练是否真实执行,防止作弊且开销极低。

OVIG: Optimistic Verification of AI Training Integrity via Gradient Signals

论文配图:OVIG: Optimistic Verification of AI Training Integrity via Gradient Signals
图 1 · 摘自论文原文
  • 基于真实异构重跑数据构建梯度差异边界,动态检测异常
  • 在语言、视觉、扩散模型上均实现0%误报率,抗多种攻击
  • 每2000步采样一次,存储和传输量减少1996倍,系统开销仅1.143倍

AI快速发展推动领域特定后训练需求增长,但加速器成本与专业化使许多模型所有者选择外包训练。外包虽降低门槛,却产生训练完整性缺口:所有者仅获检查点、日志和聚合指标,无法验证训练过程是否真实执行。不可信提供者可能为节省计算或植入安全风险而偏离原轨迹。审计困难源于异构加速器上的浮点执行存在良性数值漂移,难以区分正常差异与完整性违规。现有方法或粒度太粗,或成本过高不具可扩展性。本文提出OVIG——一种乐观验证框架,通过诚实异构重跑校准的梯度差异经验边界,审计外包后训练。它检查开放区间是否超出边界,并结合乐观采样与步长参数 $s$,将训练划分为步长对齐区间,仅保留区间端点证据。在快捷训练攻击与目标操纵攻击下,OVIG在语言、视觉和扩散任务中均保持0%误报率(ASR)。在Qwen3上,将步长从 $s=1$ 提升至 $s=2000$,链外存储与证据传输减少1996倍,系统总开销仅增加1.143倍。结果表明,OVIG可在异构执行下为外包后训练提供实用完整性保障。

原文摘要 · Abstract (English)

The rapid growth of AI has increased the demand for domain-specific post-training, while the cost and specialization of accelerator infrastructure push many model owners to outsource this process. Outsourced training lowers operational barriers, but creates a training-integrity gap: the owner receives a checkpoint, logs, and aggregate metrics without direct evidence that the declared training trajectory was faithfully executed. An untrusted provider may have incentives to deviate from that trajectory, either to save computation or to introduce targeted security risks. Auditing such deviations is difficult because floating-point execution on heterogeneous accelerators introduces benign numerical drift, making it hard to distinguish honest replay differences from integrity violations. Existing verification methods either observe training at too coarse a granularity or impose costs and deployment constraints that are impractical at scale. We present OVIG, an optimistic verification framework that audits outsourced post-training using an empirical boundary on gradient differences calibrated from honest heterogeneous replays. OVIG checks opened intervals against this boundary and combines optimistic sampling with a stride parameter $s$, which partitions training into stride-aligned intervals and retains only interval-endpoint evidence. Across shortcut training attacks and targeted manipulation attacks, OVIG maintains $0\%$ ASR on language, vision, and diffusion workloads. On Qwen3, increasing the stride from $s=1$ to $s=2000$ reduces off-chain storage and evidence transmission by $1996\times$ while preserving $0\%$ ASR; at this setting, OVIG incurs only $1.143\times$ total system overhead relative to training without verification. These results show that OVIG provides a practical integrity layer for outsourced AI post-training under heterogeneous execution.

模型安全外包验证梯度检测可信训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。