arXiv:2509.06326cs.CRcs.AI2025-09中稿 · DAC 2026被引 2

为百亿参数本地大模型提供高效可信验证,防止模型被篡改或盗用。

AttestLLM: Efficient Attestation Framework for Billion-scale On-device LLMs

  • 通过软硬件协同设计,在模型激活值中嵌入鲁棒水印。
  • 在可信执行环境中实现低延迟验证,保持推理速度不下降。
  • 可抵御模型替换与伪造攻击,适合设备厂商保护知识产权。

随着本地部署的大语言模型(如 Apple 的本地智能)广泛应用,减少网络依赖、提升隐私保护和响应速度成为关键。然而,验证本地运行模型的合法性变得愈发重要。现有验证技术难以适用于百亿参数级大模型,在时间和内存效率上均面临挑战,且无法应对大模型时代的新威胁。本文提出 AttestLLM,首个针对设备级大模型的可信验证框架,通过算法-软件-硬件协同设计,在大模型组件的激活分布中嵌入强鲁棒性水印签名,保护设备厂商的硬件知识产权。同时,优化可信执行环境(TEE)中的验证协议,实现高效验证而不降低推理吞吐量。在 Llama、Qwen、Phi 系列模型的本地应用场景下,实证表明 AttestLLM 具备高可靠性、高保真度和高效率。此外,该框架能有效防范模型替换与伪造攻击。

原文摘要 · Abstract (English)

As on-device LLMs(e.g., Apple on-device Intelligence) are widely adopted to reduce network dependency, improve privacy, and enhance responsiveness, verifying the legitimacy of models running on local devices becomes critical. Existing attestation techniques are not suitable for billion-parameter Large Language Models (LLMs), struggling to remain both time- and memory-efficient while addressing emerging threats in the LLM era. In this paper, we present AttestLLM, the first-of-its-kind attestation framework to protect the hardware-level intellectual property (IP) of device vendors by ensuring that only authorized LLMs can execute on target platforms. AttestLLM leverages an algorithm/software/hardware co-design approach to embed robust watermarking signatures onto the activation distributions of LLM building blocks. It also optimizes the attestation protocol within the Trusted Execution Environment (TEE), providing efficient verification without compromising inference throughput. Extensive proof-of-concept evaluations on LLMs from Llama, Qwen, and Phi families for on-device use cases demonstrate AttestLLM's attestation reliability, fidelity, and efficiency. Furthermore, AttestLLM enforces model legitimacy and exhibits resilience against model replacement and forgery attacks.

模型验证本地大模型水印技术可信执行

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。