arXiv:2604.23205cs.CRcs.AR2026-04

Tessera实现边缘设备中模型权重的近线速安全解密,防窃取且不降速。

Tessera: Secure, Near-Line-Rate Weight Streaming for UMA Edge Accelerators

论文配图:Tessera: Secure, Near-Line-Rate Weight Streaming for UMA Edge Accelerators
图 1 · 摘自论文原文
  • 在共享内存架构中,通过缓存行粒度并行解密,拦截64字节数据流
  • 实测带宽达理论值98.4%,比页级加密高32倍性能,无永久内存占用
  • 适合部署私有模型的边缘加速器,防御物理窃取与恶意攻击

在统一内存架构(UMA)系统中,主机CPU与神经处理单元(NPU)共享物理内存,导致模型权重以明文形式暴露于被攻陷的操作系统内核。现有防护手段受限:可信执行环境需永久预留内存区域,全内存加密仅支持页级粒度,迫使系统每次加载4 KB页面以获取子页张量块,严重损耗带宽。本文提出Tessera,一种面向UMA边缘加速器的内联、缓存行粒度权重解密参考架构。该设计拦截64字节AXI突发传输,在读取内存的同时并行计算AES-256-CTR密钥流,将明文直接流式注入隔离的NPU SRAM,仅在活跃张量块期间保留瞬时内存足迹,无需永久内存预留。跨三个不同SoC平台的测量表明,这种并行化使加密延迟被标准内存读取时间掩盖,即使在最坏时序条件下仍成立。因此,Tessera预计可达到理论内存带宽的98.4%(仅1.6%开销)。对于标准视觉与语言模型,页级加密最高带来32倍带宽惩罚,而Tessera对所有层结构均保持1x最优占用。此外,Tessera有效消除多种针对UMA的攻击向量——包括物理内存提取、恶意DMA和计算劫持,并形式化防止稀疏张量中的明文泄露。

原文摘要 · Abstract (English)

Deploying proprietary Deep Neural Networks (DNNs) on commodity edge devices demands hardware-backed Digital Rights Management (DRM) capable of withstanding both software-level and physical adversaries. In Unified Memory Architecture (UMA) systems, the host CPU and Neural Processing Unit (NPU) share physical DRAM, leaving plaintext model weights directly readable by a compromised OS kernel. Existing defenses fail in this constrained setting: trusted execution environments monopolize scarce memory with permanently reserved regions, while full-memory encryption operates at page granularity. This forces the system to fetch massive 4 KB memory pages for sub-page tensor tiles, severely crippling bandwidth. We present Tessera, a reference architecture for inline, cache-line granularity weight decryption on UMA edge accelerators. The design intercepts 64-byte AXI bursts, computing AES-256-CTR keystreams in parallel with DRAM fetches. This streams plaintext directly into isolated NPU SRAM, creating a transient memory footprint confined to the active tile and eliminating the need for permanent memory carve-outs. Measurements across three distinct SoC platforms demonstrate that this parallelization hides cryptographic latency behind standard DRAM fetch times, a condition that holds even under worst-case timing variations. Consequently, Tessera is projected to achieve 98.4\% of the theoretical memory bandwidth ceiling (a mere 1.6\% overhead). Across standard vision and language models, page-level memory encryption suffers up to a 32x bandwidth penalty, whereas Tessera maintains an optimal 1x footprint for all layer geometries. Finally, Tessera neutralizes major UMA-specific attack vectors -- including physical DRAM extraction, rogue DMA, and compute hijacking -- and formally prevents plaintext leakage across sparse tensors.

边缘计算安全推理内存加密NPU

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。