将大模型安全验证直接部署在GPU上,提升效率并统一跨平台保护
Scalable GPU-Based Integrity Verification for Large Machine Learning Models
- 在GPU上原生执行加密验证,利用专用计算单元加速
- 验证速度与100GB以上大模型训练同步,无性能瓶颈
- 支持多厂商GPU,适合企业级大规模模型部署
我们提出一种安全框架,通过在CPU和GPU平台上标准化完整性保护,显著降低验证开销。该方法将完整性验证直接与大型ML模型的执行共置在GPU加速器上,解决了大型ML工作负载通常在GPU上运行,而传统安全验证依赖独立CPU进程的根本矛盾,既实现即时性能提升,也保障长期架构一致性。通过利用GPU上的专用计算单元(如Intel Arc的XMX单元、NVIDIA的Tensor Cores)原生执行密码学操作,本方案消除了传统基于CPU的验证系统在处理大型模型时可能遇到的架构瓶颈。该方法借助支撑机器学习任务的高内存带宽和并行处理能力,确保完整性检查能与超过100GB的大型模型执行保持同步。此框架建立了一个跨不同GPU供应商和硬件配置的一致性验证机制,并通过预判未来可信执行环境与GPU之间建立安全通道的能力,提供一种硬件无关的基础,使企业团队可不受底层CPU和GPU基础设施限制地部署。
原文摘要 · Abstract (English)
We present a security framework that strengthens distributed machine learning by standardizing integrity protections across CPU and GPU platforms and significantly reducing verification overheads. Our approach co-locates integrity verification directly with large ML model execution on GPU accelerators, resolving the fundamental mismatch between how large ML workloads typically run (primarily on GPUs) and how security verifications traditionally operate (on separate CPU-based processes), delivering both immediate performance benefits and long-term architectural consistency. By performing cryptographic operations natively on GPUs using dedicated compute units (e.g., Intel Arc's XMX units, NVIDIA's Tensor Cores), our solution eliminates the potential architectural bottlenecks that could plague traditional CPU-based verification systems when dealing with large models. This approach leverages the same GPU-based high-memory bandwidth and parallel processing primitives that power ML workloads ensuring integrity checks keep pace with model execution even for massive models exceeding 100GB. This framework establishes a common integrity verification mechanism that works consistently across different GPU vendors and hardware configurations. By anticipating future capabilities for creating secure channels between trusted execution environments and GPU accelerators, we provide a hardware-agnostic foundation that enterprise teams can deploy regardless of their underlying CPU and GPU infrastructures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。