根据输入敏感度动态分配计算任务,兼顾隐私与效率。
PRISM: Privacy-Aware Routing for Adaptive Cloud-Edge LLM Inference via Semantic Sketch Collaboration
- 按实体敏感度决定云边协同或本地处理
- 能耗和延迟降至基线方法的40%-50%
- 适合对隐私要求高的实时语音/文本应用
大型语言模型(LLMs)在自然语言理解与生成方面表现优异,但在云端部署时面临高通信开销与隐私风险,而在边缘设备上又受限于算力与内存。云边推理作为一种提升隐私保护的范式,通过将敏感计算保留在本地设备实现。然而,现有方法采用统一的隐私保护策略,未考虑输入内容敏感度,导致非敏感词也遭受不必要的扰动,降低输出质量。为此,我们提出隐私感知路由框架PRISM,实现上下文感知的隐私-性能平衡。PRISM分为四阶段:(1)边缘设备评估实体级敏感度;(2)边缘侧软门控模块选择执行模式——云、边或协作;(3)协作路径下,基于实体风险应用自适应双层局部差分隐私;(4)云端大模型生成语义草图,由边缘侧小语言模型(SLM)结合本地上下文进行细化。实验表明,PRISM在多种场景下均实现更优的隐私-效用权衡,能耗与延迟降至均匀和选择性LDP基线方法的40%-50%,且在强隐私约束下仍保持高质量输出。验证涵盖真实提示、实测能耗及异构云边模型部署。
原文摘要 · Abstract (English)
Large Language Models (LLMs) demonstrate impressive capabilities in natural language understanding and generation, but incur high communication overhead and privacy risks in cloud deployments, while facing compute and memory constraints when confined to edge devices. Cloud-edge inference has emerged as a promising paradigm for improving privacy in LLM services by retaining sensitive computations on local devices. However, existing cloud-edge inference approaches apply uniform privacy protection without considering input sensitivity, resulting in unnecessary perturbation and degraded utility even for non-sensitive tokens. To address this limitation, we propose Privacy-aware Routing for Inference with Semantic Modulation (PRISM), a context-aware framework that dynamically balances privacy and inference quality. PRISM executes in four stages: (1) the edge device profiles entity-level sensitivity; (2) a soft gating module on the edge selects an execution mode - cloud, edge, or collaboration; (3) for collaborative paths, the edge applies adaptive two-layer local differential privacy based on entity risks; and (4) the cloud LLM generates a semantic sketch from the perturbed prompt, which is then refined by the edge-side small language model (SLM) using local context. Our results show that PRISM consistently achieves superior privacy-utility trade-offs across various scenarios, reducing energy consumption and latency to 40-50% of baseline methods such as Uniform and Selective LDP, while maintaining high output quality under strong privacy constraints. These findings are validated through comprehensive evaluations involving realistic prompts, actual energy measurements, and heterogeneous cloud-edge model deployments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。