通过语义转换实现云端大模型交互的隐私保护与效果兼顾
Semantic Encryption: Secure and Effective Interaction with Cloud-based Large Language Models via Semantic Transformation
- 用轻量本地模型将输入转为隐藏敏感信息的语义上下文
- 在多个数据集上优于当前最优方案InferDPT,保持高数据效用
- 适合注重隐私安全且追求实用性的云大模型用户
基于云的大语言模型(CLLMs)日益普及,用户交互中的数据隐私问题日益突出。现有方法多聚焦于加密敏感信息,却常忽视用户输入的逻辑结构,导致数据效用下降、CLLM性能受损。为此,本文提出语义加密(Semantic Encryption, SE)——一种即插即用的框架,兼顾隐私保护与数据效用。SE包含语义编码与解码两部分:编码阶段,轻量本地模型将原始输入转化为保留原意与逻辑结构但隐藏敏感信息的语义上下文;该上下文由CLLM处理并生成响应;解码阶段,通过参考本地存储的原始输入,将响应重构回原语义上下文,保障用户体验。大量实验表明,SE有效保护隐私,不损害数据效用或用户体验,在多个评估指标和数据集上显著优于当前最优方案InferDPT。
原文摘要 · Abstract (English)
The increasing adoption of Cloud-based Large Language Models (CLLMs) has raised significant concerns regarding data privacy during user interactions. While existing approaches primarily focus on encrypting sensitive information, they often overlook the logical structure of user inputs. This oversight can lead to reduced data utility and degraded performance of CLLMs. To address these limitations and enable secure yet effective interactions, we propose Semantic Encryption (SE)-a plug-and-play framework designed to preserve both privacy and utility. SE consists of two key components: Semantic Encoding and Semantic Decoding. In the encoding phase, a lightweight local model transforms the original user input into an alternative semantic context that maintains the original intent and logical structure while obfuscating sensitive information. This transformed input is then processed by the CLLM, which generates a response based on the transformed semantic context. To maintain a seamless user experience, the decoding phase will reconstruct the CLLM's response back into the original semantic context by referencing the locally stored user input. Extensive experimental evaluations demonstrate that SE effectively protects data privacy without compromising data utility or user experience, offering a practical solution for secure interaction with CLLMs. Particularly, the proposed SE demonstrates a significant improvement over the state-of-the-art InferDPT, surpassing it across various evaluated metrics and datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。