用小模型本地处理提示,既省成本又防隐私泄露。
Privacy Guard & Token Parsimony by Prompt and Context Handling and LLM Routing
- 用本地小模型分析提示,自动拆解敏感任务
- 减少45%云上计算开销,个人隐私100%消除
- 适合关注数据安全与成本的机构用户
大语言模型的大规模应用带来运营成本(OpEx)与数据隐私之间的权衡。现有路由框架虽能降低成本,却忽视提示敏感性,使用户和机构面临向第三方云服务商泄露风险。本文提出“不可分割范式”:高级上下文管理本质上等同于隐私管理。我们设计本地化“隐私卫士”——基于本地小型语言模型(SLM)的全场景上下文观察器,通过抽象摘要与自动提示优化(APO)将提示分解为聚焦子任务,并将高风险查询重路由至零信任或受保密协议保护的模型。该双机制同时消除敏感推理路径(零泄露)并降低云端令牌负载(成本下降)。采用基于后进先出(LIFO)的上下文压缩机制,限制工作内存,进一步缩小潜在泄露面。在1,000样本数据集上,2×2基准测试(懒惰/专家用户;个人/机构秘密)验证了本框架:混合成本降低45%,个人秘密红移成功率100%,经LLM作为裁判评估,APO压缩响应获得85%偏好率。结果表明,令牌精简与零泄露是同一上下文压缩算子的数学对偶。
原文摘要 · Abstract (English)
The large-scale adoption of Large Language Models (LLMs) forces a trade-off between operational cost (OpEx) and data privacy. Current routing frameworks reduce costs but ignore prompt sensitivity, exposing users and institutions to leakage risks towards third-party cloud providers. We formalise the "Inseparability Paradigm": advanced context management intrinsically coincides with privacy management. We propose a local "Privacy Guard" -- a holistic contextual observer powered by an on-premise Small Language Model (SLM) -- that performs abstractive summarisation and Automatic Prompt Optimisation (APO) to decompose prompts into focused sub-tasks, re-routing high-risk queries to Zero-Trust or NDA-covered models. This dual mechanism simultaneously eliminates sensitive inference vectors (Zero Leakage) and reduces cloud token payloads (OpEx Reduction). A LIFO-based context compacting mechanism further bounds working memory, limiting the emergent leakage surface. We validate the framework through a 2x2 benchmark (Lazy vs. Expert users; Personal vs. Institutional secrets) on a 1,000-sample dataset, achieving a 45% blended OpEx reduction, 100% redaction success on personal secrets, and -- via LLM-as-a-Judge evaluation -- an 85% preference rate for APO-compressed responses over raw baselines. Our results demonstrate that Token Parsimony and Zero Leakage are mathematically dual projections of the same contextual compression operator.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。