系统梳理大模型应用中的安全威胁与防护策略,助力落地安全
LLM in the Middle: A Systematic Review of Threats and Mitigations to Real-World LLM-based Systems
- 从开发到运维全周期分析大模型系统面临的安全威胁
- 按严重程度和使用场景分类威胁,明确高风险环节
- 为开发者、厂商和研究者提供可落地的防御参考
生成式AI,尤其是大语言模型(LLMs)的成功与广泛应用,吸引了网络犯罪分子试图滥用模型、窃取敏感数据或破坏服务。确保基于大语言模型的系统安全极具挑战性,因为既要应对传统软件应用的威胁,也要防范针对大语言模型及其集成环节的新型攻击。本文通过系统性综述,全面分类了大语言模型系统在全生命周期中面临的安全与隐私问题,并结合真实应用场景,涵盖从开发到运行阶段的不同特征。威胁按严重程度及所属场景进行分类,便于识别关键风险。同时,推荐的防御策略也被系统归类,并映射到对应生命周期阶段及可缓解的攻击路径。本工作为用户与厂商理解并高效降低大模型集成风险提供了指引,也帮助研究界把握开放挑战与边缘案例,推动大模型系统的安全与隐私保护落地。
原文摘要 · Abstract (English)
The success and wide adoption of generative AI (GenAI), particularly large language models (LLMs), has attracted the attention of cybercriminals seeking to abuse models, steal sensitive data, or disrupt services. Moreover, providing security to LLM-based systems is a great challenge, as both traditional threats to software applications and threats targeting LLMs and their integration must be mitigated. In this survey, we shed light on security and privacy concerns of such LLM-based systems by performing a systematic review and comprehensive categorization of threats and defensive strategies considering the entire software and LLM life cycles. We analyze real-world scenarios with distinct characteristics of LLM usage, spanning from development to operation. In addition, threats are classified according to their severity level and to which scenarios they pertain, facilitating the identification of the most relevant threats. Recommended defense strategies are systematically categorized and mapped to the corresponding life cycle phase and possible attack strategies they attenuate. This work paves the way for consumers and vendors to understand and efficiently mitigate risks during integration of LLMs in their respective solutions or organizations. It also enables the research community to benefit from the discussion of open challenges and edge cases that may hinder the secure and privacy-preserving adoption of LLM-based systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。