系统梳理大模型安全四大风险及应对策略,助力AI安全落地。
Large Language Model Safety: A Holistic Survey
- 从价值对齐、抗攻击性、滥用风险到自主智能四方面分析大模型安全
- 总结主流技术手段与评估资源,涵盖可解释性与治理框架
- 适合研究者、从业者和政策制定者参考,推动安全AI发展
大型语言模型(LLMs)的快速发展在自然语言理解与生成方面展现出前所未有的能力,但其在关键应用中的广泛部署也带来显著安全风险。本文全面综述了大模型安全现状,涵盖四大核心领域:价值错位、对抗攻击鲁棒性、滥用风险以及自主人工智能风险。同时,深入探讨了大模型代理的安全影响、可解释性在提升安全性中的作用、多家科技公司与机构提出的技术路线图,以及围绕大模型安全的AI治理,包括国际合作、政策建议与未来监管方向。研究强调需采用前瞻性、多维度的方法,融合技术方案、伦理考量与健全治理框架。本综述旨在为学术界、产业界及政策制定者提供基础参考,推动大模型安全可控地融入社会。相关论文清单已公开于https://github.com/tjunlp-lab/Awesome-LLM-Safety-Papers。
原文摘要 · Abstract (English)
The rapid development and deployment of large language models (LLMs) have introduced a new frontier in artificial intelligence, marked by unprecedented capabilities in natural language understanding and generation. However, the increasing integration of these models into critical applications raises substantial safety concerns, necessitating a thorough examination of their potential risks and associated mitigation strategies. This survey provides a comprehensive overview of the current landscape of LLM safety, covering four major categories: value misalignment, robustness to adversarial attacks, misuse, and autonomous AI risks. In addition to the comprehensive review of the mitigation methodologies and evaluation resources on these four aspects, we further explore four topics related to LLM safety: the safety implications of LLM agents, the role of interpretability in enhancing LLM safety, the technology roadmaps proposed and abided by a list of AI companies and institutes for LLM safety, and AI governance aimed at LLM safety with discussions on international cooperation, policy proposals, and prospective regulatory directions. Our findings underscore the necessity for a proactive, multifaceted approach to LLM safety, emphasizing the integration of technical solutions, ethical considerations, and robust governance frameworks. This survey is intended to serve as a foundational resource for academy researchers, industry practitioners, and policymakers, offering insights into the challenges and opportunities associated with the safe integration of LLMs into society. Ultimately, it seeks to contribute to the safe and beneficial development of LLMs, aligning with the overarching goal of harnessing AI for societal advancement and well-being. A curated list of related papers has been publicly available at https://github.com/tjunlp-lab/Awesome-LLM-Safety-Papers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。