通过混合指纹技术识别生成式AI中的底层大模型
Invisible Traces: Using Hybrid Fingerprinting to identify underlying LLMs in GenAI Apps
- 融合静态与动态特征,构建抗干扰的模型指纹
- 在多代理、频繁更新等场景下仍能准确识别模型
- 适合安全审计与模型溯源,尤其适用于动态部署环境
指纹识别是指通过分析AI系统(如大语言模型)的独特特征或模式来识别其底层机器学习模型的过程,类似于人类指纹。大语言模型的指纹识别对保障集成AI的应用程序的安全性与透明性至关重要。现有方法主要依赖对应用的直接交互访问以推断模型身份,但在涉及多智能体系统、频繁模型更新及模型内部受限访问的真实场景中常失效。本文提出一种新型指纹框架,通过整合静态与动态指纹技术,识别模型架构特征与行为特性,实现对动态环境中大语言模型的精准、鲁棒识别。我们揭示了传统方法失效的新威胁场景,弥合了理论技术与实际应用之间的差距。为验证该框架,我们构建了模拟真实条件的全面评估体系,展示了其在生成式AI应用中识别与监控大语言模型的有效性。结果表明,该框架具备良好的适应性,可应对多样化且不断演化的部署环境。
原文摘要 · Abstract (English)
Fingerprinting refers to the process of identifying underlying Machine Learning (ML) models of AI Systemts, such as Large Language Models (LLMs), by analyzing their unique characteristics or patterns, much like a human fingerprint. The fingerprinting of Large Language Models (LLMs) has become essential for ensuring the security and transparency of AI-integrated applications. While existing methods primarily rely on access to direct interactions with the application to infer model identity, they often fail in real-world scenarios involving multi-agent systems, frequent model updates, and restricted access to model internals. In this paper, we introduce a novel fingerprinting framework designed to address these challenges by integrating static and dynamic fingerprinting techniques. Our approach identifies architectural features and behavioral traits, enabling accurate and robust fingerprinting of LLMs in dynamic environments. We also highlight new threat scenarios where traditional fingerprinting methods are ineffective, bridging the gap between theoretical techniques and practical application. To validate our framework, we present an extensive evaluation setup that simulates real-world conditions and demonstrate the effectiveness of our methods in identifying and monitoring LLMs in Gen-AI applications. Our results highlight the framework's adaptability to diverse and evolving deployment contexts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。