通过分析模型执行时系统行为,动态检测隐藏恶意代码。
Lifecycle-Aware Dynamic Analysis for Secure ML Model Execution
- 基于模型执行生命周期阶段,监测系统交互异常。
- 在7.8万份模型中检出所有攻击类型,误报率接近零。
- 适合安全研究人员与模型部署团队使用。
日益依赖预训练机器学习(ML)模型带来了新的攻击面。近期漏洞表明,恶意行为可嵌入模型文件中,常绕过现有防御。当前模型扫描方案主要依赖静态规则或已知攻击特征,难以跨框架泛化且无法发现新型攻击路径。本文提出一种新思路:关注攻击对宿主系统的影响,基于模型执行具有明确生命周期阶段的特性,每个阶段与系统的交互高度结构化且可预测。据此构建了名为Moat的动态生命周期感知安全机制,并实现为Re-Moat参考系统。我们在多个主流框架上评估Re-Moat,使用来自Hugging Face Hub的77,974个真实模型、31个基于CVE的漏洞验证样本及334个前沿数据集模型,对比当前最优扫描方案。结果表明,该方法成功检测所有攻击类别,同时保持接近零的误报率,验证了核心假设,推动动态分析在保障模型执行安全中的应用。
原文摘要 · Abstract (English)
The growing reliance on pre-trained Machine Learning (ML) models has introduced new attack surfaces. Recent vulnerabilities demonstrate that malicious behavior can be embedded within model artifacts, often bypassing existing defenses. Current model-scanning solutions primarily rely on static, format-specific rules or known attack signatures, which limit their ability to generalize across frameworks and to detect novel exploitation paths. In contrast, we propose a solution that focuses on the effects an attack has on the host system executing the model and builds on foundational intuitions about ML model execution. In particular, we observe that ML models operate within well-defined lifecycle phases and that, within each phase, interactions with the host system are highly structured and predictable. We translate these intuitions into Moat, a dynamic lifecycle-aware approach for securing ML model execution, and instantiate this design in Re-Moat, our reference implementation. We evaluate Re-Moat across multiple ML frameworks using 77,974 real-world model artifacts from the Hugging Face Hub, 31 Proofs-of-Concept (PoCs) from CVEs, and 334 models from a state-of-the-art dataset, and compare it against state-of-the-art model-scanning solutions. Our results show that our approach detects all evaluated attack classes while maintaining a close-to-zero false-positive rate, validating our intuitions and motivating dynamic analysis for securing ML model execution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。