arXiv:2510.21459cs.CRcs.CL2025-10被引 3

用本地轻量LLM设计更真实、响应更快的钓鱼系统,提升攻击者诱骗效果。

SBASH: a Framework for Designing and Evaluating RAG vs. Prompt-Tuned LLM Honeypots

  • 采用本地部署轻量LLM,解决云端数据泄露风险。
  • 有提示调优的非RAG模型准确率媲美未调优的RAG模型,延迟更低。
  • 通过人类测试和相似度指标验证,模型行为更接近真实系统。

蜜罐是用于收集威胁情报或引导攻击者远离生产系统的诱饵系统。提高攻击者参与度是其有效性的关键。现有研究指出,系统需具备上下文感知能力,如应对新型攻击、新系统及攻击者行为的能力。大语言模型(LLMs)可增强上下文感知,但存在响应准确性不足、延迟高、运维成本大及云部署带来的数据保护问题。本文提出系统级注意力蜜罐框架(SBASH),通过使用轻量本地LLM解决数据保护问题。我们评估了基于检索增强生成(RAG)与非RAG LLM在模拟Linux shell命令上的表现,使用响应时间、人类测试真实性、以及莱文斯坦距离、SBert和BertScore等指标进行比较。结果表明:对于未调优模型,RAG显著提升准确率;而经过系统提示调优(让LLM模仿真实系统)的非RAG模型,在无需RAG的情况下达到与未调优+RAG相当的准确率,且延迟略低。

原文摘要 · Abstract (English)

Honeypots are decoy systems used for gathering valuable threat intelligence or diverting attackers away from production systems. Maximising attacker engagement is essential to their utility. However research has highlighted that context-awareness, such as the ability to respond to new attack types, systems and attacker agents, is necessary to increase engagement. Large Language Models (LLMs) have been shown as one approach to increase context awareness but suffer from several challenges including accuracy and timeliness of response time, high operational costs and data-protection issues due to cloud deployment. We propose the System-Based Attention Shell Honeypot (SBASH) framework which manages data-protection issues through the use of lightweight local LLMs. We investigate the use of Retrieval Augmented Generation (RAG) supported LLMs and non-RAG LLMs for Linux shell commands and evaluate them using several different metrics such as response time differences, realism from human testers, and similarity to a real system calculated with Levenshtein distance, SBert, and BertScore. We show that RAG improves accuracy for untuned models while models that have been tuned via a system prompt that tells the LLM to respond like a Linux system achieve without RAG a similar accuracy as untuned with RAG, while having a slightly lower latency.

蜜罐LLM安全RAG本地部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。