量化小模型在钓鱼检测中表现高效,兼具可解释性与部署优势。
Phishing Detection in the Gen-AI Era: Quantized LLMs vs Classical Models
- 对比经典模型与量化小参数LLM的钓鱼检测效果。
- 部分量化模型达80%以上准确率,仅需17GB显存。
- 轻量LLM可生成简洁解释,适合实时决策场景。
钓鱼攻击日益复杂,亟需兼顾高精度与计算效率的检测系统。本文对比传统机器学习(ML)、深度学习(DL)与量化小参数大语言模型(LLM)在钓鱼检测中的表现。实验基于一个精心构建的数据集显示,尽管当前LLM在原始准确率上仍低于ML和DL方法,但对细微上下文线索具有识别潜力。研究还考察了零样本与少样本提示策略,发现经LLM重写的邮件会显著降低ML与LLM检测器性能。基准测试表明,DeepSeek R1 Distill Qwen 14B(Q8_0)等模型在仅使用17GB VRAM的情况下达到超过80%的准确率,具备成本效益部署可行性。进一步评估了模型的对抗鲁棒性与性价比权衡,并展示轻量级LLM能提供简洁可解释的分析结果,支持实时决策。这些发现表明优化后的LLM有望成为钓鱼防御体系的关键组件,为将可解释、高效的AI整合进现代网络安全框架提供路径。
原文摘要 · Abstract (English)
Phishing attacks are becoming increasingly sophisticated, underscoring the need for detection systems that strike a balance between high accuracy and computational efficiency. This paper presents a comparative evaluation of traditional Machine Learning (ML), Deep Learning (DL), and quantized small-parameter Large Language Models (LLMs) for phishing detection. Through experiments on a curated dataset, we show that while LLMs currently underperform compared to ML and DL methods in terms of raw accuracy, they exhibit strong potential for identifying subtle, context-based phishing cues. We also investigate the impact of zero-shot and few-shot prompting strategies, revealing that LLM-rephrased emails can significantly degrade the performance of both ML and LLM-based detectors. Our benchmarking highlights that models like DeepSeek R1 Distill Qwen 14B (Q8_0) achieve competitive accuracy, above 80%, using only 17GB of VRAM, supporting their viability for cost-efficient deployment. We further assess the models' adversarial robustness and cost-performance tradeoffs, and demonstrate how lightweight LLMs can provide concise, interpretable explanations to support real-time decision-making. These findings position optimized LLMs as promising components in phishing defence systems and offer a path forward for integrating explainable, efficient AI into modern cybersecurity frameworks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。