用分层智能体结合网址和截图,提升钓鱼检测效率并降低90%以上成本
Large Multimodal Agents for Accurate Phishing Detection with Enhanced Token Optimization and Cost Reduction
- 先分析网址,不确定时再加截图,减少冗余调用
- GPT-4o mini每100美元可处理10.7万网站,是传统方法的4.2倍
- 适合预算有限但需高精度钓鱼检测的团队使用
随着复杂钓鱼攻击的增加,亟需高效且经济的检测方案。本文探索使用大型多模态智能体(Gemini 1.5 Flash 和 GPT-4o mini)通过API分析网址与网页截图,避免训练和维护模型的复杂性。结果表明,融合两种数据源显著优于单一使用。但API按输入输出令牌计费,为降低成本,提出两级代理策略:首阶段仅分析网址,若结果不明确则启动第二阶段联合分析网址与截图。该方法在保持高性能的同时大幅减少不必要的多模态调用。成本分析显示,采用该策略后,GPT-4o mini每100美元可处理约107,440个网站(对比传统方法25,626),提升4.2倍;Gemini 1.5 Flash可处理约2,232,142个网站(对比862,068),提升2.6倍。实证证明该策略在经济性上具有显著优势,为组织低成本部署先进AI钓鱼检测提供了可行路径。
原文摘要 · Abstract (English)
With the rise of sophisticated phishing attacks, there is a growing need for effective and economical detection solutions. This paper explores the use of large multimodal agents, specifically Gemini 1.5 Flash and GPT-4o mini, to analyze both URLs and webpage screenshots via APIs, thus avoiding the complexities of training and maintaining AI systems. Our findings indicate that integrating these two data types substantially enhances detection performance over using either type alone. However, API usage incurs costs per query that depend on the number of input and output tokens. To address this, we propose a two-tiered agentic approach: initially, one agent assesses the URL, and if inconclusive, a second agent evaluates both the URL and the screenshot. This method not only maintains robust detection performance but also significantly reduces API costs by minimizing unnecessary multi-input queries. Cost analysis shows that with the agentic approach, GPT-4o mini can process about 4.2 times as many websites per $100 compared to the multimodal approach (107,440 vs. 25,626), and Gemini 1.5 Flash can process about 2.6 times more websites (2,232,142 vs. 862,068). These findings underscore the significant economic benefits of the agentic approach over the multimodal method, providing a viable solution for organizations aiming to leverage advanced AI for phishing detection while controlling expenses.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。