arXiv:2604.13555cs.CVcs.NI2026-04被引 2

用网页截图检测钓鱼网站,卷积模型效果优于Transformer。

AI Powered Image Analysis for Phishing Detection

论文配图:AI Powered Image Analysis for Phishing Detection
图 1 · 摘自论文原文
  • 用截图训练ConvNeXt-Tiny和ViT-Base模型,实现视觉化钓鱼识别。
  • ConvNeXt-Tiny在最优阈值下F1分数最高,且推理更快。
  • 强调阈值调优对实际部署的重要性,适合安全系统研发者。

钓鱼网站越来越依赖视觉模仿——如复制图标、相似布局和配色,以规避基于文本和URL的检测系统。本文提出一种基于深度学习的图像检测方法,利用网页截图进行视觉钓鱼识别。测试了两种视觉模型:ConvNeXt-Tiny 和 Vision Transformer (ViT-Base),涵盖数据集构建、预处理、使用ImageNet权重的迁移学习及不同决策阈值下的评估。结果表明,ConvNeXt-Tiny整体表现最佳,在优化阈值下取得最高F1-score,且运行效率高于ViT-Base。研究强调了阈值调优对真实场景部署的关键作用,并通过两模型在相同设置下的对比,揭示了卷积与Transformer架构在鲁棒性与计算效率上的差异。未来将公开所用数据集,支持可复现性与进一步研究。

原文摘要 · Abstract (English)

Phishing websites now rely heavily on visual imitation-copied logos, similar layouts, and matching colours-to avoid detection by text- and URL-based systems. This paper presents a deep learning approach that uses webpage screenshots for image-based phishing detection. Two vision models, ConvNeXt-Tiny and Vision Transformer (ViT-Base), were tested to see how well they handle visually deceptive phishing pages. The framework covers dataset creation, preprocessing, transfer learning with ImageNet weights, and evaluation using different decision thresholds. The results show that ConvNeXt-Tiny performs the best overall, achieving the highest F1-score at the optimised threshold and running more efficiently than ViT-Base. This highlights the strength of convolutional models for visual phishing detection and shows why threshold tuning is important for real-world deployment. As future work, the curated dataset used in this study will be released to support reproducibility and encourage further research in this area. Unlike many existing studies that primarily report accuracy, this work places greater emphasis on threshold-aware evaluation to better reflect real-world deployment conditions. By examining precision, recall, and F1-score across different decision thresholds, the study identifies operating points that balance detection performance and false-alarm control. In addition, the side-by-side comparison of ConvNeXt-Tiny and ViT-Base under the same experimental setup offers practical insights into how convolutional and transformer-based architectures differ in robustness and computational efficiency for visual phishing detection.

图像检测钓鱼防御深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。