arXiv:2504.16449cs.CRcs.LG2025-04综述被引 35

系统梳理恶意网址检测技术与数据资源,填补开源实现与基准对比空白。

From Past to Present: A Survey of Malicious URL Detection Techniques, Datasets and Code Repositories

  • 按数据模态分类,清晰展示各类方法如何利用URL、HTML、视觉等信息
  • 整合2016-2024年公开数据集与2013-2025年开源代码,支持可复现研究
  • 适合安全研究人员、工程团队快速搭建检测系统,推动实际应用落地

恶意网址持续威胁网络安全,通过诱导用户泄露隐私或传播恶意载荷入侵系统。现有综述存在四大缺陷:依赖算法中心的分类体系,忽视对具体模态信息通道的分析;未涵盖基于LLM/Transformer的新型防御方法;缺乏开源实现以支持基准测试;数据集覆盖不足。本文系统综述从传统黑名单到先进深度学习(如Transformer、GNN、LLM)的恶意网址检测技术。提出新颖的模态驱动分类法,按主要数据模态(如URL、HTML、视觉等)组织方法,提升技术理解与多模态融合分析。同时,整理2016–2024年间公开可用的数据集,以及2013–2025年发表论文中的开源实现,并构建标准化评估框架。最后,提出产品级系统的架构设计原则与未来研究方向。项目维护于GitHub:https://github.com/sevenolu7/Malicious-URL-Detection-Open-Source/tree/master。

原文摘要 · Abstract (English)

Malicious URLs persistently threaten the cybersecurity ecosystem, by either deceiving users into divulging private data or distributing harmful payloads to infiltrate host systems. Gaining timely insights into the current state of this ongoing battle holds significant importance. However, existing reviews exhibit 4 critical gaps: 1) Their reliance on algorithm-centric taxonomies obscures understanding of how detection approaches exploit specific modal information channels; 2) They fail to incorporate pivotal LLM/Transformer-based defenses; 3) No open-source implementations are collected to facilitate benchmarking; 4) Insufficient dataset coverage.This paper presents a comprehensive review of malicious URL detection technologies, systematically analyzing methods from traditional blacklisting to advanced deep learning approaches (e.g. Transformer, GNNs, and LLMs). Unlike prior surveys, we propose a novel modality-based taxonomy that categorizes existing works according to their primary data modalities (URL, HTML, Visual, etc.). This hierarchical classification enables both rigorous technical analysis and clear understanding of multimodal information utilization. Furthermore, to establish a profile of accessible datasets and address the lack of standardized benchmarking (where current studies often lack proper baseline comparisons), we curate and analyze: 1) publicly available datasets (2016-2024), and 2) open-source implementations from published works(2013-2025). Then, we outline essential design principles and architectural frameworks for product-level implementations. The review concludes by examining emerging challenges and proposing actionable directions for future research. We maintain a GitHub repository for ongoing curating datasets and open-source implementations: https://github.com/sevenolu7/Malicious-URL-Detection-Open-Source/tree/master.

恶意网址检测数据集综述开源实现模态分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。