arXiv:2412.12154cs.LGcs.AI2024-12被引 28

PyOD 2 用大模型自动选型,让异常检测更简单高效

PyOD 2: A Python Library for Outlier Detection with LLM-powered Model Selection

  • 基于大语言模型实现自动化模型选择
  • 整合45种算法,覆盖12个前沿深度学习模型
  • 适合非专家快速部署异常检测系统

异常检测(OD)是机器学习中的关键任务,广泛应用于欺诈检测、网络入侵检测、点击流分析、推荐系统和社交网络管理。目前最流行的开源库PyOD已拥有超过8,500个GitHub星标、2500万次下载,并被广泛应用。但其仍存在三大问题:(1)现代深度学习算法覆盖不足,(2)在PyTorch与TensorFlow间实现碎片化,(3)缺乏自动化模型选择,对非专家不友好。为此,我们推出PyOD 2,将12个前沿深度学习模型统一整合至PyTorch框架,并引入大语言模型(LLM)驱动的自动化模型选择流程。该版本支持45种算法,显著简化了异常检测工作流,在多个数据集上表现稳健。本文展示了PyOD 2如何提升模型部署与自动化能力,为研究与工业界树立新标准。项目地址:https://github.com/yzhao062/pyod。

原文摘要 · Abstract (English)

Outlier detection (OD), also known as anomaly detection, is a critical machine learning (ML) task with applications in fraud detection, network intrusion detection, clickstream analysis, recommendation systems, and social network moderation. Among open-source libraries for outlier detection, the Python Outlier Detection (PyOD) library is the most widely adopted, with over 8,500 GitHub stars, 25 million downloads, and diverse industry usage. However, PyOD currently faces three limitations: (1) insufficient coverage of modern deep learning algorithms, (2) fragmented implementations across PyTorch and TensorFlow, and (3) no automated model selection, making it hard for non-experts. To address these issues, we present PyOD Version 2 (PyOD 2), which integrates 12 state-of-the-art deep learning models into a unified PyTorch framework and introduces a large language model (LLM)-based pipeline for automated OD model selection. These improvements simplify OD workflows, provide access to 45 algorithms, and deliver robust performance on various datasets. In this paper, we demonstrate how PyOD 2 streamlines the deployment and automation of OD models and sets a new standard in both research and industry. PyOD 2 is accessible at [https://github.com/yzhao062/pyod](https://github.com/yzhao062/pyod). This study aligns with the Web Mining and Content Analysis track, addressing topics such as the robustness of Web mining methods and the quality of algorithmically-generated Web data.

异常检测大模型自动化Python库

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。