用特征爆炸策略统一优化异常检测算法,提升性能且无需定制化改造。
Feature Explosion: a generic optimization strategy for outlier detection algorithms
- 提出通用优化策略OSD,通过特征爆炸提升算法表现。
- 14种算法在24个数据集上平均AUC提升15%,AP提升63.7%。
- 适合需要快速增强现有异常检测模型的研究者和工程师。
异常检测旨在发现潜在问题或机会,广泛应用于网络安全、金融安全、工业检测等领域。迄今为止,已有数千种异常检测算法被提出,但实际应用中大量算法冗余。我们认为其根源在于当前高度定制化的优化策略——研究人员需为每种算法设计专属优化版本,导致算法数量持续膨胀。为此,本文引入物理学中的“特征爆炸”概念,提出一种通用优化策略OSD(Optimization Strategy for outlier Detection algorithms)。未来改进现有算法时,只需调用OSD插件,无需再为每种算法单独设计优化版本。我们在24个数据集上对比了14种异常检测算法在使用OSD前后的性能,结果表明几乎所有数据集上的性能均得到提升。平均而言,算法的AUC提升15%,AP提升63.7%。
原文摘要 · Abstract (English)
Outlier detection tasks aim at discovering potential issues or opportunities and are widely used in cybersecurity, financial security, industrial inspection, etc. To date, thousands of outlier detection algorithms have been proposed. Clearly, in real-world scenarios, such a large number of algorithms is unnecessary. In other words, a large number of outlier detection algorithms are redundant. We believe the root cause of this redundancy lies in the current highly customized (i.e., non-generic) optimization strategies. Specifically, when researchers seek to improve the performance of existing outlier detection algorithms, they have to design separate optimized versions tailored to the principles of each algorithm, leading to an ever-growing number of outlier detection algorithms. To address this issue, in this paper, we introduce the explosion from physics into the outlier detection task and propose a generic optimization strategy based on feature explosion, called OSD (Optimization Strategy for outlier Detection algorithms). In the future, when improving the performance of existing outlier detection algorithms, it will be sufficient to invoke the OSD plugin without the need to design customized optimized versions for them. We compared the performances of 14 outlier detection algorithms on 24 datasets before and after invoking the OSD plugin. The experimental results show that the performances of all outlier detection algorithms are improved on almost all datasets. In terms of average accuracy, OSD make these outlier detection algorithms improve by 15% (AUC), 63.7% (AP).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。