arXiv:2412.15593cs.LGcs.AI2024-12被引 15

用SVM提升高维稀疏数据中模式挖掘的准确率与鲁棒性。

Machine Learning Techniques for Pattern Recognition in High-Dimensional Data Mining

  • 将模式挖掘转为分类问题,利用核函数实现非线性分离。
  • 在Retail和Mushroom数据集上,支持度、置信度和提升度均显著优于传统方法。
  • 适合处理高稀疏性、大交易量场景下的复杂模式发现任务。

本文提出一种基于支持向量机(SVM)的频繁模式数据挖掘算法,旨在解决传统频繁模式挖掘算法在高维稀疏数据环境下的性能瓶颈。通过将频繁模式挖掘任务转化为分类问题,引入SVM模型以提升模式提取的准确性和鲁棒性。在方法设计上,利用核函数将数据映射到高维特征空间,构建最优分类超平面,实现模式的非线性分离与频繁项的精准挖掘。实验选用Retail和Mushroom两个公开数据集,与FP-Growth、FP-Tree、决策树及随机森林模型进行对比。结果表明,该算法在支持度、置信度和提升度三项关键指标上均显著优于传统模型,展现出强大的模式识别能力和规则提取效果。研究还指出,未来可结合深度学习与集成学习框架进一步提升算法的可扩展性与适应性。该工作不仅为频繁模式挖掘提供了新思路,也为实际应用中的模式发现与关联规则挖掘提供了重要技术支持。

原文摘要 · Abstract (English)

This paper proposes a frequent pattern data mining algorithm based on support vector machine (SVM), aiming to solve the performance bottleneck of traditional frequent pattern mining algorithms in high-dimensional and sparse data environments. By converting the frequent pattern mining task into a classification problem, the SVM model is introduced to improve the accuracy and robustness of pattern extraction. In terms of method design, the kernel function is used to map the data to a high-dimensional feature space, so as to construct the optimal classification hyperplane, realize the nonlinear separation of patterns and the accurate mining of frequent items. In the experiment, two public datasets, Retail and Mushroom, were selected to compare and analyze the proposed algorithm with traditional FP-Growth, FP-Tree, decision tree and random forest models. The experimental results show that the algorithm in this paper is significantly better than the traditional model in terms of three key indicators: support, confidence and lift, showing strong pattern recognition ability and rule extraction effect. The study shows that the SVM model has excellent performance advantages in an environment with high data sparsity and a large number of transactions, and can effectively cope with complex pattern mining tasks. At the same time, this paper also points out the potential direction of future research, including the introduction of deep learning and ensemble learning frameworks to further improve the scalability and adaptability of the algorithm. This research not only provides a new idea for frequent pattern mining, but also provides important technical support for solving pattern discovery and association rule mining problems in practical applications.

模式挖掘SVM高维数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。