arXiv:2410.21293cs.NEcs.AI2024-10被引 1

提出新算法LMSSS,高效筛选高维数据中的关键特征。

Large-scale Multi-objective Feature Selection: A Multi-phase Search Space Shrinking Approach

  • 先用相关性筛选剔除无关特征,缩小搜索空间
  • 实验在15个大数据集上表现优于现有方法
  • 适合处理海量特征的机器学习场景

特征选择是机器学习中的关键步骤,尤其在高维数据中,无关和冗余特征会降低模型性能并增加计算成本。本文提出一种基于搜索空间缩减的大规模多目标进化算法LMSSS,专门应对稀疏优化问题。该方法通过基于排名的过滤机制,在低成本的初始进化过程中评估特征与类别标签的相关性及出现频率,提前剔除无关特征以降低搜索空间维度。同时引入基于投票的智能交叉策略,优先保留分类准确率更高的父代特征;设计智能突变机制,重新评估被过早排除的特征,使其与其他特征组合进行评估。这些技术协同提升进化过程的效率与有效性,有效应对大规模特征选择中的稀疏与高维挑战。在15个大规模数据集上的全面实验验证了该算法的有效性,结果表明其能发现更优的特征子集,显著提升模型性能与计算效率,为该领域树立了新基准。

原文摘要 · Abstract (English)

Feature selection is a crucial step in machine learning, especially for high-dimensional datasets, where irrelevant and redundant features can degrade model performance and increase computational costs. This paper proposes a novel large-scale multi-objective evolutionary algorithm based on the search space shrinking, termed LMSSS, to tackle the challenges of feature selection particularly as a sparse optimization problem. The method includes a shrinking scheme to reduce dimensionality of the search space by eliminating irrelevant features before the main evolutionary process. This is achieved through a ranking-based filtering method that evaluates features based on their correlation with class labels and frequency in an initial, cost-effective evolutionary process. Additionally, a smart crossover scheme based on voting between parent solutions is introduced, giving higher weight to the parent with better classification accuracy. An intelligent mutation process is also designed to target features prematurely excluded from the population, ensuring they are evaluated in combination with other features. These integrated techniques allow the evolutionary process to explore the search space more efficiently and effectively, addressing the sparse and high-dimensional nature of large-scale feature selection problems. The effectiveness of the proposed algorithm is demonstrated through comprehensive experiments on 15 large-scale datasets, showcasing its potential to identify more accurate feature subsets compared to state-of-the-art large-scale feature selection algorithms. These results highlight LMSSS's capability to improve model performance and computational efficiency, setting a new benchmark in the field.

特征选择进化算法高维数据多目标优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。