FRAME融合前向选择与递归消除,提升高维数据特征选择效果。
"FRAME: Forward Recursive Adaptive Model Extraction-A Technique for Advance Feature Selection"
- 结合前向选择与递归消除,递进式筛选最优特征子集。
- 在高维噪声数据上表现优于SelectKBest和Lasso,预测性能更优。
- 适合需可解释性与高精度的场景,如生物医学诊断。
特征选择在模型准确率、可解释性与计算效率间难以平衡,仍是机器学习的关键挑战。本文提出新型混合方法——前向递归自适应模型提取技术(FRAME),融合前向选择与递归特征消除(RFE),系统识别最优特征子集,在探索性与精确性间取得良好平衡。在高维、含噪、异构数据集上对传统方法(如SelectKBest、Lasso回归)进行综合评估,结果表明FRAME在下游机器学习指标上持续表现更优,兼具高效降维与强模型性能。该方法特别适用于需可解释且精准预测的应用,如生物医学诊断。研究强调应在多样化数据上评估特征选择方法以检验其鲁棒性与泛化能力。结果显示,FRAME具备进一步发展潜力,尤其可通过集成深度学习框架实现动态环境下的自适应、实时特征选择。通过改进特征选择,FRAME为多领域机器学习应用提供实用高效解决方案。
原文摘要 · Abstract (English)
The challenges in feature selection, particularly in balancing model accuracy, interpretability, and computational efficiency, remain a critical issue in advancing machine learning methodologies. To address these complexities, this study introduces a novel hybrid approach, the Forward Recursive Adaptive Model Extraction Technique (FRAME), which combines Forward Selection and Recursive Feature Elimination (RFE) to enhance feature selection across diverse datasets. By combining the exploratory capabilities of Forward Selection with the refinement strengths of RFE, FRAME systematically identifies optimal feature subsets, striking a harmonious trade-off between experimentation and precision. A comprehensive evaluation of FRAME is conducted against traditional methods such as SelectKBest and Lasso Regression, using high-dimensional, noisy, and heterogeneous datasets. The results demonstrate that FRAME consistently delivers superior predictive performance based on downstream machine learning evaluation metrics. It efficiently performs dimensionality reduction with strong model performance, thus being especially useful for applications that need interpretable and accurate predictions, e.g., biomedical diagnostics. This research emphasizes the need to evaluate feature selection techniques on diverse datasets to test their robustness and generalizability. The results indicate that FRAME has great potential for further development, especially by incorporating deep learning frameworks for adaptive and real-time feature selection in dynamic settings. By advancing feature selection methodologies, FRAME offers a practical and effective solution to improve machine learning applications across multiple domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。