通过自适应最近邻子空间提升分类效果,性能媲美随机森林。
Bags of Projected Nearest Neighbours: Competitors to Random Forests?
- 基于判别子空间的自适应k近邻分类,提升区分能力。
- 在多个数据集上超越随机森林和其他近邻集成方法。
- 适合需要高精度且对可解释性要求高的分类任务。
本文提出一种简单直观的自适应k近邻分类器,并探索其在自助采样集成(
原文摘要 · Abstract (English)
In this paper we introduce a simple and intuitive adaptive k nearest neighbours classifier, and explore its utility within the context of bootstrap aggregating ("bagging"). The approach is based on finding discriminant subspaces which are computationally efficient to compute, and are motivated by enhancing the discrimination of classes through nearest neighbour classifiers. This adaptiveness promotes diversity of the individual classifiers fit across different bootstrap samples, and so further leverages the variance reducing effect of bagging. Extensive experimental results are presented documenting the strong performance of the proposed approach in comparison with Random Forest classifiers, as well as other nearest neighbours based ensembles from the literature, plus other relevant benchmarks. Code to implement the proposed approach is available in the form of an R package from https://github.com/DavidHofmeyr/BOPNN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。