改进KNN分类器,通过加权维度提升高维数据分类准确率
On pattern classification with weighted dimensions
- 提出基于Minkowski距离的维度加权新方法
- 在基因表达数据上提升约10%分类准确率
- 适合样本少、维度高的真实数据场景
针对多维样本的模式分类问题,本文系统分析了不同距离范数与维度权重的影响,并提出一种新的维度加权方案。该方案被集成至KNN分类器中,在多种合成与真实数据集上进行了实验。结果表明,在相同实验设置下,该模型显著优于传统KNN。特别是在基因表达数据集上,所有交叉验证实验中分类准确率均提升约10%,尤其在样本数量少、维度高的情况下表现更优。通过调节包含k个参考样本区域的形状与大小,该加权机制有效提升了近邻选择的合理性,是基于加权Minkowski距离的KNN重要推广。
原文摘要 · Abstract (English)
Studies on various facets of pattern classification is often imperative while working with multi-dimensional samples pertaining to diverse application scenarios. In this notion, weighted dimension-based distance measure has been one of the vital considerations in pattern analysis as it reflects the degree of similarity between samples. Though it is often presumed to be settled with the pervasive use of Euclidean distance, plethora of issues often surface. In this paper, we present (a) a detail analysis on the impact of distance measure norms and weights of dimensions along with visualization, (b) a novel weighting scheme for each dimension, (c) incorporation of this dimensional weighting schema into a KNN classifier, and (d) pattern classification on a variety of synthetic as well as realistic datasets with the developed model. It has performed well across diverse experiments in comparison to the traditional KNN under the same experimental setups. Specifically, for gene expression datasets, it yields significant and consistent gain in classification accuracy (around 10%) in all cross-validation experiments with different values of k. As such datasets contain limited number of samples of high dimensions, meaningful selection of nearest neighbours is desirable, and this requirement is reasonably met by regulating the shape and size of the region enclosing the k number of reference samples with the developed weighting schema and appropriate norm. It, therefore, stands as an important generalization of KNN classifier powered by weighted Minkowski distance with the present weighting schema.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。