通过结构熵学习高阶相关性,提升多视图多标签特征选择效果
SEHFS: Structural Entropy-Guided High-Order Correlation Learning for Multi-View Multi-Label Feature Selection
- 构建编码树最小化结构熵,捕捉超越成对关系的高阶特征关联
- 在8个跨领域数据集上显著优于现有方法,特征冗余被有效消除
- 适合处理复杂多视图数据的特征筛选任务,尤其关注高阶依赖建模
近年来,多视图多标签学习(MVML)因其与现实场景的高度契合而受到广泛关注。信息论方法在挖掘非线性相关性方面表现突出,但仍面临两大挑战:一是真实数据中特征常具有高阶结构相关性,而现有信息论方法难以建模;二是依赖启发式优化,易陷入局部最优。为此,本文提出结构熵引导的高阶相关性学习方法(SEHFS),用于多视图多标签特征选择。核心思想是将特征图转换为结构熵最小化的编码树,量化高阶依赖的信息代价,从而学习超出成对相关性的高阶特征关联。具体而言,强高阶冗余的特征被聚类至编码树同一节点,同时跨簇特征相关性被最小化,实现簇内与簇间冗余的双重消除。此外,引入融合信息论与矩阵方法的新框架,学习共享语义矩阵和视图特异性贡献矩阵以重构全局视图矩阵,增强信息论方法并平衡全局与局部优化。结构熵学习高阶相关性的理论有效性得到证明,8个不同领域数据集上的实验及消融研究均表明,SEHFS在特征选择任务中表现优异。
原文摘要 · Abstract (English)
In recent years, multi-view multi-label learning (MVML) has attracted extensive attention due to its close alignment to real-world scenarios. Information-theoretic methods have gained prominence for learning nonlinear correlations. However, two key challenges persist: first, features in real-world data commonly exhibit high-order structural correlations, but existing information-theoretic methods struggle to learn such correlations; second, commonly relying on heuristic optimization, information-theoretic methods are prone to converging to local optima. To address these two challenges, we propose a novel method called Structural Entropy Guided High-Order Correlation Learning for Multi-View Multi-Label Feature Selection (SEHFS). The core idea of SEHFS is to convert the feature graph into a structural-entropy-minimizing encoding tree, quantifying the information cost of high-order dependencies and thus learning high-order feature correlations beyond pairwise correlations. Specifically, features exhibiting strong high-order redundancy are grouped into a single cluster within the encoding tree, while inter-cluster feaeture correlations are minimized, thereby eliminating redundancy both within and across clusters. Furthermore, a new framework based on the fusion of information theory and matrix methods is adopted, which learns a shared semantic matrix and view-specific contribution matrices to reconstruct a global view matrix, thereby enhancing the information-theoretic method and balancing the global and local optimization. The ability of structural entropy to learn high-order correlations is theoretically established, and and both experiments on eight datasets from various domains and ablation studies demonstrate that SEHFS achieves superior performance in feature selection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。