arXiv:2511.12462cs.LG2025-11AAAI

提出新模型,解决多视图多标签特征选择中的冗余与互补性问题。

Redundancy-optimized Multi-head Attention Networks for Multi-View Multi-Label Feature Selection

论文配图:Redundancy-optimized Multi-head Attention Networks for Multi-View Multi-Label Feature Selection
图 1 · 摘自论文原文
  • 用多头注意力建模视图内关系,交叉注意力捕捉视图间互补性。
  • 设计静态与动态冗余项,提升选中特征的紧凑性。
  • 在6个真实数据集上优于6种现有方法,适合复杂多标签场景。

多视图多标签数据为人工智能提供了更丰富的视角,但其特征、视图和标签间的复杂关联给特征选择带来挑战。注意力机制能通过查询与键矩阵的相关性聚合计算重要性权重,聚焦关键信息。然而,现有基于注意力的方法多关注视图内关系,忽略视图间特征互补性和关键特征-标签相关性,且未考虑特征冗余,易导致次优特征子集。为此,本文提出冗余优化的多头注意力网络用于多视图多标签特征选择(RMAN-MMFS)。具体地,每个注意力头建模视图内特征关系,不同头间的交叉注意力捕捉视图间互补性;同时设计静态与动态冗余项:静态项缓解视图内冗余,动态项显式建模整个选择过程中已选与未选特征间的冗余,促进特征紧凑性。在六个真实数据集上,对比六种多视图多标签特征选择方法,所提方法表现更优。

原文摘要 · Abstract (English)

Multi-view multi-label data offers richer perspectives for artificial intelligence, but simultaneously presents significant challenges for feature selection due to the inherent complexity of interrelations among features, views and labels. Attention mechanisms provide an effective way for analyzing these intricate relationships. They can compute importance weights for information by aggregating correlations between Query and Key matrices to focus on pertinent values. However, existing attention-based feature selection methods predominantly focus on intra-view relationships, neglecting the complementarity of inter-view features and the critical feature-label correlations. Moreover, they often fail to account for feature redundancy, potentially leading to suboptimal feature subsets. To overcome these limitations, we propose a novel method based on Redundancy-optimized Multi-head Attention Networks for Multi-view Multi-label Feature Selection (RMAN-MMFS). Specifically, we employ each individual attention head to model intra-view feature relationships and use the cross-attention mechanisms between different heads to capture inter-view feature complementarity. Furthermore, we design static and dynamic feature redundancy terms: the static term mitigates redundancy within each view, while the dynamic term explicitly models redundancy between unselected and selected features across the entire selection process, thereby promoting feature compactness. Comprehensive evaluations on six real-world datasets, compared against six multi-view multi-label feature selection methods, demonstrate the superior performance of the proposed method.

特征选择多视图学习注意力机制冗余优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。