在联邦学习中实现无标签客户端的多标签特征选择,提升模型性能。
Semi-Supervised Federated Multi-Label Feature Selection with Fuzzy Information Measures
- 基于模糊信息论构建联邦特征选择框架,客户端仅需无标签数据。
- 通过服务器计算特征相关性与冗余度,在五个真实数据集上表现更优。
- 适合缺乏标注能力的分布式场景,如医疗、图像等隐私敏感领域。
多标签特征选择通过去除无关、噪声和冗余特征,降低多标签数据维度,从而提升多标签学习模型性能。然而,现有方法通常依赖集中式数据,难以适用于各设备持有本地数据的分布式环境。此外,联邦方法常假设客户端具备标注数据,这在客户端缺乏专业知识或资源进行任务标注时并不现实。为此,本文提出半监督联邦多标签特征选择方法SSFMLFS:客户端仅持有无标签数据,而服务器拥有少量标签数据。该方法将模糊信息理论适配至联邦设置,客户端计算模糊相似性矩阵并上传至服务器,服务器据此计算特征冗余度与特征-标签相关性。以特征为顶点,相关性与冗余度分别作为顶点权重与边权重构建特征图,再使用PageRank算法对特征重要性进行排序。在生物、图像、音乐和文本等领域的五个真实数据集上进行的大量实验表明,在非独立同分布(non-IID)数据分布下,SSFMLFS在三种评估指标上均优于其他联邦及集中式监督与半监督方法。
原文摘要 · Abstract (English)
Multi-label feature selection (FS) reduces the dimensionality of multi-label data by removing irrelevant, noisy, and redundant features, thereby boosting the performance of multi-label learning models. However, existing methods typically require centralized data, which makes them unsuitable for distributed and federated environments where each device/client holds its own local dataset. Additionally, federated methods often assume that clients have labeled data, which is unrealistic in cases where clients lack the expertise or resources to label task-specific data. To address these challenges, we propose a Semi-Supervised Federated Multi-Label Feature Selection method, called SSFMLFS, where clients hold only unlabeled data, while the server has limited labeled data. SSFMLFS adapts fuzzy information theory to a federated setting, where clients compute fuzzy similarity matrices and transmit them to the server, which then calculates feature redundancy and feature-label relevancy degrees. A feature graph is constructed by modeling features as vertices, assigning relevancy and redundancy degrees as vertex weights and edge weights, respectively. PageRank is then applied to rank the features by importance. Extensive experiments on five real-world datasets from various domains, including biology, images, music, and text, demonstrate that SSFMLFS outperforms other federated and centralized supervised and semi-supervised approaches in terms of three different evaluation metrics in non-IID data distribution setting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。