用多任务自编码器筛选联邦学习中的异常样本,提升模型准确率。
Sample Selection Using Multi-Task Autoencoders in Federated Learning with Non-IID Data

- 通过损失与特征分析结合多任务自编码器评估样本贡献。
- 在非独立同分布数据下,最高提升CIFAR10准确率7.02%。
- 适合存在噪声或恶意样本的分布式图像分类场景。
联邦学习允许多个设备在中央服务器监督下协作训练模型,同时保障数据隐私。然而,冗余、恶意或异常样本常导致模型退化和效率低下。为此,我们提出针对图像分类的新样本选择方法,利用多任务自编码器通过损失与特征分析估算样本贡献。该方法由中央服务器管理,集成无监督异常检测技术:一类支持向量机(OCSVM)、孤立森林(IF)和自适应损失阈值(AT),用于客户端过滤噪声样本。同时,我们提出由中央服务器控制的多类深度支持向量数据描述(SVDD)损失,以增强基于特征的样本选择。我们在CIFAR10和MNIST数据集上验证了该方法,在不同客户端数量、非独立同分布分布及高达40%的噪声水平下均表现优异。结果表明,基于损失的样本选择在CIFAR10上使用OCSVM可实现最高7.02%的准确率提升,在MNIST上使用AT提升1.83%。此外,联邦SVDD损失进一步改善特征选择,使CIFAR10上再提升0.99%。实验验证了方法在多种客户端数量和噪声条件下的有效性。
原文摘要 · Abstract (English)
Federated learning is a machine learning paradigm in which multiple devices collaboratively train a model under the supervision of a central server while ensuring data privacy. However, its performance is often hindered by redundant, malicious, or abnormal samples, leading to model degradation and inefficiency. To overcome these issues, we propose novel sample selection methods for image classification, employing a multitask autoencoder to estimate sample contributions through loss and feature analysis. Our approach incorporates unsupervised outlier detection, using one-class support vector machine (OCSVM), isolation forest (IF), and adaptive loss threshold (AT) methods managed by a central server to filter noisy samples on clients. We also propose a multi-class deep support vector data description (SVDD) loss controlled by a central server to enhance feature-based sample selection. We validate our methods on CIFAR10 and MNIST datasets across varying numbers of clients, non-IID distributions, and noise levels up to 40%. The results show significant accuracy improvements with loss-based sample selection, achieving gains of up to 7.02% on CIFAR10 with OCSVM and 1.83% on MNIST with AT. Additionally, our federated SVDD loss further improves feature-based sample selection, yielding accuracy gains of up to 0.99% on CIFAR10 with OCSVM. These results show the effectiveness of our methods in improving model accuracy across various client counts and noise conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。