arXiv:2409.11657cs.LGcs.AI2024-09被引 6

提出联邦少样本增量学习框架,解决隐私保护下新类别学习难题

Few-Shot Class-Incremental Learning with Non-IID Decentralized Data

  • 构建基于生成回放的合成数据框架,平衡新旧知识学习
  • 设计噪声感知生成模块,提升小样本新类识别能力
  • 采用类别加权聚合策略,缓解客户端数据异构问题

少样本类别增量学习对构建可扩展、自适应智能系统至关重要,它使模型能在少量标注数据下学习新类别,同时保护已有知识。然而,现有方法多为集中式处理连续数据流,在注重数据隐私与安全的场景中适用性受限。为此,本文提出联邦少样本类别增量学习(Federated FSCIL),一种针对分布式客户端稀缺数据的去中心化学习范式。在该范式中,客户端本地更新模型以学习新类别,同时保护数据隐私,再将模型更新上传至中央服务器进行全局聚合。但该范式面临小样本学习困难、灾难性遗忘和数据异构性等挑战。为此,本文提出一种基于合成数据的驱动框架(SDD),利用回放缓冲区数据维持旧知识并促进新知识获取。框架内设计了噪声感知的生成回放模块,通过新数据与回放数据的联合微调来优化本地模型,并生成新类别的合成数据以扩充回放缓冲区。此外,提出一种基于性能的类别特定加权聚合策略,根据本地模型在合成数据上的表现自适应聚合类别参数,实现无需访问客户端原始数据的有效全局优化。在三个常用数据集上的全面实验验证了该框架的有效性和优越性。

原文摘要 · Abstract (English)

Few-shot class-incremental learning is crucial for developing scalable and adaptive intelligent systems, as it enables models to acquire new classes with minimal annotated data while safeguarding the previously accumulated knowledge. Nonetheless, existing methods deal with continuous data streams in a centralized manner, limiting their applicability in scenarios that prioritize data privacy and security. To this end, this paper introduces federated few-shot class-incremental learning, a decentralized machine learning paradigm tailored to progressively learn new classes from scarce data distributed across multiple clients. In this learning paradigm, clients locally update their models with new classes while preserving data privacy, and then transmit the model updates to a central server where they are aggregated globally. However, this paradigm faces several issues, such as difficulties in few-shot learning, catastrophic forgetting, and data heterogeneity. To address these challenges, we present a synthetic data-driven framework that leverages replay buffer data to maintain existing knowledge and facilitate the acquisition of new knowledge. Within this framework, a noise-aware generative replay module is developed to fine-tune local models with a balance of new and replay data, while generating synthetic data of new classes to further expand the replay buffer for future tasks. Furthermore, a class-specific weighted aggregation strategy is designed to tackle data heterogeneity by adaptively aggregating class-specific parameters based on local models performance on synthetic data. This enables effective global model optimization without direct access to client data. Comprehensive experiments across three widely-used datasets underscore the effectiveness and preeminence of the introduced framework.

联邦学习少样本学习增量学习数据异构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。