用记忆共享实现跨设备协作学习,保护隐私还提效果
Social Hippocampus Memory Learning
- 以记忆为核心,通过类海马体机制抽象和融合知识
- 在两个数据集上最高提升8.78%准确率,优于7种基线方法
- 适合隐私敏感场景的异构设备协同学习
社交学习强调智能体通过互动与结构化知识交换来共同进步。将其引入机器学习催生了社会机器学习(SML),即多个智能体通过共享抽象知识协同学习。联邦学习(FL)为该范式提供了天然协作基础,但现有异构FL方法通常依赖共享模型参数或中间表示,可能泄露敏感信息并增加开销。本文提出SoHip(Social Hippocampus Memory Learning),一种以记忆为中心的社会机器学习框架,使异构智能体通过共享记忆而非模型进行协作。SoHip从本地表示中抽象个体短期记忆,通过类海马体机制整合为长期记忆,并与聚合的集体长期记忆融合以增强本地预测。整个过程保持原始数据和本地模型在设备端,仅交换轻量级记忆。我们提供了收敛性和隐私保护的理论分析。在两个基准数据集上与七种基线对比的实验表明,SoHip持续优于现有方法,最高实现8.78%的准确率提升。
原文摘要 · Abstract (English)
Social learning highlights that learning agents improve not in isolation, but through interaction and structured knowledge exchange with others. When introduced into machine learning, this principle gives rise to social machine learning (SML), where multiple agents collaboratively learn by sharing abstracted knowledge. Federated learning (FL) provides a natural collaboration substrate for this paradigm, yet existing heterogeneous FL approaches often rely on sharing model parameters or intermediate representations, which may expose sensitive information and incur additional overhead. In this work, we propose SoHip (Social Hippocampus Memory Learning), a memory-centric social machine learning framework that enables collaboration among heterogeneous agents via memory sharing rather than model sharing. SoHip abstracts each agent's individual short-term memory from local representations, consolidates it into individual long-term memory through a hippocampus-inspired mechanism, and fuses it with collectively aggregated long-term memory to enhance local prediction. Throughout the process, raw data and local models remain on-device, while only lightweight memory are exchanged. We provide theoretical analysis on convergence and privacy preservation properties. Experiments on two benchmark datasets with seven baselines demonstrate that SoHip consistently outperforms existing methods, achieving up to 8.78% accuracy improvements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。