arXiv:2508.04745cs.LG2025-08

边缘侧协同微调,实现多用户个性化生成内容

Edge-Assisted Collaborative Fine-Tuning for Multi-User Personalized Artificial Intelligence Generated Content (AIGC)

  • 按用户需求相似性分组,本地用低秩适配微调模型
  • 组内聚合提升个性化,组间交互支持跨群体生成
  • 保护隐私且适合资源受限的边缘设备部署

扩散模型(DMs)在高质量内容生成中表现优异,但其推理计算开销大,难以在资源受限的边缘设备上运行。云端方案虽能缓解计算压力,却面临隐私泄露、个性化效率低和通信成本高的问题。为此,本文提出一种面向多用户边缘AIGC场景的聚类感知分层联邦聚合框架。基于低秩适配(LoRA)的参数高效微调,系统首先根据用户上传任务需求的相似性进行客户端聚类,再在组内执行聚合以增强服务端个性化;随后引入组间知识交互机制,实现跨集群混合式内容生成。该框架结合联邦学习,在设备端同时训练个性化模型,服务器端维护带多个LoRA适配器的共享全局模型,支持高效边缘推理;所有提示在传输前均经编码,降低明文泄露风险。实验表明,该方法在边缘约束下实现快速收敛,具备可扩展的多用户个性化AIGC服务能力。

原文摘要 · Abstract (English)

Diffusion models (DMs) have emerged as powerful tools for high-quality content generation, yet their intensive computational requirements for inference pose challenges for resource-constrained edge devices. Cloud-based solutions aid in computation but often fall short in addressing privacy risks, personalization efficiency, and communication costs in multi-user edge-AIGC scenarios. To bridge this gap, we first analyze existing edge-AIGC applications in personalized content synthesis, revealing their limitations in efficiency and scalability. We then propose a novel cluster-aware hierarchical federated aggregation framework. Based on parameter-efficient local fine-tuning via Low-Rank Adaptation (LoRA), the framework first clusters clients based on the similarity of their uploaded task requirements, followed by an intra-cluster aggregation for enhanced personalization at the server-side. Subsequently, an inter-cluster knowledge interaction paradigm is implemented to enable hybrid-style content generation across diverse clusters.Building upon federated learning (FL) collaboration, our framework simultaneously trains personalized models for individual users at the devices and a shared global model enhanced with multiple LoRA adapters on the server,enabling efficient edge inference; meanwhile, all prompts for clustering and inference are encoded prior to transmission, thereby further mitigating the risk of plaintext leakage. Our evaluations demonstrate that the framework achieves accelerated convergence while maintaining practical viability for scalable multi-user personalized AIGC services under edge constraints.

边缘计算AIGC联邦学习个性化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。