提出KNEXA-FL框架,让大模型在不共享数据情况下高效协作。
Learning to Collaborate: An Orchestrated-Decentralized Framework for Peer-to-Peer LLM Federation
- 用上下文无关的匹配算法动态选择最佳模型搭档
- 代码生成任务中性能提升约50%,且训练更稳定
- 适合需要隐私保护的跨机构智能协作场景
为解决专用领域大语言模型微调中的数据隐私与异构性难题,本文提出KNEXA-FL——一种协同去中心化联邦学习框架。该框架引入非聚合式中央画像匹配器(CPM),将模型间协作建模为上下文相关多臂赌博机问题,采用LinUCB算法基于抽象代理画像学习最优配对策略。通过安全蒸馏实现异构PEFT-LMM间的直接知识传递,全程不访问原始模型。在挑战性代码生成任务上,相比随机配对,Pass@1提升约50%;且其自适应协调机制确保稳定收敛,显著优于存在灾难性崩溃风险的集中式蒸馏基线。本工作确立了学习驱动的动态协调机制,是构建鲁棒去中心化AI生态的核心原则。
原文摘要 · Abstract (English)
Fine-tuning Large Language Models (LLMs) for specialized domains is constrained by a fundamental challenge: the need for diverse, cross-organizational data conflicts with the principles of data privacy and sovereignty. While Federated Learning (FL) provides a framework for collaboration without raw data exchange, its classic centralized form introduces a single point of failure and remains vulnerable to model inversion attacks. Decentralized FL (DFL) mitigates this risk by removing the central aggregator but typically relies on inefficient, random peer-to-peer (P2P) pairings, forming a collaboration graph that is blind to agent heterogeneity and risks negative transfer. This paper introduces KNEXA-FL, a novel framework for orchestrated decentralization that resolves this trade-off. KNEXA-FL employs a non-aggregating Central Profiler/Matchmaker (CPM) that formulates P2P collaboration as a contextual bandit problem, using a LinUCB algorithm on abstract agent profiles to learn an optimal matchmaking policy. It orchestrates direct knowledge exchange between heterogeneous, PEFT-based LLM agents via secure distillation, without ever accessing the models themselves. Our comprehensive experiments on a challenging code generation task show that KNEXA-FL yields substantial gains, improving Pass@1 by approx. 50% relative to random P2P collaboration. Critically, our orchestrated approach demonstrates stable convergence, in stark contrast to a powerful centralized distillation baseline which suffers from catastrophic performance collapse. Our work establishes adaptive, learning-based orchestration as a foundational principle for building robust and effective decentralized AI ecosystems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。