arXiv:2605.09855cs.LG2026-05

让合成数据动态优化,提升联邦学习中文本任务表现。

Concordia: Self-Improving Synthetic Tables for Federated LLMs

论文配图:Concordia: Self-Improving Synthetic Tables for Federated LLMs
图 1 · 摘自论文原文
  • 三层次优化框架,合成数据与本地评估反馈联动更新。
  • 在金融医疗数据上,性能优于静态合成数据基线。
  • 适合隐私敏感场景下跨客户端稳定训练的团队使用。

联邦学习(FL)可在不共享原始数据的情况下训练大语言模型(LLMs),但在严格数据隔离和非独立同分布(non-IID)客户端分布下,适应LLM仍具挑战。合成数据可作为本地训练的隐私保护替代,但现有联邦流程通常将合成生成视为静态或松散耦合,导致异构客户端下效用迅速下降。本文研究在无法共享原始记录与验证数据的条件下,基于合成表格的联邦LLM适配问题。提出Concordia,一种三层次优化框架,即使在约束下也能对齐合成数据生成与联邦验证效用。客户端通过参数高效的LoRA在合成表格上微调模型,并基于私有验证反馈学习轻量级效用评分器,以重加权合成样本。外层采用组相对策略优化(GRPO),各客户端独立优化自身合成生成器,由跨客户端共享的异构评分器指导,无需聚合生成器参数或暴露验证数据。在金融与医疗领域的隐私敏感表格基准上实验表明,Concordia显著提升了联邦性能、跨客户端稳定性及对分布偏移的鲁棒性,优于静态与解耦合成数据基线。

原文摘要 · Abstract (English)

Federated learning (FL) enables training large language models (LLMs) without sharing raw data, but adapting LLMs under strict data isolation and non-IID client distributions remains challenging in practice. Synthetic data offers a natural privacy-preserving surrogate for local training, yet existing federated pipelines typically treat synthetic generation as static or loosely coupled with downstream optimization, leading to rapidly diminishing utility under heterogeneous clients. We study federated adaptation of LLMs on tabular tasks where raw records and validation data cannot be shared, and local training must rely entirely on synthetic tables. We propose Concordia, a tri-level optimization framework that aligns synthetic data generation with federated validation utility despite these constraints. At the client level, models are adapted via parameter-efficient LoRA training on synthetic tables. Clients additionally learn lightweight utility scorers from private validation feedback to reweight synthetic samples during local training. At the outer level, each client refines its own synthetic table generator using group-relative policy optimization (GRPO), guided by an ensemble of heterogeneous scorers shared across clients, without aggregating generator parameters or exposing validation data. Experiments on privacy-sensitive tabular benchmarks from finance and healthcare demonstrate that Concordia consistently improves federated performance, cross-client stability, and robustness to distribution shift compared to static and decoupled synthetic-data baselines.

联邦学习合成数据LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。