arXiv:2605.10082cs.CLcs.LG2026-05被引 1

让大模型在不共享数据前提下,靠多方协作提升推理能力。

FERA: Uncertainty-Aware Federated Reasoning for Large Language Models

论文配图:FERA: Uncertainty-Aware Federated Reasoning for Large Language Models
图 1 · 摘自论文原文
  • 通过迭代式协同优化,客户端生成带不确定性估计的推理过程,服务端融合改进后反馈
  • 多轮实验显示准确率持续提升,较基线最高提高12.3个百分点
  • 适合隐私敏感场景,如医疗、金融领域的大模型协作推理

大语言模型在高质量示范引导下展现出强大推理能力,但这类数据常分散于受监管、保密或机构限制无法集中。本文研究联邦推理:服务器在不进行集中训练或共享原始数据的前提下,协调持有私有示范的异构客户端以改进多步推理。核心挑战在于客户端可靠性依赖于具体查询,而服务器无法访问其数据来判断可信度。为此,提出无需训练的不确定性感知联邦推理(FERA)框架,基于迭代式服务器-客户端共同优化。每轮中,客户端生成带轻量级不确定性估计的推理路径,服务器将其合成更优推理结果并作为上下文回传,逐步提升服务器输出与客户端推理质量。每轮内采用不确定性感知自省聚合(UA-SCA),通过查询相关信任加权和结构化跨客户端验证解决异构推理路径冲突,不简单丢弃低质路径,而是修正错误步骤以恢复有效信息。理论证明该迭代协议收敛,且不确定性加权加速收敛。多个推理基准测试表明,FERA始终优于联邦训练与无训练基线,在保持通信与计算效率的同时,准确率随轮次持续提升。

原文摘要 · Abstract (English)

Large language models (LLMs) exhibit strong reasoning capabilities when guided by high-quality demonstrations, yet such data is often distributed across organizations that cannot centralize it due to regulatory, proprietary, or institutional constraints. We study federated reasoning, where a server improves multi-step reasoning by coordinating with heterogeneous clients holding private demonstrations, without centralized training or raw data sharing. The key challenge is that client reliability is query-dependent, while the server cannot inspect client data to determine which contributions are trustworthy. To address this, we propose Uncertainty-Aware Federated Reasoning (FERA), a training-free framework based on iterative server-client co-refinement. Across communication rounds, clients generate reasoning traces with lightweight uncertainty estimates, and the server synthesizes them into improved reasoning that is redistributed as context for the next round, progressively improving both server outputs and client-side reasoning. Within each round, Uncertainty-Aware Self-Critique Aggregation (UA-SCA) resolves conflicts among heterogeneous client traces through query-dependent trust weighting and structured cross-client verification. Rather than simply discarding low-quality traces, UA-SCA revises flawed reasoning steps to recover useful information. We provide theoretical guarantees showing that the proposed iterative protocol converges and that uncertainty-aware weighting accelerates convergence. Experiments on multiple reasoning benchmarks show that FERA consistently outperforms both federated training and training-free baselines, achieving progressively higher accuracy across rounds while maintaining communication and computational efficiency.

联邦学习大模型推理不确定性建模隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。