联邦推理中提升大模型思维链能力,兼顾效率与可解释性。
FedCoT: Communication-Efficient Federated Reasoning Enhancement for Large Language Models
- 本地生成多条推理路径,用轻量判别器选出最优解。
- 在医疗任务上显著提升推理准确率,通信开销更低。
- 适合对可解释性要求高的医疗等隐私敏感场景。
在联邦学习环境中高效提升大语言模型(LLM)的推理能力仍具挑战,尤其需在性能提升与严格的计算、通信及隐私约束间取得平衡。这一问题在医疗领域尤为突出,因临床、运营和患者交互决策不仅要求输出准确,还需可解释、可追溯的推理过程以确保安全、责任归属和合规性。传统联邦微调方法主要关注答案正确性,忽视推理过程质量,使思维链(CoT)能力依赖模型预训练水平。现有改进方法通常依赖违反隐私的知识蒸馏。此外,传统联邦微调在大模型上通信开销巨大。本文提出FedCoT,一种专为联邦环境设计的推理增强框架。该框架采用轻量级思维链增强机制:本地模型生成多条推理路径,由紧凑判别器动态选择最优路径,从而提升推理准确性和鲁棒性,并增强可解释性,这对医疗应用至关重要。为有效应对客户端异构性,采用改进的聚合方法,在先进LoRA模块堆叠基础上引入客户端分类器感知机制,实现无噪声跨客户端聚合。在医疗推理任务上的全面实验表明,FedCoT在严格资源预算下显著提升客户端推理性能,同时完全保护数据隐私。
原文摘要 · Abstract (English)
Efficiently enhancing the reasoning capabilities of large language models (LLMs) in federated learning environments remains challenging, particularly when balancing performance gains with strict computational, communication, and privacy constraints. This challenge is especially acute in healthcare, where decisions-spanning clinical, operational, and patient-facing contexts-demand not only accurate outputs but also interpretable, traceable rationales to ensure safety, accountability, and regulatory compliance. Conventional federated tuning approaches on LLM fail to address this need: they optimize primarily for answer correctness while neglecting rationale quality, leaving CoT capabilities dependent on models' innate pre-training abilities. Moreover, existing methods for improving rationales typically rely on privacy-violating knowledge distillation from centralized models. Additionally, the communication overhead in traditional federated fine-tuning on LLMs remains substantial. We addresses this gap by proposing FedCoT, a novel framework specifically designed to enhance reasoning in federated settings. FedCoT leverages a lightweight chain-of-thought enhancement mechanism: local models generate multiple reasoning paths, and a compact discriminator dynamically selects the most promising one. This approach improves reasoning accuracy and robustness while providing valuable interpretability, which is particularly critical for medical applications. To manage client heterogeneity efficiently, we adopt an improved aggregation approach building upon advanced LoRA module stacking, incorporating client classifier-awareness to achieve noise-free aggregation across diverse clients. Comprehensive experiments on medical reasoning tasks demonstrate that FedCoT significantly boosts client-side reasoning performance under stringent resource budgets while fully preserving data privacy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。