arXiv:2604.16778cs.LGcs.AI2026-04被引 1

多智能体通过共享思考过程,集体生成可复用的推理智慧库。

Federation over Text: Insight Sharing for Multi-Agent Reasoning

  • 各智能体独立思考并分享推理轨迹,不传原始任务数据。
  • 跨任务提升25%表现,减少4%推理令牌消耗,科研洞察覆盖超80%关键成果。
  • 适合需要跨领域协作与持续优化的复杂推理场景。

我们提出一种类联邦学习框架——文本联邦(Federation over Text, FoT),使多个解决不同任务的客户端能够通过迭代共享本地推理过程,共同构建一个跨任务、跨领域的元认知洞察知识库,而无需交换实际问题或任务指令。与基于梯度的联邦学习不同,FoT在语义层面运作,不依赖梯度优化或监督信号。每个客户端运行大模型代理,在各自任务上独立进行思考与自我改进,并将推理轨迹上传至中心服务器,由其聚合并提炼出通用洞察库,供现有及未来智能体复用以提升性能。实验表明,FoT在数学求解、跨域协作、日常任务及机器学习研究洞察发现等挑战性应用中均显著提升推理效果与效率。在前三个应用中,平均性能提升25%,推理令牌减少4%;在研究洞察发现任务中,生成的洞察覆盖后续论文中超过80%的核心贡献。

原文摘要 · Abstract (English)

We propose a federated learning-like framework, Federation over Text (FoT), that enables multiple clients solving different tasks to collectively generate a shared library of metacognitive insights by iteratively federating their local reasoning processes without sharing actual problem instances or task instructions. Instead of federation over gradients (e.g., as in distributed training), FoT operates at the semantic level without any gradient optimization or supervision signal. Iteratively, each client runs an LLM agent that does local thinking and self-improvement on their specific tasks independently, and shares reasoning traces with a central server, which aggregates and distills them into a cross-task (and cross-domain) insight library that existing and future agents can leverage to improve performance on related tasks. Experiments show that FoT improves reasoning effectiveness and efficiency across a wide range of challenging applications, including mathematical problem solving, cross-domain collaboration, real-world daily tasks, and machine learning research insight discovery. Specifically, it improves average performance scores by 25% while reducing the reasoning tokens by 4% across the first three applications. In the research insight discovery application, FoT is able to generate insights that cover over 80% of the major contributions in the subsequent papers.

多智能体推理增强知识共享

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。