arXiv:2505.11107cs.AI2025-05被引 23

让大模型同时扮演多个思考者,实时协作提升推理质量与速度

Group Think: Multiple Concurrent Reasoning Agents Collaborating at Token Level Granularity

  • 同一模型内并行多个思考线程,以令牌为单位动态协作
  • 相比串行推理,延迟降低且冗余减少,质量反而提升
  • 适合边缘设备,可零成本改造现有模型使用

大型语言模型(LLM)通过自生成思维链展现出强大推理能力。多个推理代理协同可超越个体表现,但传统方式多采用轮询交互,虽提升质量却增加延迟。本文提出 Group Think——一个单一模型模拟多个并发推理代理(思考者)的机制。各代理共享部分生成进展,可在令牌级别动态调整推理路径。例如,某条线索在生成中途发现另一条更优,可即时切换。这种细粒度协作减少冗余,提升质量并显著降低延迟。其并发特性还能高效利用闲置计算资源,特别适合边缘推理场景,因小批量时本地GPU常利用率低。我们提出一种简单通用的修改方法,使任意现有LLM可在本地GPU上实现Group Think。还设计评估策略,实证验证了开源模型在未专门训练的情况下仍能获得延迟改进。本工作为未来大模型实现更智能、高效的协同推理提供新路径。

原文摘要 · Abstract (English)

Recent advances in large language models (LLMs) have demonstrated the power of reasoning through self-generated chains of thought. Multiple reasoning agents can collaborate to raise joint reasoning quality above individual outcomes. However, such agents typically interact in a turn-based manner, trading increased latency for improved quality. In this paper, we propose Group Think--a single LLM that acts as multiple concurrent reasoning agents, or thinkers. With shared visibility into each other's partial generation progress, Group Think introduces a new concurrent-reasoning paradigm in which multiple reasoning trajectories adapt dynamically to one another at the token level. For example, a reasoning thread may shift its generation mid-sentence upon detecting that another thread is better positioned to continue. This fine-grained, token-level collaboration enables Group Think to reduce redundant reasoning and improve quality while achieving significantly lower latency. Moreover, its concurrent nature allows for efficient utilization of idle computational resources, making it especially suitable for edge inference, where very small batch size often underutilizes local~GPUs. We give a simple and generalizable modification that enables any existing LLM to perform Group Think on a local GPU. We also present an evaluation strategy to benchmark reasoning latency and empirically demonstrate latency improvements using open-source LLMs that were not explicitly trained for Group Think. We hope this work paves the way for future LLMs to exhibit more sophisticated and more efficient collaborative behavior for higher quality generation.

推理协作并发思考边缘推理令牌级

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。