让大模型自创符号语言,用精简协议提升多智能体推理效率。
When LLMs Develop Languages: Symbolic Communication for Efficient Multi-Agent Reasoning

- 多智能体自主发明并进化紧凑的符号语言框架,通过纠错与成本优化迭代改进。
- 相比标准链式思维,生成令牌数减少3~6倍,推理延迟显著降低。
- 适合需要高效推理的场景,如实时决策、资源受限部署。
链式思维(CoT)虽能提升大语言模型在复杂推理任务上的表现,但常伴随冗长自然语言推理过程,与高效机器推理不匹配。本文提出通信语言符号路由(CLSR)框架,在推理时让多个大模型智能体自主发明、演化并共享紧凑的語言符號框架(LSFs)。一个无隐变量的路由器根据查询动态选择并组合这些语言,以优化准确率与令牌消耗的权衡。不同于仅优化提示词表面结构的方法,CLSR将每个LSF视为可复用的符号协议,包含紧凑符号、使用规则和消息传递契约,并通过正确性与令牌成本驱动的演化循环持续优化。推理时,路由器可调用单一低成本LSF、集成多个LSF,或对复杂任务执行多轮LSF组合协议。在多个挑战性基准测试中,CLSR将面向延迟的生成令牌量减少3~6倍,同时保持高准确率。我们进一步推导出任意符号体系下的令牌成本信息论下界,并在解释器可实现的前提下证明:多轮LSF协议在条件上超越程序执行流水线。
原文摘要 · Abstract (English)
Chain-of-Thought (CoT) improves large language models (LLMs) on difficult reasoning tasks, but it often incurs long natural-language rationales that are poorly aligned with efficient machine reasoning. We propose Communicative Language Symbolism Routing (CLSR), a test-time framework in which multiple LLM agents autonomously invent, evolve, and share compact Language Symbolism Frameworks (LSFs), while a latent-free router adaptively selects and composes these languages per query to optimize the accuracy-token trade-off. Unlike prompt optimization that refines surface instructions, CLSR treats each LSF as a reusable symbolic protocol with compact symbols, usage rules, and a message-passing contract, and improves it through an evolutionary loop driven by correctness and token cost. At inference time, the router may invoke a single low-cost LSF call, ensemble multiple LSFs, or execute a multi-round LSF composition protocol on harder queries. Across challenging benchmarks, CLSR reduces latency-oriented generated token completion by $3\sim 6\times$ compared to standard CoT while maintaining accuracy. We further derive an information-theoretic lower bound on token cost under arbitrary symbolism and show that, under an interpreter-realizability premise, multi-round LSF protocols conditionally subsume program-execution pipelines. Code is publicly available (https://github.com/pzqpzq/LSF_MDia).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。