arXiv:2410.13181cs.CL2024-10EMNLP被引 5

让本地小模型和云端大模型智能协作,提升推理效率与效果。

AdaSwitch: Adaptive Switching between Small and Large Agents for Effective Cloud-Local Collaborative Learning

  • 小模型自主识别错误并请求大模型协助,实现动态切换
  • 在7个基准上显著提升本地模型性能,接近云端效果
  • 适合资源受限场景下追求高效高质推理的用户

大语言模型(LLM)发展迅速,用户面临抉择:使用云端大模型获取高质量生成结果,或部署本地小模型降低计算成本。前者通常代价高且低效,后者在需要深度思考的任务中表现不佳。本文提出一种新型的协同学习范式——AdaSwitch,通过本地小模型与云端大模型协作,分别处理简单与复杂推理任务。本地代理基于较小的LLM,负责轻量级推理;云端代理配备更大的LLM,处理复杂任务。两者通过自适应机制协同:本地代理可自我检测错误并主动请求云端协助,从而有效结合两地优势,显著提升任务完成率与效率。我们在7个基准上进行了评估,涵盖数学推理与复杂问答任务,使用多种类型LLM作为本地与云端代理。实验证明,AdaSwitch能显著提升本地模型性能,在部分任务中达到与云端模型相当的效果,同时大幅降低计算开销。

原文摘要 · Abstract (English)

Recent advancements in large language models (LLMs) have been remarkable. Users face a choice between using cloud-based LLMs for generation quality and deploying local-based LLMs for lower computational cost. The former option is typically costly and inefficient, while the latter usually fails to deliver satisfactory performance for reasoning steps requiring deliberate thought processes. In this work, we propose a novel LLM utilization paradigm that facilitates the collaborative operation of large cloud-based LLMs and smaller local-deployed LLMs. Our framework comprises two primary modules: the local agent instantiated with a relatively smaller LLM, handling less complex reasoning steps, and the cloud agent equipped with a larger LLM, managing more intricate reasoning steps. This collaborative processing is enabled through an adaptive mechanism where the local agent introspectively identifies errors and proactively seeks assistance from the cloud agent, thereby effectively integrating the strengths of both locally-deployed and cloud-based LLMs, resulting in significant enhancements in task completion performance and efficiency. We evaluate AdaSwitch across 7 benchmarks, ranging from mathematical reasoning and complex question answering, using various types of LLMs to instantiate the local and cloud agents. The empirical results show that AdaSwitch effectively improves the performance of the local agent, and sometimes achieves competitive results compared to the cloud agent while utilizing much less computational overhead.

协同学习云边协同大模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。