arXiv:2509.10436cs.CL2025-09被引 5

提出云边协同架构,提升多领域编程问题求解能力。

RefactorCoderQA: Benchmarking LLMs for Multi-Domain Coding Question Solutions in Cloud and Edge Deployment

  • 云边协同三模块:边缘轻量引导、云端强力求解、自动评估。
  • 在多领域编程任务上达到76.84%准确率,优于所有基线。
  • 适合关注实际部署中代码生成性能的研究者与开发者。

为优化大语言模型的推理与解题能力,本文提出一种新型云边协同架构,支持结构化的多智能体提示框架。该框架包含三个专用组件:部署于边缘的轻量级引导模型GuideLLM,负责方法论指导;部署于云端的高性能求解模型SolverLLM,负责生成代码解决方案;以及自动化评估模型JudgeLLM,用于评估解法正确性与质量。为评估该架构在真实场景中的有效性,本文构建了RefactorCoderQA基准,涵盖软件工程、数据科学、机器学习和自然语言处理等多技术领域,使用来自Stack Overflow的真实编程挑战。基于DeepSeek-Coder-7B-Instruct,采用QLoRA微调得到RefactorCoder-MoE混合专家模型,专用于该基准。大量实验表明,RefactorCoder-MoE整体准确率达76.84%,显著优于所有评估的开源与商业基线。

原文摘要 · Abstract (English)

To optimize the reasoning and problem-solving capabilities of Large Language Models (LLMs), we propose a novel cloud-edge collaborative architecture that enables a structured multi-agent prompting framework. This framework comprises three specialized components: GuideLLM, a lightweight model deployed at the edge to provide methodological guidance; SolverLLM, a more powerful model hosted in the cloud and responsible for generating code solutions; and JudgeLLM, an automated evaluator for assessing solution correctness and quality. To evaluate and demonstrate the effectiveness of this architecture in realistic settings, we introduce RefactorCoderQA, a comprehensive benchmark designed to evaluate and enhance the performance of LLMs across multi-domain coding tasks. Motivated by the limitations of existing benchmarks, RefactorCoderQA systematically covers multiple technical domains, including Software Engineering, Data Science, Machine Learning, and Natural Language Processing, using authentic coding challenges sourced from Stack Overflow. We propose RefactorCoder-MoE, a fine-tuned mixture-of-experts (MoE) code language model based on DeepSeek-Coder-7B-Instruct, adapted to the RefactorCoderQA benchmark using QLoRA for domain-specific coding question answering. Extensive experiments demonstrate that RefactorCoder-MoE achieves strong and competitive performance, significantly outperforming all evaluated open-source and commercial baselines, with an overall accuracy of 76.84%.

代码生成云边协同多领域

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。