24B小模型在代码代理任务中表现媲美百倍大的模型
Devstral: Fine-tuning Language Models for Coding Agent Applications
- 针对代码代理任务微调轻量级24B模型
- 性能超越多数超100B的大模型
- 适合资源有限但需高效编码的开发者
我们提出 Devstral-Small，一款面向代码代理应用的轻量开源模型，在参数量低于100B的模型中表现最优。本技术报告概述了模型的设计与开发过程，重点在于为智能软件开发构建专用能力。最终模型为24B参数规模，具备快速部署和易服务特性。尽管体积小，其性能仍可与超过其十倍大小的模型相媲美。
原文摘要 · Abstract (English)
We introduce Devstral-Small, a lightweight open source model for code agents with the best performance among models below 100B size. In this technical report, we give an overview of how we design and develop a model and craft specializations in agentic software development. The resulting model, Devstral-Small is a small 24B model, fast and easy to serve. Despite its size, Devstral-Small still attains competitive performance compared to models more than an order of magnitude larger.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。