IQuest-Coder-V1通过动态代码流训练,提升代码智能与自主编程能力。
IQuest-Coder-V1 Technical Report
- 采用代码流多阶段训练,捕捉软件逻辑演化过程。
- 在32k和128k上下文实现推理与代理轨迹融合,增强逻辑基础。
- 支持推理与指令双路径,适用于复杂编程与自动化系统开发。
本文介绍 IQuest-Coder-V1 系列(7B/14B/40B/40B-Loop)新型代码大模型。突破静态代码表征,提出代码流多阶段训练范式,通过流水线不同阶段捕捉软件逻辑的动态演化。模型经由演进式流程构建:初始预训练包含代码事实、代码库与补全数据;随后引入中段训练,结合32k上下文的推理与代理轨迹,以及128k上下文的代码库级训练,建立深层逻辑基础;最终通过后训练阶段,分两条专精路径完成:思考路径(基于推理驱动强化学习)与指令路径(优化通用辅助能力)。IQuest-Coder-V1 在代理软件工程、竞赛编程与复杂工具使用等关键维度上达到当前最优性能。为应对部署约束,40B-Loop 版本引入循环机制,优化模型容量与部署开销的平衡,提供高效能-效率权衡的新架构路径。我们公开从预训练基底到最终思考与指令模型的完整白盒检查点,推动自主代码智能与真实代理系统的研究进展。
原文摘要 · Abstract (English)
In this report, we introduce the IQuest-Coder-V1 series-(7B/14B/40B/40B-Loop), a new family of code large language models (LLMs). Moving beyond static code representations, we propose the code-flow multi-stage training paradigm, which captures the dynamic evolution of software logic through different phases of the pipeline. Our models are developed through the evolutionary pipeline, starting with the initial pre-training consisting of code facts, repository, and completion data. Following that, we implement a specialized mid-training stage that integrates reasoning and agentic trajectories in 32k-context and repository-scale in 128k-context to forge deep logical foundations. The models are then finalized with post-training of specialized coding capabilities, which is bifurcated into two specialized paths: the thinking path (utilizing reasoning-driven RL) and the instruct path (optimized for general assistance). IQuest-Coder-V1 achieves state-of-the-art performance among competitive models across critical dimensions of code intelligence: agentic software engineering, competitive programming, and complex tool use. To address deployment constraints, the IQuest-Coder-V1-Loop variant introduces a recurrent mechanism designed to optimize the trade-off between model capacity and deployment footprint, offering an architecturally enhanced path for efficacy-efficiency trade-off. We believe the release of the IQuest-Coder-V1 series, including the complete white-box chain of checkpoints from pre-training bases to the final thinking and instruction models, will advance research in autonomous code intelligence and real-world agentic systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。