让大模型用土耳其思维推理,而非翻译成英语再解题。
TUDUM: A Turkish-Thinking Reasoning Pipeline for Qwen3.5-27B
- 将思考过程设为可训练行为,全程使用土耳其语生成推理链。
- 微调后响应变短、思维更连贯,数学基准成绩略有下降。
- 适合关注多语言推理机制与本土化模型调优的研究者。
本文提出TUDUM(Türkçe Düşünen Üretken Model),一个针对Qwen家族270亿参数模型的土耳其语推理适配管道。核心挑战不仅是用土耳其语回答土耳其语提问,更要使推理过程本身具有土耳其思维特征。传统方法可能将问题翻译成英文内部处理,仅在最终答案本地化。TUDUM则将块视为可训练行为,从unsloth/Qwen3.5-27B基础模型出发,基于15,991个土耳其语推理样本使用LoRA适配器进行监督微调(SFT),随后在代理筛选的土耳其数学环境上应用GRPO类强化学习。结果表明:SFT使模型输出更短、思维更一致,平均响应长度和思维耗竭显著降低,但基准准确率下降;强化学习部分恢复了数学能力,尤其在AIME24上最佳早期检查点表现突出,但未统一提升所有基准,且未超越基础模型在报告的Macro-6平均分上的表现。因此,该工作更应被视为技术透明的土耳其语推理管道与评估,而非顶尖性能宣言。发布的step-50模型已公开。
原文摘要 · Abstract (English)
This paper presents TUDUM (Türkçe Düşünen Üretken Model), a project pipeline for adapting a Qwen-family 27B thinking model toward Turkish reasoning. The central problem is not only to answer Turkish prompts in Turkish, but to make the explicit reasoning trace itself Turkish. A thinking model may translate a Turkish prompt into an English-centered internal or visible scratchpad, solve the problem mostly in English, and only localize the final answer. TUDUM instead treats the generated <think>...</think> block as a trainable behavior. The pipeline starts from the project base checkpoint unsloth/Qwen3.5-27B, applies supervised fine-tuning (SFT) on 15,991 Turkish reasoning examples using LoRA adapters, and then applies GRPO-family reinforcement learning on a proxy-filtered Turkish mathematics environment. The results are mixed. SFT made the model shorter and more consistently Turkish in its reasoning behavior, with large reductions in average response length and thinking exhaustion, but reduced benchmark accuracy. RL recovered some mathematical performance, especially AIME24 at the best early checkpoint, yet did not uniformly improve all benchmarks and did not exceed the base model on the reported Macro-6 average. The contribution is therefore best framed as a technically honest Turkish-thinking reasoning pipeline and evaluation, not as a claim of state-of-the-art Turkish reasoning. The released step-50 model is publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。