arXiv:2604.20996cs.CL2026-04被引 1

用19万条词典构建AI语言导师,助力非洲低资源语言学习。

AFRILANGTUTOR: Advancing Language Tutoring and Culture Education in Low-Resource Languages with Large Language Models

论文配图:AFRILANGTUTOR: Advancing Language Tutoring and Culture Education in Low-Resource Languages with Large Language Models
图 1 · 摘自论文原文
  • 基于19.47万条词典自动生成多轮问答数据,支持语言教学训练。
  • 在10种非洲语言上微调模型,性能提升最高达15.5%。
  • 开源全部数据与模型,推动低资源语言AI研究发展。

如何为缺乏足够训练资源的语言开发语言学习系统?这一挑战在非洲大陆日益突出,开发者亟需能理解并回应本土语言的AI系统。为此,我们提出AFRILANGDICT,包含194.7万条非洲语言-英语词典条目,作为生成语言学习材料的种子资源,可自动构建大规模、多样且可验证的学生-导师问答交互数据,用于训练AI辅助语言导师。基于AFRILANGDICT,我们构建了AFRILANGEDU数据集,包含78.9万条多轮训练样本,适用于监督微调(SFT)和直接偏好优化(DPO)。利用AFRILANGEDU,我们训练了统称为AFRILANGTUTOR的语言教学模型。在10种非洲语言上对Llama-3-8B-IT和Gemma-3-12B-IT两个多语言大模型进行微调,并评估其表现。结果表明,经训练的模型均显著优于基线模型,结合SFT与DPO带来明显提升,在四种评估维度下,改进幅度达1.8%至15.5%。为促进低资源语言研究,所有资源已公开于https://huggingface.co/afrilang-edu。

原文摘要 · Abstract (English)

How can language learning systems be developed for languages that lack sufficient training resources? This challenge is increasingly faced by developers across the African continent who aim to build AI systems capable of understanding and responding in local languages. To address this gap, we introduce AFRILANGDICT, a collection of 194.7K African language-English dictionary entries designed as seed resources for generating language-learning materials, enabling us to automatically construct large-scale, diverse, and verifiable student-tutor question-answer interactions suitable for training AI-assisted language tutors. Using AFRILANGDICT, we build AFRILANGEDU, a dataset of 78.9K multi-turn training examples for Supervised Fine-Tuning (SFT) and Direct Preference Optimization (DPO). Using AFRILANGEDU, we train language tutoring models collectively referred to as AFRILANGTUTOR. We fine-tune two multilingual LLMs: Llama-3-8B-IT and Gemma-3-12B-IT on AFRILANGEDU across 10 African languages and evaluate their performance. Our results show that models trained on AFRILANGEDU consistently outperform their base counterparts, and combining SFT and DPO yields substantial improvements, with gains ranging from 1.8% to 15.5% under LLM-as-a-judge evaluations across four criteria. To facilitate further research on low-resource languages, all resources are available at https://huggingface.co/afrilang-edu.

语言教育低资源语言大模型应用非洲语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。