构建首个孟加拉语-英语技术术语平行语料库,提升孟加拉语技术问题翻译准确率。
BanglaSTEM: A Parallel Corpus for Technical Domain Bangla-English Translation
- 收集5000对孟加拉语-英语科技句对,聚焦理工科领域
- 基于T5模型训练后,在代码生成与数学求解任务中显著提升翻译精度
- 适合需用英文大模型解决孟加拉语技术问题的研究者与开发者
大型语言模型在英文技术问题求解中表现良好,但在孟加拉语提问时效果差。简单方法是先将孟加拉语问题翻译成英文再使用模型,但现有系统难以准确处理专业术语,常导致语义偏差和错误答案。本文提出BanglaSTEM,一个包含5000组从计算机科学、数学、物理、化学和生物学等领域精选的孟加拉语-英语句子对的平行语料库。通过语言模型生成超过12000组翻译,并由人工评估筛选出高质量对以确保技术术语正确性。我们基于T5训练了翻译模型,并在代码生成和数学问题求解两个任务上进行测试,结果显示技术内容翻译准确率显著提升,使孟加拉语使用者能更有效地利用面向英文的大模型。该数据集及训练好的模型已公开发布于https://huggingface.co/reyazul/BanglaSTEM-T5。
原文摘要 · Abstract (English)
Large language models work well for technical problem solving in English but perform poorly when the same questions are asked in Bangla. A simple solution would be to translate Bangla questions into English first and then use these models. However, existing Bangla-English translation systems struggle with technical terms. They often mistranslate specialized vocabulary, which changes the meaning of the problem and leads to wrong answers. We present BanglaSTEM, a dataset of 5,000 carefully selected Bangla-English sentence pairs from STEM fields including computer science, mathematics, physics, chemistry, and biology. We generated over 12,000 translations using language models and then used human evaluators to select the highest quality pairs that preserve technical terminology correctly. We train a T5-based translation model on BanglaSTEM and test it on two tasks: generating code and solving math problems. Our results show significant improvements in translation accuracy for technical content, making it easier for Bangla speakers to use English-focused language models effectively. Both the BanglaSTEM dataset and the trained translation model are publicly released at https://huggingface.co/reyazul/BanglaSTEM-T5.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。