将MMLU数据集本地化为11种欧洲语言，提升大模型评估的包容性。
Building a European Multilingual Evaluation Dataset: The MMLU Localisation Project within the EMT Network
- 联合翻译机构与硕士项目，将MMLU多语言本地化
- 覆盖11种欧洲语言，支持跨语言模型评估
- 为学生提供真实翻译项目实训，适合语言技术教育者
本文报告了欧盟翻译总署（DGT）与欧洲翻译硕士项目（EMT）合作，将MMLU数据集本地化为11种欧洲语言的过程。该项目不仅构建了更具包容性的大语言模型评估基准，还为硕士生提供了真实的翻译、校对、项目管理与多语协调的实践训练，同时揭示了方法论、行政管理与工作流程中的关键挑战。
原文摘要 · Abstract (English)
This paper reports on a collaboration between the Directorate-General for Translation (DGT) and the European Master's in Translation (EMT) to localise the MMLU dataset into 11 European languages. Beyond creating a more inclusive benchmark for LLM evaluation, the project offers master's students authentic, project-based professional training in translation, revision, project management, and multilingual coordination, while highlighting key methodological, administrative, and workflow challenges.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。