arXiv:2502.17882cs.AIcs.CL2025-02Conference of the …被引 18

用大模型自动翻译科学论文,保持格式且准确率达95.9%

Science Across Languages: Assessing LLM Multilingual Translation of Scientific Papers

  • 用LLM翻译论文并保留原JATS XML格式,实现自动化处理
  • 问答评测显示关键信息准确率平均达95.9%
  • 可适配领域偏好,解决术语过度翻译问题,适合期刊与研究者使用

科学研宄具有全球性,但绝大多数学术期刊仅以英语发表,对非英语母语研究者构成障碍。本研究利用大语言模型(LLMs)翻译已发表的科学论文,同时保留其原始的JATS XML格式,为学术期刊提供一种实用的自动化翻译方案。通过该方法,我们实现了跨多个学科领域向28种语言的论文翻译。为评估翻译准确性,引入一种新的基于问答(QA)的基准测试方法:由一个LLM从原文生成理解类问题,并基于译文回答。结果显示平均准确率达95.9%,表明关键科学内容被有效传达。在用户研究中,15位研究人员的论文被翻译为其母语,作者普遍认为译文准确传递了原文信息;但约三分之一作者指出部分术语存在“过度翻译”现象,更倾向保留熟悉的英文术语。最后,我们展示如何利用上下文学习技术,使翻译符合特定领域偏好,如减少术语翻译,凸显了LLM驱动科学翻译的可调适性与实用性。代码与译文见https://hankleid.github.io/ProjectMundo。

原文摘要 · Abstract (English)

Scientific research is inherently global. However, the vast majority of academic journals are published exclusively in English, creating barriers for non-native-English-speaking researchers. In this study, we leverage large language models (LLMs) to translate published scientific articles while preserving their native JATS XML formatting, thereby developing a practical, automated approach for implementation by academic journals. Using our approach, we translate articles across multiple scientific disciplines into 28 languages. To evaluate translation accuracy, we introduce a novel question-and-answer (QA) benchmarking method, in which an LLM generates comprehension-based questions from the original text and then answers them based on the translated text. Our benchmark results show an average performance of 95.9%, showing that the key scientific details are accurately conveyed. In a user study, we translate the scientific papers of 15 researchers into their native languages, finding that the authors consistently found the translations to accurately capture the original information in their articles. Interestingly, a third of the authors found many technical terms "overtranslated," expressing a preference to keep terminology more familiar in English untranslated. Finally, we demonstrate how in-context learning techniques can be used to align translations with domain-specific preferences such as mitigating overtranslation, highlighting the adaptability and utility of LLM-driven scientific translation. The code and translated articles are available at https://hankleid.github.io/ProjectMundo.

多语言科学翻译LLMJATS

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。