Gemini翻译奥斯曼帝国历史文献时,14%~23%内容因安全机制被屏蔽
LLMs for Translation: Historical, Low-Resourced Languages and Contemporary AI Models
- 用Gemini翻译18世纪奥斯曼土耳其战俘日记,测试其处理敏感历史文本能力
- 14%至23%原文因含暴力描述被标记为有害,导致无法翻译
- 揭示当前大模型安全机制对历史文献翻译的过度干预问题
大型语言模型(LLMs)在无需显式训练的情况下展现出强大的多任务适应能力,包括机器翻译(MT)。GPT-4和Gemini等模型常被用于翻译基准测试并作为翻译工具。本文研究Gemini在将18世纪奥斯曼土耳其手稿《异教徒之囚:蒂米索拉的奥斯曼阿加回忆录》译为英文时的表现。该手稿记录了奥斯曼人奥斯曼阿加在奥地利被俘11年的经历,包含对战争与暴力的详细叙述。分析显示,Gemini的安全机制将其中14%至23%的内容标记为有害,导致部分段落无法翻译。尽管这些安全设置能有效减少潜在危害,却严重削弱了模型对历史文本进行完整、准确翻译的能力。通过真实历史案例,本研究揭示了当前LLM安全机制在处理敏感且富含背景信息材料时的固有局限性。这些现实场景凸显了大模型在当代翻译应用中的潜在失效风险,例如在法律诉讼或人道主义记录中翻译现代战争受害者陈述的关键需求。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated remarkable adaptability in performing various tasks, including machine translation (MT), without explicit training. Models such as OpenAI's GPT-4 and Google's Gemini are frequently evaluated on translation benchmarks and utilized as translation tools due to their high performance. This paper examines Gemini's performance in translating an 18th-century Ottoman Turkish manuscript, Prisoner of the Infidels: The Memoirs of Osman Agha of Timisoara, into English. The manuscript recounts the experiences of Osman Agha, an Ottoman subject who spent 11 years as a prisoner of war in Austria, and includes his accounts of warfare and violence. Our analysis reveals that Gemini's safety mechanisms flagged between 14 and 23 percent of the manuscript as harmful, resulting in untranslated passages. These safety settings, while effective in mitigating potential harm, hinder the model's ability to provide complete and accurate translations of historical texts. Through real historical examples, this study highlights the inherent challenges and limitations of current LLM safety implementations in the handling of sensitive and context-rich materials. These real-world instances underscore potential failures of LLMs in contemporary translation scenarios, where accurate and comprehensive translations are crucial-for example, translating the accounts of modern victims of war for legal proceedings or humanitarian documentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。