arXiv:2412.20584cs.CL2024-12被引 1

用大模型零资源翻译濒危语言,效果逼近人类。

Towards Neural No-Resource Language Translation: A Comparative Evaluation of Approaches

  • 用大模型上下文学习+推理提示实现零资源翻译
  • 链式推理提示在数据多时表现更好,直接提示适合小数据
  • 方法无需专家干预,可推广至多种濒危语言

无资源语言(数字语料极少,常少于100句)的机器翻译面临独特挑战。本文以奥文斯谷派尤特语为例,对比三种方法:专用模型微调、基于大模型的链式推理上下文学习、直接提示。结果表明,传统低资源翻译方法在此类语言上失效;而大模型的上下文学习能力可实现超越低资源方法的翻译性能,甚至达到人类水平(BLEU 0.45–0.6)。链式推理在较大语料下更优,直接提示则在小数据中占优。该方法不依赖语言特定知识,具备跨语言泛化潜力,为濒危语言保护提供新范式。

原文摘要 · Abstract (English)

No-resource languages - those with minimal or no digital representation - pose unique challenges for machine translation (MT). Unlike low-resource languages, which rely on limited but existent corpora, no-resource languages often have fewer than 100 sentences available for training. This work explores the problem of no-resource translation through three distinct workflows: fine-tuning of translation-specific models, in-context learning with large language models (LLMs) using chain-of-reasoning prompting, and direct prompting without reasoning. Using Owens Valley Paiute as a case study, we demonstrate that no-resource translation demands fundamentally different approaches from low-resource scenarios, as traditional approaches to machine translation, such as those that work for low-resource languages, fail. Empirical results reveal that, although traditional approaches fail, the in-context learning capabilities of general-purpose large language models enable no-resource language translation that outperforms low-resource translation approaches and rivals human translations (BLEU 0.45-0.6); specifically, chain-of-reasoning prompting outperforms other methods for larger corpora, while direct prompting exhibits advantages in smaller datasets. As these approaches are language-agnostic, they have potential to be generalized to translation tasks from a wide variety of no-resource languages without expert input. These findings establish no-resource translation as a distinct paradigm requiring innovative solutions, providing practical and theoretical insights for language preservation.

零资源翻译大模型语言保护上下文学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。