用大模型零样本翻译满语,发现词典和双语例句最有效。
Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchu
- 通过提示工程整合词典、语法书和双语例句,测试其对翻译的影响
- 高质量词典和优质平行语料显著提升性能,语法书几乎无效
- 适合研究低资源语言翻译或数据增强的学者与工程师
基于大语言模型(LLM)的上下文学习(ICL)为低资源机器翻译提供新路径,可直接利用语法书、词典等语言资源实现零训练翻译。本研究以满语为例,系统评估不同资源类型及其质量对翻译效果的影响。为排除模型预训练中可能包含的满语知识,还使用加密版本的满语文本进行实验。结果表明,高质量词典和良好平行语料能显著提升翻译表现,而语法书作用微弱。后续研究展示了该方法在并行数据增强中的潜力:当单语数据丰富时,可通过上下文翻译生成合成双语数据,从而构建高效低资源神经机器翻译系统。
原文摘要 · Abstract (English)
In-context machine translation (MT) with large language models (LLMs) is a promising approach for low-resource MT, as it can readily take advantage of linguistic resources such as grammar books and dictionaries. Such resources are usually selectively integrated into the prompt so that LLMs can directly perform translation without any specific training, via their in-context learning capability (ICL). However, the relative importance of each type of resource, e.g., dictionary, grammar book, and retrieved parallel examples, is not entirely clear. To address this gap, this study systematically investigates how each resource and its quality affect the translation performance, with the Manchu language as our case study. To remove any prior knowledge of Manchu encoded in the LLM parameters and single out the effect of ICL, we also experiment with an enciphered version of Manchu texts. Our results indicate that high-quality dictionaries and good parallel examples are very helpful, while grammars hardly help. In a follow-up study, we showcase a promising application of in-context MT: parallel data augmentation as a way to bootstrap a conventional MT model. When monolingual data abound, generating synthetic parallel data through in-context MT offers a pathway to mitigate data scarcity and build effective and efficient low-resource neural MT systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。