用大模型提升危机中低资源语言翻译,快速构建可复用的应急翻译系统。
Leveraging LLMs for MT in Crisis Scenarios: a blueprint for low-resource languages
- 结合大模型微调与社区共建语料,定制危机场景专用翻译系统。
- 在新冠疫情期间的两种低资源语言对上,多语言大模型表现优于通用大模型。
- 提出可复制的应急翻译开发流程,适合人道主义救援与紧急响应团队使用。
在不断变化的危机通信环境中,为低资源语言构建稳健且灵活的机器翻译(MT)系统比以往任何时候都更为迫切。本研究全面探索了利用大语言模型(LLMs)和多语言大语言模型(MLLMs)来增强此类场景下的翻译能力。针对危机情境下速度、准确性和多语言覆盖的关键需求,本文提出一种新方法,融合前沿大模型能力、微调技术与社区驱动语料库建设策略。核心在于为两个低资源语言对开发并实证评估定制化翻译系统,涵盖从模型选型、微调到部署的全流程。系统基于近期新冠疫情案例构建,强调社区参与对创建高度专业化危机语料的重要性,并对比了定制GPT与适配NLLB的MLLM模型。结果表明,微调后的MLLM模型性能显著优于同类通用大模型。研究提出了一种可扩展、可复现的快速开发模式,为人道主义技术领域提供了应急多语言通信系统的蓝图。
原文摘要 · Abstract (English)
In an evolving landscape of crisis communication, the need for robust and adaptable Machine Translation (MT) systems is more pressing than ever, particularly for low-resource languages. This study presents a comprehensive exploration of leveraging Large Language Models (LLMs) and Multilingual LLMs (MLLMs) to enhance MT capabilities in such scenarios. By focusing on the unique challenges posed by crisis situations where speed, accuracy, and the ability to handle a wide range of languages are paramount, this research outlines a novel approach that combines the cutting-edge capabilities of LLMs with fine-tuning techniques and community-driven corpus development strategies. At the core of this study is the development and empirical evaluation of MT systems tailored for two low-resource language pairs, illustrating the process from initial model selection and fine-tuning through to deployment. Bespoke systems are developed and modelled on the recent Covid-19 pandemic. The research highlights the importance of community involvement in creating highly specialised, crisis-specific datasets and compares custom GPTs with NLLB-adapted MLLM models. It identifies fine-tuned MLLM models as offering superior performance compared with their LLM counterparts. A scalable and replicable model for rapid MT system development in crisis scenarios is outlined. Our approach enhances the field of humanitarian technology by offering a blueprint for developing multilingual communication systems during emergencies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。