提升低资源语言翻译能力,优化多语言模型的知识迁移效果
Analyzing and Improving Cross-lingual Knowledge Transfer for Machine Translation
- 分析语言相似性对知识迁移的影响,设计增强低资源翻译的策略
- 发现增加训练语言多样性可提升泛化能力并减少错误传播
- 适合关注多语言模型鲁棒性与公平性的研究者和开发者
多语言机器翻译系统旨在实现跨语言知识共享,但学习有效的跨语言表示仍具挑战,尤其在低资源语言中,有限的平行数据限制了模型泛化与迁移能力。本文以机器翻译为核心场景,研究神经模型中的跨语言知识迁移机制,探讨语言相似性、检索与辅助监督对低资源翻译的增强作用,以及在平行数据上微调可能引发大语言模型的意外权衡。同时,分析训练时语言多样性的作用,表明扩大翻译覆盖范围可提升模型泛化性并降低非目标语言干扰。该研究揭示了建模选择与数据构成如何影响多语言学习,为构建更包容、稳健的多语言自然语言处理系统提供洞见。
原文摘要 · Abstract (English)
Multilingual machine translation systems aim to make knowledge accessible across languages, yet learning effective cross-lingual representations remains challenging. These challenges are especially pronounced for low-resource languages, where limited parallel data constrains generalization and transfer. Understanding how multilingual models share knowledge across languages requires examining the interaction between representations, data availability, and training strategies. In this thesis, we study cross-lingual knowledge transfer in neural models and develop methods to improve robustness and generalization in multilingual settings, using machine translation as a central testbed. We analyze how similarity between languages influences transfer, how retrieval and auxiliary supervision can strengthen low-resource translation, and how fine-tuning on parallel data can introduce unintended trade-offs in large language models. We further examine the role of language diversity during training and show that increasing translation coverage improves generalization and reduces off-target behavior. Together, this work highlights how modeling choices and data composition shape multilingual learning and offers insights toward more inclusive and resilient multilingual NLP systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。