arXiv:2607.12612cs.CL2026-07

用翻译+英语BERT微调,低成本实现低资源语言NLP效果

Translation as a Computationally Efficient Bridge: Feasibility of English BERT for Low-Resource Languages

论文配图:Translation as a Computationally Efficient Bridge: Feasibility of English BERT for Low-Resource Languages
图 1 · 摘自论文原文
  • 将非英语数据译为英语后,用现成英语BERT模型微调
  • 6项任务中53.3%情况下效果优于或持平原生模型
  • 对语法结构类任务和近英语语言更有效,适合资源匮乏场景

BERT模型通过处理跨领域未结构化文本革新了自然语言处理,但非英语语言高质量BERT模型的构建因标注数据有限和计算成本高而困难。将非英语数据翻译成英语,并微调现有英语BERT模型是一种资源高效的替代方案。本研究系统比较了翻译微调与原生语言BERT在六项任务(情感分析、仇恨言论检测、问答、命名实体识别、词性标注、自然语言推理)上的表现,使用保加利亚语、中文、荷兰语、意大利语和俄语的数据集。所有设置下,翻译方法在53.3%的情况下表现相当或更优,尤其在问答、词性标注和自然语言推理任务中优势明显,而在命名实体识别和仇恨言论检测中常有性能下降。结果表明,翻译微调对依赖句法或结构模式的任务及与英语语言类型相近的语言(如荷兰语)最有效,对需细粒度标记或文化敏感的任务(如中文)效果较差。该研究证明翻译微调是扩展低资源语言NLP的可扩展、高效且经实证验证的路径,有助于提升AI的多语言包容性和可持续性。

原文摘要 · Abstract (English)

BERT models have revolutionised Natural Language Processing (NLP) through their ability to process unstructured text across diverse domains. However, developing high-quality BERT models for non-English languages remains challenging due to limited annotated data and high computational demands. Translating non-English data into English and fine-tuning existing English BERT models offers a resource-efficient alternative, yet few studies have structurally compared translation-based fine-tuning with native-language BERT performance across tasks and languages. This study provides such a comparison, evaluating the feasibility of translation-based fine-tuning across six NLP tasks: Sentiment Analysis, Hate Speech Detection, Question Answering, Named Entity Recognition, Part-of-Speech Tagging, and Natural Language Inference, using datasets translated from Bulgarian, Chinese, Dutch, Italian, and Russian. Across all settings, the translation-based approach was comparable or superior in 53.3 percent of cases. Gains were most frequent in Question Answering, Part-of-Speech Tagging, and Natural Language Inference, while performance declines were common in Named Entity Recognition and Hate Speech Detection. The results show that translation-based fine-tuning is most effective for tasks relying on syntactic or structural patterns and for languages typologically close to English, such as Dutch, but less effective for token-level or culturally nuanced tasks, particularly in Chinese. Overall, this study demonstrates that translation-based fine-tuning offers a scalable, resource-efficient, and empirically validated path for extending NLP to low-resource languages while advancing linguistic inclusivity and sustainability in artificial intelligence.

低资源语言BERT翻译微调NLP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。