arXiv:2504.08543cs.CL2025-04ACL被引 2

用适配器高效实现多语言情感识别,低资源语言表现突出

UoB-NLP at SemEval-2025 Task 11: Leveraging Adapters for Multilingual and Cross-Lingual Emotion Detection

  • 采用适配器微调多语言模型,仅更新少量参数保持原模型不变
  • 在7个非洲低资源语言中排名前8,部分语言超越大模型性能
  • 参数少、计算省,适合资源有限场景下的跨语言情感分析

情感检测因人类情绪复杂性和语言多样性而具有挑战性。尽管高资源语言已取得进展,低资源语言仍研究不足。本文通过适配器微调多语言预训练模型,实现多语言与跨语言情感检测。适配器引入少量可训练参数,固定预训练权重,提升参数效率。实验对比任务专用适配器、目标语言就绪适配器及语言家族适配器策略。结果表明,目标语言就绪适配器整体表现最佳,对低资源非洲语言尤其有效:在Track A中Tigrinya排名第7,Kinyarwanda排名第8;在Track C中Amharic排名第3,Oromo、Tigrinya、Kinyarwanda、Hausa和Igbo均排名第4。该方法在11种语言上优于大模型,在4种语言上持平,但模型参数显著更少。此外,适配器模型在保持跨语言迁移能力的同时,所需计算资源远低于全量微调。

原文摘要 · Abstract (English)

Emotion detection in natural language processing is a challenging task due to the complexity of human emotions and linguistic diversity. While significant progress has been made in high-resource languages, emotion detection in low-resource languages remains underexplored. In this work, we address multilingual and cross-lingual emotion detection by leveraging adapter-based fine-tuning with multilingual pre-trained language models. Adapters introduce a small number of trainable parameters while keeping the pre-trained model weights fixed, offering a parameter-efficient approach to adaptation. We experiment with different adapter tuning strategies, including task-only adapters, target-language-ready task adapters, and language-family-based adapters. Our results show that target-language-ready task adapters achieve the best overall performance, particularly for low-resource African languages with our team ranking 7th for Tigrinya, and 8th for Kinyarwanda in Track A. In Track C, our system ranked 3rd for Amharic, and 4th for Oromo, Tigrinya, Kinyarwanda, Hausa, and Igbo. Our approach outperforms large language models in 11 languages and matches their performance in four others, despite our models having significantly fewer parameters. Furthermore, we find that adapter-based models retain cross-linguistic transfer capabilities while requiring fewer computational resources compared to full fine-tuning for each language.

情感识别多语言适配器低资源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。