arXiv:2503.06531cs.CL2025-03被引 2

用强化学习选最佳语料,让模型跨语言少样本推理更准

MetaXCR: Reinforcement-Based Meta-Transfer Learning for Cross-Lingual Commonsense Reasoning

  • 多源适配器融合多个英语数据集,学习通用任务适配器
  • 强化学习动态选择对目标语言最有益的源任务,提升迁移效率
  • 适合低资源跨语言常识推理场景,参数量更少性能更强

常识推理(CR)在多个领域取得进展,但多数数据集为英文,导致现有研究集中于英语。由于常识标注成本高,难以构建每项新任务的大规模数据集。因此,跨语言低资源常识推理需求迫切,旨在利用现有英文数据集帮助模型在少量标注数据下适应新语言任务。本文提出多源适配器框架MetaXCR,首先扩展元学习,融合多个训练数据集以学习跨任务的通用适配器;其次引入基于强化学习的采样策略,动态选择对目标任务最有帮助的源任务;最后设计两种跨语言元适应方法,提升模型在目标语言上的表现。大量实验表明,MetaXCR优于现有最先进方法,且训练参数更少。

原文摘要 · Abstract (English)

Commonsense reasoning (CR) has been studied in many pieces of domain and has achieved great progress with the aid of large datasets. Unfortunately, most existing CR datasets are built in English, so most previous work focus on English. Furthermore, as the annotation of commonsense reasoning is costly, it is impossible to build a large dataset for every novel task. Therefore, there are growing appeals for Cross-lingual Low-Resource Commonsense Reasoning, which aims to leverage diverse existed English datasets to help the model adapt to new cross-lingual target datasets with limited labeled data. In this paper, we propose a multi-source adapter for cross-lingual low-resource Commonsense Reasoning (MetaXCR). In this framework, we first extend meta learning by incorporating multiple training datasets to learn a generalized task adapters across different tasks. Then, we further introduce a reinforcement-based sampling strategy to help the model sample the source task that is the most helpful to the target task. Finally, we introduce two types of cross-lingual meta-adaption methods to enhance the performance of models on target languages. Extensive experiments demonstrate MetaXCR is superior over state-of-the-arts, while being trained with fewer parameters than other work.

跨语言少样本元学习常识推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。