arXiv:2410.20021cs.CLcs.AI2024-10被引 4

用四步法让大模型搞定低资源语言的跨语言摘要

Think Carefully and Check Again! Meta-Generation Unlocking LLMs for Low-Resource Cross-Lingual Summarization

  • 设计SITR四步流程,零样本提升大模型跨语言摘要能力
  • GPT-3.5和GPT-4在多个低资源语言上显著超越基线
  • 适合想用大模型做小语种摘要的研究者和应用开发者

跨语言摘要(CLS)旨在用目标语言生成源文本的摘要。当前指令微调的大语言模型(LLMs)在英语任务中表现优异,但在中文、西班牙语等数据较少的低资源语言上,即使采用少样本设置,性能仍不理想。这引发疑问:大模型能否处理低资源语言的跨语言摘要?为此,我们提出四步零样本方法SITR(摘要→改进→翻译→优化),并设计相应提示词。在两个主流跨语言摘要数据集上测试多种大模型,结果表明:i) GPT-3.5和GPT-4在使用SITR方法时显著且一致优于其他基线;ii) 该方法有效释放了大模型在低资源语言上的潜力,使其可高效完成跨语言摘要任务。

原文摘要 · Abstract (English)

Cross-lingual summarization (CLS) aims to generate a summary for the source text in a different target language. Currently, instruction-tuned large language models (LLMs) excel at various English tasks. However, unlike languages such as English, Chinese or Spanish, for those relatively low-resource languages with limited usage or data, recent studies have shown that LLMs' performance on CLS tasks remains unsatisfactory even with few-shot settings. This raises the question: Are LLMs capable of handling cross-lingual summarization tasks for low-resource languages? To resolve this question, we fully explore the potential of large language models on cross-lingual summarization task for low-resource languages through our four-step zero-shot method: Summarization, Improvement, Translation and Refinement (SITR) with correspondingly designed prompts. We test our proposed method with multiple LLMs on two well-known cross-lingual summarization datasets with various low-resource target languages. The results show that: i) GPT-3.5 and GPT-4 significantly and consistently outperform other baselines when using our zero-shot SITR methods. ii) By employing our proposed method, we unlock the potential of LLMs, enabling them to effectively handle cross-lingual summarization tasks for relatively low-resource languages.

跨语言摘要大模型低资源语言零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。