arXiv:2505.07857cs.CLcs.AI2025-05

用对比学习提升乌尔都语意图识别,支持少样本新类别预测。

Enhanced Urdu Intent Detection with Large Language Models and Prototype-Informed Predictive Pipelines

  • 基于无标签数据重训练大模型,增强乌尔都语表征能力。
  • 在两个数据集上实现最高98.25%的少样本F1分数。
  • 适合需要低资源语言意图识别的研究者和开发者。

针对乌尔都语这一全球第十大语言在意图识别领域研究不足的问题,本文提出一种结合对比学习与原型注意力机制的端到端框架LLMPIA。该方法利用未标注乌尔都语数据对预训练语言模型进行再训练,增强其下游任务表征能力,并融合原型信息实现少样本新类别预测。在公开数据集ATIS(5836样本)和Web Queries(8519样本)上评估,4类1样本设置下分别取得83.28%和76.23% F1-score,4类5样本设置下达98.25%和84.42%。在相同类别训练测试设置的案例研究中,相比当前最优模型提升53.55% F1-score。

原文摘要 · Abstract (English)

Multifarious intent detection predictors are developed for different languages, including English, Chinese and French, however, the field remains underdeveloped for Urdu, the 10th most spoken language. In the realm of well-known languages, intent detection predictors utilize the strategy of few-shot learning and prediction of unseen classes based on the model training on seen classes. However, Urdu language lacks few-shot strategy based intent detection predictors and traditional predictors are focused on prediction of the same classes which models have seen in the train set. To empower Urdu language specific intent detection, this introduces a unique contrastive learning approach that leverages unlabeled Urdu data to re-train pre-trained language models. This re-training empowers LLMs representation learning for the downstream intent detection task. Finally, it reaps the combined potential of pre-trained LLMs and the prototype-informed attention mechanism to create a comprehensive end-to-end LLMPIA intent detection pipeline. Under the paradigm of proposed predictive pipeline, it explores the potential of 6 distinct language models and 13 distinct similarity computation methods. The proposed framework is evaluated on 2 public benchmark datasets, namely ATIS encompassing 5836 samples and Web Queries having 8519 samples. Across ATIS dataset under 4-way 1 shot and 4-way 5 shot experimental settings LLMPIA achieved 83.28% and 98.25% F1-Score and on Web Queries dataset produced 76.23% and 84.42% F1-Score, respectively. In an additional case study on the Web Queries dataset under same classes train and test set settings, LLMPIA outperformed state-of-the-art predictor by 53.55% F1-Score.

意图识别少样本学习乌尔都语对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。