用贪心搜索引导思维链,提升小模型对俚语的准确理解。
Slang Context-based Inference Enhancement via Greedy Search-Guided Chain-of-Thought Prompting
- 将贪心搜索与思维链提示结合,增强小模型推理能力。
- 实验表明模型大小和温度对俚语理解准确率影响不大。
- 适合需要低成本高精度俚语解析的应用场景。
俚语理解是大语言模型面临的挑战性下游任务,因其表达嵌入在上下文、文化与语言框架中。缺乏领域特定训练数据时,仅靠词法信息难以准确解释俚语含义。本文研究大模型在俚语推理中的难点,提出一种基于贪心搜索引导的思维链框架。实验发现,模型规模与温度设置对推理准确率影响有限,参数量更大的Transformer模型并未优于小模型。基于此,将贪心搜索与思维链提示结合,应用于小语言模型,构建了提升俚语理解准确率的框架。结果表明该方法有效改进了俚语意义解析性能。研究深化了对语言模型上下文依赖性的理解,并为通过结构化推理提示提升俚语认知提供了实用方案。
原文摘要 · Abstract (English)
Slang interpretation has been a challenging downstream task for Large Language Models (LLMs) as the expressions are inherently embedded in contextual, cultural, and linguistic frameworks. In the absence of domain-specific training data, it is difficult for LLMs to accurately interpret slang meaning based on lexical information. This paper attempts to investigate the challenges of slang inference using large LLMs and presents a greedy search-guided chain-of-thought framework for slang interpretation. Through our experiments, we conclude that the model size and temperature settings have limited impact on inference accuracy. Transformer-based models with larger active parameters do not generate higher accuracy than smaller models. Based on the results of the above empirical study, we integrate greedy search algorithms with chain-of-thought prompting for small language models to build a framework that improves the accuracy of slang interpretation. The experimental results indicate that our proposed framework demonstrates improved accuracy in slang meaning interpretation. These findings contribute to the understanding of context dependency in language models and provide a practical solution for enhancing slang comprehension through a structured reasoning prompting framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。