arXiv:2506.17700cs.CLcs.AI2025-06被引 4

系统梳理11类提示优化策略,推动大模型应用落地

The Evolution of Natural Language Processing: How Prompt Optimization and Language Models are Shaping the Future

  • 将提示优化方法分为11类,揭示其底层原理
  • 涵盖多种大模型与基准数据集,覆盖多元任务场景
  • 为新任务提供可复用的优化框架,适合研究者参考

大型语言模型(LLMs)已彻底改变自然语言处理(NLP)领域,自动化传统高耗时任务,加速计算机辅助应用发展。随着新型语言模型及高效训练/微调方法不断涌现,提示工程及其后续优化策略成为显著提升多样NLP任务性能的关键趋势。尽管已有大量综述探讨提示工程,但对提示优化策略的全面分析仍存在空白。本文首次系统梳理并深入分析了多种提示优化策略的潜在价值,剖析其内在工作机制,并据此划分为11个独立类别。论文详细列举了这些策略在各类NLP任务中的应用实例,以及所使用的不同大模型和基准数据集。这一综合整理为未来对比研究奠定了坚实基础,支持在一致实验设置下对提示优化与基于大模型的预测流程进行严谨评估,满足当前研究迫切需求。最终,本研究将分散的战略知识集中整合,助力研究人员在未探索任务中复用现有优化策略,开发创新预测模型。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have revolutionized the field of Natural Language Processing (NLP) by automating traditional labor-intensive tasks and consequently accelerated the development of computer-aided applications. As researchers continue to advance this field with the introduction of novel language models and more efficient training/finetuning methodologies, the idea of prompt engineering and subsequent optimization strategies with LLMs has emerged as a particularly impactful trend to yield a substantial performance boost across diverse NLP tasks. To best of our knowledge numerous review articles have explored prompt engineering, however, a critical gap exists in comprehensive analyses of prompt optimization strategies. To bridge this gap this paper provides unique and comprehensive insights about the potential of diverse prompt optimization strategies. It analyzes their underlying working paradigms and based on these principles, categorizes them into 11 distinct classes. Moreover, the paper provides details about various NLP tasks where these prompt optimization strategies have been employed, along with details of different LLMs and benchmark datasets used for evaluation. This comprehensive compilation lays a robust foundation for future comparative studies and enables rigorous assessment of prompt optimization and LLM-based predictive pipelines under consistent experimental settings: a critical need in the current landscape. Ultimately, this research will centralize diverse strategic knowledge to facilitate the adaptation of existing prompt optimization strategies for development of innovative predictors across unexplored tasks.

大模型提示优化NLP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。