arXiv:2510.21148cs.AI2025-10NeurIPS被引 2

自动优化提示词与推理路径,让小模型也能高效完成专业任务。

How to Auto-optimize Prompts for Domain Tasks? Adaptive Prompting and Reasoning through Evolutionary Domain Knowledge Adaptation

  • 用因果图引导文本梯度,迭代优化提示和推理过程。
  • 在真实场景中提升F1 7.32%-12.61%,小模型成本低于原方案20%。
  • 输出可解释的领域专用因果图,适合医疗、交通等专业应用。

在实际应用中,为大语言模型(LLM)设计最优提示词与推理流程对于特定领域任务至关重要但极具挑战。如何整合领域知识、提升推理效率,并为领域专家提供精准的知识融合建议,仍是未解难题。本文提出进化图优化提示框架(EGO-Prompt),从人工专家构建的容错初始语义因果图(SCG)出发,自动优化提示词与推理机制。针对专家定义的SCG可能不完整且不同模型适配性差异大的问题,EGO-Prompt引入双重因果引导文本梯度:先基于SCG生成近似确定性推理指引,再调整模型有效利用该指引。通过结合真实标签的文本梯度进行迭代优化,持续改进SCG与推理机制。在公共卫生、交通与人类行为等真实任务上测试,结果表明,EGO-Prompt相比前沿方法提升F1 7.32%-12.61%,并使小型模型性能达到大型模型水平,仅需原成本的20%以下。同时输出可解释的领域专属优化后SCG。

原文摘要 · Abstract (English)

Designing optimal prompts and reasoning processes for large language models (LLMs) on domain-specific tasks is both necessary and challenging in real-world applications. Determining how to integrate domain knowledge, enhance reasoning efficiency, and even provide domain experts with refined knowledge integration hints are particularly crucial yet unresolved tasks. In this research, we propose Evolutionary Graph Optimization for Prompting (EGO-Prompt), an automated framework to designing better prompts, efficient reasoning processes and providing enhanced causal-informed process. EGO-Prompt begins with a general prompt and fault-tolerant initial Semantic Causal Graph (SCG) descriptions, constructed by human experts, which is then automatically refined and optimized to guide LLM reasoning. Recognizing that expert-defined SCGs may be partial or imperfect and that their optimal integration varies across LLMs, EGO-Prompt integrates a novel causal-guided textual gradient process in two steps: first, generating nearly deterministic reasoning guidance from the SCG for each instance, and second, adapting the LLM to effectively utilize the guidance alongside the original input. The iterative optimization algorithm further refines both the SCG and the reasoning mechanism using textual gradients with ground-truth. We tested the framework on real-world public health, transportation and human behavior tasks. EGO-Prompt achieves 7.32%-12.61% higher F1 than cutting-edge methods, and allows small models to reach the performence of larger models at under 20% of the original cost. It also outputs a refined, domain-specific SCG that improves interpretability.

提示优化因果推理小模型领域适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。