融合黑盒与白盒优势,高效优化大模型指令质量。
Instruction Learning Paradigms: A Dual Perspective on White-box and Black-box LLMs
- 用黑盒生成多样指令初值,白盒提供可解释性分析。
- 通过语义相似约束融合表示,迭代提升指令适应性。
- 在复杂推理与跨语言任务中均超越现有方法。
优化大语言模型(LLMs)的指令对发挥其在复杂多变任务中的潜力至关重要。然而,仅依赖白盒方法需大量计算资源且表征能力有限,而黑盒模型则可能带来高昂成本。为此,我们提出一种新框架,无缝结合两种范式的优势:黑盒模型提供高质量、多样化的指令初始值,白盒模型通过隐藏状态和输出特征实现细粒度可解释性。通过施加语义相似性约束,二者融合为统一的高维表示,捕捉深层语义与结构细节,支持迭代优化以提升指令质量与适应性。在涵盖复杂推理到跨语言泛化等广泛任务上的评估表明,该方法持续优于当前最佳基线。黑盒初始化与先进语义精炼的结合,形成了一种可扩展、高效的解决方案,为下一代大模型驱动的应用铺平道路。代码将很快开源。
原文摘要 · Abstract (English)
Optimizing instructions for large language models (LLMs) is critical for harnessing their full potential in complex and diverse tasks. However, relying solely on white-box approaches demands extensive computational resources and offers limited representational capacity, while black-box models can incur prohibitive financial costs. To address these challenges, we introduce a novel framework that seamlessly merges the strengths of both paradigms. Black-box models provide high-quality, diverse instruction initializations, and white-box models supply fine-grained interpretability through hidden states and output features. By enforcing a semantic similarity constraint, these components fuse into a unified high-dimensional representation that captures deep semantic and structural nuances, enabling an iterative optimization process to refine instruction quality and adaptability. Extensive evaluations across a broad spectrum of tasks-ranging from complex reasoning to cross-lingual generalization-demonstrate that our approach consistently outperforms state-of-the-art baselines. This fusion of black-box initialization with advanced semantic refinement yields a scalable and efficient solution, paving the way for next-generation LLM-driven applications in diverse real-world scenarios. The source code will be released soon.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。