PRISM通过分析排列结构,提前判断优化策略是否值得用。
PRISM: A Predictive Protocol for Permutation Optimization via Landscape Diagnostics

- 用快速诊断检测排列空间的结构特征。
- 实验证明指令顺序变化可导致性能差异达30%以上。
- 适合需要优化排序的场景,如模型指令、架构设计。
排列优化在系统组件固定但顺序影响性能时出现。我们提出PRISM,一种基于景观诊断的预测性优化协议。PRISM通过低成本的景观分析——包括单步移动自相关和适应度-距离相关性——预测有效变异算子,识别结构化搜索优于随机采样的时机,并检测搜索优势有限的区域。在合成排列景观、神经网络架构基准、科学机器学习流水线及大语言模型指令排序任务中,该协议能在优化前做出可验证的搜索行为预测。全面的指令排序实验显示,仅改变顺序即可带来显著性能波动;跨模型实验表明,有用排序结构可在不同模型族和任务难度间迁移。额外实验表明,在提示词优化后,顺序优化仍具显著影响,说明内容与顺序优化互补。结果表明,PRISM并非万能优化器,而是一个判断何时进行排列搜索、选择何种表示与算子、以及何时采用更简单方案的框架。
原文摘要 · Abstract (English)
Permutation optimization arises whenever the components of a system are fixed but their ordering affects performance. We introduce PRISM, a predictive protocol for permutation optimization that measures a fitness landscape before selecting a search strategy. PRISM uses inexpensive landscape diagnostics, including one-step move autocorrelation and fitness-distance correlation, to predict useful mutation operators, identify when structured search is likely to outperform random sampling, and detect regimes in which search provides little advantage. Across synthetic permutation landscapes, neural architecture benchmarks, scientific machine learning pipelines, and large-language-model instruction ordering, the protocol makes testable predictions about search behavior before optimization begins. Exhaustive instruction-ordering experiments reveal substantial performance variation induced solely by permutation, while cross-model experiments show that useful ordering structure can transfer across model families and task difficulty. Additional experiments demonstrate that instruction ordering remains consequential after prompt wording is optimized, indicating that content optimization and ordering optimization are complementary. The results position PRISM not as a universally superior optimizer, but as a framework for determining when permutation search is useful, which representation and operator should be used, and when simpler alternatives are preferable.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。