针对部署中常崩溃的复杂搜索空间,提出先找可行解再优化的新方法。
Feasible-First Exploration for Constrained ML Deployment Optimization in Crash-Prone Hierarchical Search Spaces

- 先探索可行区域,再用传统方法优化,避免无效尝试。
- 在5种GPU上测试,比传统方法节省30%以上评估预算。
- 适合资源受限、易崩溃的模型部署场景,如边缘计算。
在生产环境中部署机器学习模型需联合优化模型家族、量化方案、运行时后端和服务配置,形成具有层级结构的混合变量搜索空间。许多配置会因崩溃、超出内存限制或违反延迟约束而无效。标准黑箱优化器(如TPE、受约束贝叶斯优化)在有效配置较多时表现良好,但在充满无效配置的恶劣空间中,会将大量评估预算浪费在无效试验上。本文研究此场景,提出将优化分解为显式探索阶段与模型引导的利用阶段。提出热预算退火(TBA)方法,通过映射有效与可行区域,实现对TPE的热启动。该方法包含两项鲁棒性机制:试运行超时以提前终止明显不可行的评估;子空间黑名单机制,在多次失败后临时屏蔽特定类别子空间。同时引入DeployBench基准套件,涵盖层级结构、隐藏崩溃区、硬约束及不等价评估成本。在合成基准和真实GPU部署(5个预训练视觉模型,5种GPU目标:NVIDIA H100、A100、RTX 5080、L4、T4)上,所提混合方法在严苛约束下提升模型家族发现能力,相比冷启动TPE显著减少预算浪费。
原文摘要 · Abstract (English)
Deploying machine learning models under production constraints requires joint optimization over model family, quantization scheme, runtime backend, and serving configuration. This induces a hierarchical mixed-variable search space in which many configurations are invalid: evaluations may crash, exceed memory limits, or violate latency constraints. Standard black-box optimizers such as Tree-structured Parzen Estimators (TPE) and constrained Bayesian optimization are effective when valid configurations are common, but they can spend a large fraction of a small evaluation budget on invalid or uninformative trials in hostile deployment spaces. This paper studies that regime and asks whether optimization should be decomposed into an explicit exploration stage followed by model-guided exploitation. We propose Thermal Budget Annealing (TBA), a feasible-first exploration procedure that maps valid and feasible regions before warm-starting TPE. The method includes two robustness mechanisms for hostile hardware: trial timeouts that abort clearly infeasible evaluations early, and subspace blacklisting that temporarily suppresses categorical subspaces after repeated failures. We also introduce DeployBench, a benchmark suite for deployment optimization with hierarchical structure, hidden crash zones, hard constraints, and unequal evaluation costs. On synthetic benchmarks and real GPU deployment with five pre-trained vision models across five GPU targets (NVIDIA H100, A100, RTX 5080, L4, and T4), the proposed hybrid improves model-family discovery under tight constraints while reducing wasted budget relative to cold-start TPE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。