arXiv:2607.13735cs.LG2026-07

用约束驱动框架,帮工业界选对模型压缩加速方法。

Constraint-Driven Model Optimization: An Industry Framework for Selecting Compression and Acceleration Techniques in Modern Machine Learning Systems

  • 按数据、延迟、内存等五类约束分类优化技术
  • 整合文献数据,把效果映射到实际部署条件
  • 提供四个真实场景的可操作优化流程

机器学习系统在云、边缘和企业环境中的快速部署,使模型优化成为系统工程的核心。尽管已有大量关于量化、剪枝、知识蒸馏、参数高效微调(PEFT)和推理时优化的研究,从业者仍常依赖经验而非系统方法。本文主张将优化视为受约束的多目标工程决策,提出一个涵盖五维约束(数据可用性、延迟预算、内存预算、精度容忍度、重训练预算)的统一框架。基于此分类体系,我们整合文献中报告的实证收益,并将其映射至具体运行约束,而非算法类别。所选技术均来自近期研究,且明确报告了对关键部署瓶颈的改进。本文提出可指导实践的决策框架,并以四个典型工业场景为例,展示其应用流程。据我们所知,这是首个系统化将模型优化形式化为约束感知、多目标工程过程的工作,综合了研究文献中的量化证据。

原文摘要 · Abstract (English)

The rapid deployment of machine learning systems across cloud, edge, and enterprise environments has brought model optimization to the forefront of systems-engineering. Despite a rich literature spanning quantization, pruning, knowledge distillation, parameter-efficient fine-tuning (PEFT), and inference-time optimization, practitioners are often left navigating these techniques through heuristics rather than principled methodology. We argue that optimization should be formulated as a constraint-driven, multi-objective engineering decision and introduce a unified framework that characterizes any production deployment along five interacting constraint dimensions: data availability, latency budget, memory budget, accuracy tolerance, and retraining budget. Building on this taxonomy, we synthesize empirical gains reported across the research literature and map them to operational constraints rather than algorithmic categories. To ensure practical relevance, we selected these techniques by reviewing recent literature for methods that report measurable improvements against critical deployment bottlenecks. We propose a prescriptive decision framework and provide optimization pipelines for four representative industrial scenarios to illustrate it in practice. To the best of our knowledge, this work provides one of the first structured attempts to formalize model optimization as a constraint-aware, multi-objective engineering process, synthesizing quantitative evidence from the research literature.

模型压缩工业落地多目标优化决策框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。