arXiv:2603.28845cs.LGcs.AI2026-03被引 3

一键压缩大模型,自动适配硬件实现高效部署。

OneComp: One-Line Revolution for Generative AI Model Compression

  • 输入模型和硬件,自动规划混合精度压缩策略。
  • 分阶段渐进量化,每步提升模型质量且可部署。
  • 开源可扩展,适合需要落地部署的开发者。

大模型部署受限于内存占用、延迟和硬件成本。后训练压缩可通过降低参数精度缓解这些瓶颈,但实际应用困难,因量化算法、精度预算、数据校准策略与硬件执行环境碎片化。本文提出OneComp,一个开源压缩框架,将专家工作流转化为可复现、资源自适应的管道。给定模型标识符和可用硬件,OneComp自动分析模型,规划混合精度分配,并执行从层级压缩到块级优化、全局优化的渐进量化过程。关键设计是将首个量化检查点作为可部署的基准,确保后续各阶段均在相同模型上改进,且随着计算投入增加,性能持续提升。通过将前沿压缩研究转化为可扩展、开源、硬件感知的流水线,OneComp弥合了算法创新与生产级部署之间的鸿沟。

原文摘要 · Abstract (English)

Deploying foundation models is increasingly constrained by memory footprint, latency, and hardware costs. Post-training compression can mitigate these bottlenecks by reducing the precision of model parameters without significantly degrading performance; however, its practical implementation remains challenging as practitioners navigate a fragmented landscape of quantization algorithms, precision budgets, data-driven calibration strategies, and hardware-dependent execution regimes. We present OneComp, an open-source compression framework that transforms this expert workflow into a reproducible, resource-adaptive pipeline. Given a model identifier and available hardware, OneComp automatically inspects the model, plans mixed-precision assignments, and executes progressive quantization stages, ranging from layer-wise compression to block-wise refinement and global refinement. A key architectural choice is treating the first quantized checkpoint as a deployable pivot, ensuring that each subsequent stage improves the same model and that quality increases as more compute is invested. By converting state-of-the-art compression research into an extensible, open-source, hardware-aware pipeline, OneComp bridges the gap between algorithmic innovation and production-grade model deployment.

模型压缩自动化部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。