arXiv:2506.09782cs.CVcs.AI2025-06被引 2

Q-SAM2让分割大模型在低比特下仍保持高精度,适合移动端部署。

Q-SAM2: Accurate Quantization for Segment Anything Model 2

  • 引入方差缩减校准与可学习统计裁剪,优化量化过程中的分布问题。
  • 2比特量化下视频分割指标提升9.7个百分点,实例分割提升7.3个百分点。
  • 模型大小压缩8倍,适合资源受限设备上的高效推理。

Segment Anything Model 2(SAM2)是一个强大的可提示分割基础模型,但其高计算和内存开销限制了在资源受限设备上的部署。本文提出Q-SAM2,一种高精度低比特量化方法,实现显著压缩与高保真度。为解决量化过程中权重和激活分布带来的性能下降,Q-SAM2引入两项新贡献:方差缩减校准(VRC),通过在小校准批次上最小化Frobenius范数来降低权重统计方差;以及可学习统计裁剪(LSC),一种量化感知训练(QAT)方法,通过学习动量稳定的裁剪因子来处理权重与激活中的异常值。全面实验表明,Q-SAM2在高效率下实现高精度推理,显著优于现有通用QAT方案,尤其在超低2比特场景中表现突出。具体而言,其在视频分割基准上比最优竞品模型在J&F指标上最高提升9.7 ppt,实例分割的mIoU提升7.3 ppt,同时相较BF16基线实现8倍模型尺寸压缩。

原文摘要 · Abstract (English)

The Segment Anything Model 2 (SAM2) is a powerful foundation model for promptable segmentation. However, its high computational and memory costs are a major barrier to deployment on resource-constrained devices. In this paper, we present Q-SAM2, an accurate low-bit quantization method that achieves high compression and high fidelity. To address performance degradation arising from challenging weight and activation distributions during quantization, Q-SAM2 introduces two novel contributions: Variance-Reduced Calibration (VRC), an initialization method that reduces weight statistical variance by minimizing the Frobenius norm over a small calibration batch; and Learnable Statistical Clipping (LSC), a Quantization-Aware Training (QAT) method that learns momentum-stabilized clipping factors to manage outliers in weights and activations. Comprehensive experiments demonstrate that Q-SAM2 achieves highly accurate inference with substantial efficiency gains, significantly surpassing state-of-the-art general QAT schemes, particularly in the ultra-low 2-bit regime. Specifically, Q-SAM2 achieves an accuracy gain of up to 9.7 ppt in J&F on the video segmentation benchmark and 7.3 ppt in mIoU for instance segmentation over the best competing QAT model, all while achieving an 8x reduction in model size compared to the BF16 baseline.

量化分割模型低比特SAM2

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。