arXiv:2604.16855cs.CV2026-04

针对伪装目标检测的4位量化难题,提出双约束激活量化方法。

When W4A4 Breaks Camouflaged Object Detection: Token-Group Dual-Constraint Activation Quantization

论文配图:When W4A4 Breaks Camouflaged Object Detection: Token-Group Dual-Constraint Activation Quantization
图 1 · 摘自论文原文
  • 设计分组尺度抑制跨令牌范围主导问题
  • 双约束投影确保零桶质量与步长分散比可控
  • 在四个基准上提升性能超0.12,无需重训练

伪装目标检测(COD)需识别与背景高度融合的物体,依赖细微纹理和边界线索。在设备端内存与延迟受限场景下,低比特推理至关重要,但COD极难进行激进量化。本文研究基于Transformer的COD模型在后训练W4A4量化下的表现,发现任务特异性瓶颈:长尾背景令牌占据共享激活范围,放大量化步长,使弱但有结构的边界线索被压缩至零桶。这暴露了令牌局部瓶颈——需消除跨令牌范围主导,并将零桶质量控制在4比特激活范围内。为此,提出面向COD的令牌-分组双约束量化方法(COD-TDQ),通过两步协同实现:直接求和令牌-分组(DSTG)分配分组尺度以抑制范围主导;双约束范围投影(DCRP)对每个分组裁剪范围,保持步长-离散比与零桶质量受控。在四个COD基准与两个基线模型(CFRN与ESCNet)上,COD-TDQ均显著优于现有最优无重训练量化方法,S_α得分提升超过0.12。代码已开源。

原文摘要 · Abstract (English)

Camouflaged object detection (COD) segments objects that intentionally blend with the background, so predictions depend on subtle texture and boundary cues. COD is often needed under tight on-device memory and latency budgets, making low-bit inference highly desirable. However, COD is unusually hard to quantize aggressively. We study post-training W4A4 quantization of Transformer-based COD and find a task-specific cliff: heavy-tailed background tokens dominate a shared activation range, inflating the step size and pushing weak-but-structured boundary cues into the zero bin. This exposes a token-local bottleneck -- remove cross-token range domination and bound the zero-bin mass under 4-bit activations. To address this, we introduce COD-TDQ, a COD-aware Token-group Dual-constraint activation Quantization method. COD-TDQ addresses this token-local bottleneck with two coupled steps: Direct-Sum Token-Group (DSTG) assigns token-group scales to suppress cross-token range domination, and Dual-Constraint Range Projection (DCRP) projects each token-group clip range to keep the step-to-dispersion ratio and the zero-bin mass bounded. Across four COD benchmarks and two baseline models (CFRN and ESCNet), COD-TDQ consistently achieves an $S_α$ score more than 0.12 higher than that of the state-of-the-art quantization method without retraining. The code is available at https://github.com/MCG-NKU/nku-model-compre.

量化伪装检测Transformer低比特推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。