arXiv:2607.08643cs.LG2026-07

无需查表的二值球面编码,实现极致低比特大模型压缩

BiSCo-LLM: Lookup-Free Binary Spherical Coding for Extreme Low-Bit Large Language Model Compression

论文配图:BiSCo-LLM: Lookup-Free Binary Spherical Coding for Extreme Low-Bit Large Language Model Compression
图 1 · 摘自论文原文
  • 将权重映射到单位超球面后二值化,仅存储符号流避免查表
  • 通过残差编码补偿重构误差,实现无代码本的率失真控制
  • 适用于对存储和推理效率要求极高的部署场景

大语言模型在部署时受内存容量、权重带宽和检查点存储限制日益严重。现有低比特压缩方法主要分为两类:标量或分组量化简单且兼容高效低精度内核,但当目标预算接近每权重2比特时表达能力受限;向量量化权重压缩提供更丰富的块级表示,但通常引入显式代码本、索引查找和额外存储开销。本文提出BiSCo-LLM,一种面向极端低比特大模型权重压缩的无代码本二值球面编码框架。核心流程包含三个组件:首先,局部权重块被映射至单位超球面并二值化为紧凑的球面码,使主要数据为位打包符号流而非显式向量量化中心;其次,残差二值球面量化阶段编码基础球面编码留下的重构误差,实现无存储代码本的率失真路径;第三,替换每个Transformer模块类别后执行类别级恢复蒸馏,降低局部权重重构与整体模型行为之间的不匹配。此外,使用一个8比特保护通道路径作为敏感通道的辅助稳定机制,该部分单独计算,不计入主BSQ负载。报告的存储预算包括二值码、神经解码器、保护通道负载、LoRA适配器和元数据。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly constrained by memory capacity, weight bandwidth, and checkpoint storage during deployment. Existing low-bit compression methods mainly follow two directions. Scalar or group-wise quantization is simple and compatible with efficient low-precision kernels, but its representation capacity becomes limited when the target budget approaches 2 bits per weight. Vector-quantized weight compression provides a richer block-level representation, but usually introduces explicit codebooks, index lookup, and additional storage accounting. This paper presents BiSCo-LLM, a codebook-free binary spherical coding framework for extreme low-bit LLM weight compression. The core pipeline is built on three components. First, local weight chunks are mapped onto a unit hypersphere and binarized into compact spherical codes, so that the main payload is a bit-packed sign stream rather than explicit VQ centroids. Second, a residual BSQ stage encodes the reconstruction error left by the base spherical codec, providing an explicit rate-distortion path without stored codebooks. Third, category-wise recovery distillation is performed after replacing each Transformer module category, reducing the mismatch between local weight reconstruction and assembled model behavior. A small 8-bit protected-channel path is used as an auxiliary stabilization mechanism for sensitive channels and is counted separately from the BSQ payload. The reported storage budget includes binary codes, neural decoders, protected-channel payloads, LoRA adapters, and metadata.

模型压缩二值编码低比特量化LLM部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。