arXiv:2608.02162cs.SEcs.AI2026-08

用程序合成方法实现无损张量压缩,大幅减少模型存储体积。

Lossless Tensor Compression as Program Synthesis

  • 将张量压缩建模为程序合成问题,用可逆操作符捕捉重复结构。
  • 在10个公开模型上实现33.93%压缩率,比通用工具小30.87%。
  • 适合需要精确还原模型的部署与归档场景,支持高速读写。

模型检查点在数量和大小上持续增长,导致存档、传输和部署成本不断上升。通用压缩器虽能降低存储需求,但忽略张量结构;而现有张量专用压缩器依赖固定格式管道。我们提出Brevis,将无损张量压缩建模为程序合成问题。设计一种带类型的领域特定语言(DSL),通过一组可逆操作符捕获重复区域、浮点字段等常见张量结构。给定一个张量,Brevis生成一个自包含的DSL程序,可逐比特重建原数据。基于少量代表性张量学习的检查点特定先验,引导有界A*搜索,生成紧凑程序,后续可直接执行实现比特级解压。在涵盖语言、音频和图像生成模型的10个公开检查点上,Brevis将2.13 TB数据压缩至1.41 TB,存储减少33.93%。生成的压缩包比zstd、gzip等四种通用压缩器小30.87%,也优于ZipNN和DFloat11。在实际并发配置下,压缩速度达3.60 GB/s,解压速度达6.61 GB/s,确保每个源字节完整保留。

原文摘要 · Abstract (English)

Model checkpoints are growing in both number and size, which makes archival, transfer, and deployment increasingly costly. General-purpose compressors can reduce storage requirements but ignore tensor structure, whereas existing tensor-specific compressors rely on fixed and format-specific pipelines. We present Brevis, which formulates lossless tensor compression as program synthesis. We design a typed domain-specific language (DSL) that captures recurring tensor structures, such as repeated regions and floating-point fields, through a set of reversible operators. Given a tensor, Brevis synthesizes a self-contained DSL program that reconstructs it bit-exactly. A checkpoint-specific production prior, learned from a small representative sample of tensors, guides a bounded A* search to synthesize compact programs, which can later be executed directly for bit-exact decompression. On 10 public checkpoints spanning language, audio, and image generation models, Brevis reduces 2.13 TB of checkpoint data to 1.41 TB, a 33.93% storage reduction. It produces archives up to 30.87% smaller than those of four general-purpose compressors, including zstd and gzip, and smaller archives than the tensor-specific compressors ZipNN and DFloat11. Under a practical concurrency configuration, Brevis achieves 3.60 GB/s compression and 6.61 GB/s decompression while preserving every source byte.

无损压缩张量优化程序合成模型部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。