arXiv:2607.08221cs.CV2026-07

用嵌入空间替代文本转换,让大模型无须依赖分词器实现图像无损压缩。

LUMI: Tokenizer-Agnostic LLM-Based Lossless Image Compression

论文配图:LUMI: Tokenizer-Agnostic LLM-Based Lossless Image Compression
图 1 · 摘自论文原文
  • 将像素直接映射到模型嵌入空间,摆脱对分词器的依赖。
  • 在多个数据集上达到与现有方法相当的压缩率,跨领域鲁棒性更强。
  • 适合希望统一适配不同大模型、避免分词器干扰的图像压缩研究者。

基于大语言模型(LLM)的无损图像压缩方法通常通过预训练模型的原生文本接口表示像素数据,将像素值转换为令牌序列由模型处理。这种方法虽能利用预训练模型的概率估计能力,但会绑定分词器行为、词汇特定的数值令牌及模型家族特异性适配。本文提出LUMI(LLM-based Unified Model-agnostic lossless Image compression),一种基于冻结LLM骨干网络的分词器无关无损图像压缩框架。LUMI以像素嵌入模块替代像素转文本的分词方式,将原始强度和通道信息映射至LLM的连续嵌入空间;引入片内位置编码保留展平后的二维空间结构;采用256路预测头生成对原生像素字母表的概率估计。仅训练像素嵌入、位置编码、软前缀参数和预测头,保持LLM主干固定。在自然、医疗和遥感图像基准测试中使用LLaMA、Qwen和Gemma骨干网络的实验表明,LUMI实现了跨分词器家族的统一接口,取得有竞争力的压缩率,并显著提升跨域鲁棒性。结果表明,应将基于大模型的无损图像压缩视为冻结基础模型的像素空间适配,而非分词器特异的语言符号建模。

原文摘要 · Abstract (English)

Large language model (LLM)-based lossless image compression methods typically represent pixel data through the native text interface of a pretrained model, converting pixel values into token sequences that the LLM processes through its vocabulary head. This design shows that pretrained language models can provide probability estimates for image coding, but it also couples compression to tokenizer behavior, vocabulary-specific numeric tokens, and model-family-specific adaptation. In this paper, we present LUMI (LLM-based Unified Model-agnostic lossless Image compression), a tokenizer-agnostic framework for lossless RGB image compression with frozen LLM backbones. LUMI replaces pixel-as-text tokenization with a pixel embedding module that maps raw intensity and channel information into the continuous embedding space of the LLM. It further introduces intra-patch position encoding to retain two-dimensional spatial structure after flattening, and uses a 256-way prediction head to produce probabilities over the native pixel alphabet. Only the pixel embedding, position encoding, soft-prefix parameters, and prediction head are trained, while the LLM backbone remains fixed. Experiments on natural, medical, and remote-sensing image benchmarks with LLaMA, Qwen, and Gemma backbones show that LUMI provides a unified interface across tokenizer families, achieves competitive compression rates, and improves cross-domain robustness over tokenizer-based LLM compression baselines. These results formulate LLM-based lossless image compression as pixel-space adaptation of frozen foundation models rather than tokenizer-specific language-symbol modeling.

图像压缩大模型无损嵌入空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。