arXiv:2505.16256cs.CVcs.AI2025-05被引 2

首个统一图文的轻量级无损压缩模型,性能媲美大模型。

DualComp: End-to-End Learning of a Unified Dual-Modality Lossless Compressor

  • 采用统一分词与专家路由机制,适配图像和文本差异。
  • 参数量仅1.2%却在Kodak上比最优图像压缩高9%。
  • 单机CPU实现近实时压缩,适合部署于资源受限场景。

现有基于学习的无损压缩器多针对单一模态,处理多模态数据需多个独立模型,缺乏灵活性。不同模态在格式与统计特性上差异显著,通用压缩器效果不佳。虽然多模态大语言模型(MLLMs)可提供统一压缩路径,但其复杂性阻碍实际应用。为此,本文聚焦图像与文本两大常见模态,提出DualComp——首个统一、轻量的双模态无损压缩框架。基于轻量骨干网络,引入三项核心结构改进:模态统一分词、模态切换上下文学习与模态路由混合专家。同时采用重参数化训练策略提升压缩性能。模型共享与专用参数并存,实现高效参数利用,在桌面级CPU上达到200KB/s近实时推理速度。相比最先进基于大模型的方法,参数更少却性能相当;其简化版单模态模型在Kodak数据集上较前序最优图像压缩器提升约9%,仅使用1.2%模型规模。

原文摘要 · Abstract (English)

Most learning-based lossless compressors are designed for a single modality, requiring separate models for multi-modal data and lacking flexibility. However, different modalities vary significantly in format and statistical properties, making it ineffective to use compressors that lack modality-specific adaptations. While multi-modal large language models (MLLMs) offer a potential solution for modality-unified compression, their excessive complexity hinders practical deployment. To address these challenges, we focus on the two most common modalities, image and text, and propose DualComp, the first unified and lightweight learning-based dual-modality lossless compressor. Built on a lightweight backbone, DualComp incorporates three key structural enhancements to handle modality heterogeneity: modality-unified tokenization, modality-switching contextual learning, and modality-routing mixture-of-experts. A reparameterization training strategy is also used to boost compression performance. DualComp integrates both modality-specific and shared parameters for efficient parameter utilization, enabling near real-time inference (200KB/s) on desktop CPUs. With much fewer parameters, DualComp achieves compression performance on par with the SOTA LLM-based methods for both text and image datasets. Its simplified single-modality variant surpasses the previous best image compressor on the Kodak dataset by about 9% using just 1.2% of the model size.

无损压缩双模态轻量模型图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。