arXiv:2606.21033eess.IVcs.AI2026-06

用专家混合动态压缩图像,兼顾人眼与机器视觉需求。

MoECodec: Image Compression for joint human and machine perception via Mixture-of-Experts

论文配图:MoECodec: Image Compression for joint human and machine perception via Mixture-of-Experts
图 1 · 摘自论文原文
  • 以专家混合机制实现按图像区域动态计算,适应不同语义重要性。
  • 在重建质量和机器任务性能上均优于基线模型。
  • 适合需要统一压缩方案的多任务视觉系统开发者。

面向机器的图像压缩需统一编码器支持多种下游视觉任务。现有方法或采用任务专用端到端设计,导致参数和部署开销大;或依赖外部迁移适配,任务设计仍为启发式。两者共有的局限是计算模式僵化,对所有图像区域使用相似变换,忽略了不同区域对机器感知的语义重要性和复杂度差异。本文提出MoECodec,一种支持多任务的令牌感知压缩框架。通过将基于Transformer的压缩模型中的前馈网络替换为令牌级混合专家(MoE),实现根据输入内容和任务目标动态调整计算量。为提升压缩模型中MoE的有效性,提出结合专家选择路由与空间总变差正则化的稳定路由策略,促进空间上一致的专家分配,并设计轻量级专家结构组交错MLP(GShMLP)以控制参数增长。大量实验表明,该方法在传统图像重建及机器任务上均持续优于基线。

原文摘要 · Abstract (English)

Image compression for machines calls for a unified codec that serves multiple downstream vision tasks. Existing approaches either adopt task-specific end-to-end designs, raising parameter and deployment overhead, or rely on transfer-based adaptations that remain externally attached and heuristic task design. A key limitation shared by both lines of work is their largely static computation pattern, which applies similar transformations across tokens despite the fact that different image regions exhibit markedly different semantic importance and complexity for machine perception. We propose MoECodec, a token-aware image compression framework that supports multiple downstream tasks within a single model. MoECodec replaces the FFN layers in transformer-based compression model token-wise Mixture-of-Experts (MoE), enabling dynamic, token-level computation conditioned on the input content and task objective. To make MoE effective in compression model, we introduce a stable routing strategy that combines expert-choice routing with spatial total variation regularization to encourage spatially coherent assignments, and we propose a lightweight expert architecture, Group Shuffle MLP (GShMLP), to control parameter growth. Extensive experiments show consistent improvement against baselines on both conventional image reconstruction and machine tasks.

图像压缩专家混合多任务Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。