arXiv:2602.11494cs.CV2026-02

一个模型实现任意压缩比,无需重新训练。

Arbitrary Ratio Feature Compression via Next Token Prediction

  • 用自回归预测下一个词的方式控制压缩比,推理时调整生成词数即可。
  • 在多个数据集上优于现有方法,部分场景甚至超过原始未压缩特征性能。
  • 引入多解融合与实体关系约束,提升压缩后特征质量与结构保留。

特征压缩对提升下游任务效率至关重要,尤其在大规模或多模态数据应用中。现有方法通常依赖特定模型实现固定压缩比,灵活性差且需重新训练以适配新比例。为此,我们提出一种新型灵活的任意压缩比特征压缩框架(ARFC),仅用一个模型即可支持任意压缩比,无需多个专用模型。核心为自回归压缩器(ARC),通过下一个词预测实现压缩,推理时仅需调整生成词数量即可控制压缩比。为提升压缩质量,引入两个关键模块:多解融合(MoS)通过整合多个压缩结果降低不确定性,增强鲁棒性;实体关系图约束(ERGC)在训练中保留语义与结构关系。在跨模态检索、图像分类和图像检索等多个数据集上的大量实验表明,该方法在不同压缩比下均优于现有方法,部分情况下甚至超越原始未压缩特征性能。结果验证了ARFC在资源受限场景下的有效性与通用性。

原文摘要 · Abstract (English)

Feature compression is increasingly important for improving the efficiency of downstream tasks, especially in applications involving large-scale or multi-modal data. While existing methods typically rely on dedicated models for achieving specific compression ratios, they are often limited in flexibility and generalization. In particular, retraining is necessary when adapting to a new compression ratio. To address this limitation, we propose a novel and flexible Arbitrary Ratio Feature Compression (ARFC) framework, which supports any compression ratio with a single model, eliminating the need for multiple specialized models. At its core, the Arbitrary Ratio Compressor (ARC) is an auto-regressive model that performs compression via next-token prediction. This allows the compression ratio to be controlled at inference simply by adjusting the number of generated tokens. To enhance the quality of the compressed features, two key modules are introduced. The Mixture of Solutions (MoS) module refines the compressed tokens by utilizing multiple compression results (solutions), reducing uncertainty and improving robustness. The Entity Relation Graph Constraint (ERGC) is integrated into the training process to preserve semantic and structural relationships during compression. Extensive experiments on cross-modal retrieval, image classification, and image retrieval tasks across multiple datasets demonstrate that our method consistently outperforms existing approaches at various compression ratios. Notably, in some cases, it even surpasses the performance of the original, uncompressed features. These results validate the effectiveness and versatility of ARFC for practical, resource-constrained scenarios.

特征压缩自回归任意比例多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。