提出可变长度图像分块方法,实现压缩质量可控且重建更清晰。
One-D-Piece: Image Tokenizer Meets Quality-Controllable Compression
- 引入尾部令牌丢弃机制,让关键信息集中于序列开头。
- 在更小文件尺寸下,感知质量优于JPEG和WebP。
- 适用于分类、检测等多类视觉任务,适配性强。
当前图像分块方法需大量令牌来捕捉图像信息,但多数分块器仅支持固定长度,导致令牌分配效率低。本文提出One-D-Piece,一种面向可变长度分块的离散图像分块器,具备质量可控压缩能力。通过引入名为“尾部令牌丢弃”的简单有效正则化机制,使关键信息集中在令牌序列头部,从而支持可变压缩率,同时保持最先进的重建质量。我们在多个重建质量指标上评估该分块器,结果表明其在较小字节尺寸下,感知质量显著优于现有质量可控压缩方法(如JPEG、WebP)。此外,在图像分类、目标检测、语义分割和深度估计等下游任务中,其表现优于其他可变速率方法,验证了其广泛适用性。最后,通过详细分析证实尾部令牌丢弃的有效性。
原文摘要 · Abstract (English)
Current image tokenization methods require a large number of tokens to capture the information contained within images. Although the amount of information varies across images, most image tokenizers only support fixed-length tokenization, leading to inefficiency in token allocation. In this study, we introduce One-D-Piece, a discrete image tokenizer designed for variable-length tokenization, achieving quality-controllable mechanism. To enable variable compression rate, we introduce a simple but effective regularization mechanism named "Tail Token Drop" into discrete one-dimensional image tokenizers. This method encourages critical information to concentrate at the head of the token sequence, enabling support of variadic tokenization, while preserving state-of-the-art reconstruction quality. We evaluate our tokenizer across multiple reconstruction quality metrics and find that it delivers significantly better perceptual quality than existing quality-controllable compression methods, including JPEG and WebP, at smaller byte sizes. Furthermore, we assess our tokenizer on various downstream computer vision tasks, including image classification, object detection, semantic segmentation, and depth estimation, confirming its adaptability to numerous applications compared to other variable-rate methods. Our approach demonstrates the versatility of variable-length discrete image tokenization, establishing a new paradigm in both compression efficiency and reconstruction performance. Finally, we validate the effectiveness of tail token drop via detailed analysis of tokenizers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。