arXiv:2605.00392cs.CVcs.LG2026-05中稿 · ICML被引 3

提出双阶段剪枝方法,提升DeepSeek-OCR推理效率与文字保真度。

RTPrune: Reading-Twice Inspired Token Pruning for Efficient DeepSeek-OCR Inference

论文配图:RTPrune: Reading-Twice Inspired Token Pruning for Efficient DeepSeek-OCR Inference
图 1 · 摘自论文原文
  • 分两阶段剪枝:先保留高范数关键视觉标记,再用最优传输合并剩余项。
  • 在OmniDocBench上达99.47%准确率,推理速度提升1.23倍,保留84.25%标记。
  • 动态剪枝率适配文本密度,适合追求高效高精度文档理解的场景。

DeepSeek-OCR通过视觉-文本压缩降低长文本处理成本并加速推理,但视觉标记仍易包含冗余文本与结构信息。现有视觉语言模型的剪枝方法因压缩机制不当,难以保持文本保真度。分析DeepSeek-OCR解码过程发现其具有独特双阶段阅读轨迹:模型初期优先关注多数高范数标记,随后重新分配注意力至剩余标记。受此启发,提出专为DeepSeek-OCR设计的双阶段剪枝方法RTPrune。第一阶段保留捕捉显著文本与结构信息的高范数视觉标记;第二阶段基于最优传输理论对剩余标记成对合并,实现高效特征聚合。引入随标记相似性与文本密度动态调整的剪枝率,优化效率与精度权衡。大量实验表明,该方法在OmniDocBench上以84.25%标记保留率达成99.47%准确率与1.23倍更快的预填充速度,性能达到当前最佳。

原文摘要 · Abstract (English)

DeepSeek-OCR leverages visual-text compression to reduce long-text processing costs and accelerate inference, yet visual tokens remain prone to redundant textual and structural information. Moreover, current token pruning methods for conventional vision-language models (VLMs) fail to preserve textual fidelity due to improper compression mechanisms. By analyzing the decoding process of DeepSeek-OCR, we find that a distinct two-stage reading trajectory: the model initially prioritizes the majority of high-norm tokens, then subsequently redistributes its attention to the remaining ones. Motivated by this insight, we propose RTPrune, a two-stage token pruning method tailored for DeepSeek-OCR. In the first stage, we prioritize high-norm visual tokens that capture salient textual and structural information. In the second stage, the remaining tokens are paired and merged based on optimal transport theory to achieve efficient feature aggregation. We further introduce a dynamic pruning ratio that adapts to token similarity and textual density for OCR tasks, enabling a better efficiency-accuracy trade-off. Extensive experiments demonstrate state-of-the-art performance, as evidenced by 99.47% accuracy and 1.23$\times$ faster prefill on OmniDocBench, achieved with 84.25% token retention when applied to DeepSeek-OCR-Large.

OCR剪枝视觉语言模型推理加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。