arXiv:2608.03471cs.CV2026-08

通过分位数编码坐标,提升视觉定位生成精度。

Hi-Token: Hierarchical Coordinate Tokenization for Generative Visual Grounding

论文配图:Hi-Token: Hierarchical Coordinate Tokenization for Generative Visual Grounding
图 1 · 摘自论文原文
  • 将坐标按百十个位分层编码,增强数字结构
  • 在多个数据集上实现更高定位准确率(如IoU提升)
  • 适合需要精确目标定位的视觉语言模型研究者

生成式视觉语言模型通常将边界框坐标视为独立输出符号,隐含了数值顺序与轴向语义。本文指出这种表示是视觉定位错误的重要来源。Hi-Token 采用针对坐标的百位、十位、个位分别编码的分层标记方式,引入粗到细的结构,提升标记复用率,同时保持原有模型架构不变。Hi-GAR 则通过基于几何的奖励机制,配合组相对策略优化(GRPO),在多尺度下评估框重叠度与坐标准确性。在相同训练条件下控制对比表明,Hi-Token 在整个评估的 IoU 范围内均提升了定位效果;Hi-GAR 进一步减少低重叠预测,仅用于训练阶段。在三个 VLM 主干网络及 RefCOCO 系列数据集上的实验显示,各项指标持续提升。Hi-R1 在多数报告指标上优于强基线。对标记频率、数字边界、物体尺度和 IoU 分布的分析揭示了坐标表示与奖励训练的影响机制。结果表明,结构化坐标生成是生成式视觉定位的有效路径。

原文摘要 · Abstract (English)

Generative Vision-Language Models (VLMs) commonly treat bounding-box coordinates as independent output symbols, leaving numerical order and axis semantics implicit. We identify this representation as an important source of error in visual grounding. Hi-Token encodes each coordinate with axis-specific tokens for the hundreds, tens, and ones digits, which adds coarse-to-fine structure and increases token reuse while retaining the existing VLM architecture. Hi-GAR complements this representation with a geometry-based reward for Group Relative Policy Optimization (GRPO), using box overlap and coordinate accuracy at multiple scales. Controlled comparisons under matched training conditions show that Hi-Token improves localization throughout the evaluated IoU range. Hi-GAR further reduces low-overlap predictions and is used only during training. Experiments on three VLM backbones and the RefCOCO family show consistent gains across models and benchmarks. Hi-R1 achieves higher values than strong specialist baselines on most reported metrics. Analyses of token frequency, digit boundaries, object scale, and IoU distributions explain the effects of coordinate representation and reward training. The results show that structured coordinate generation provides an effective approach to generative visual grounding. Project page: https://xyzzzh.github.io/Hi-Token/

视觉定位坐标编码生成模型多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。