用并行框解码提升视觉定位速度与精度
LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding

- 将框坐标作为原子单位一次性并行解码,保持几何一致性
- 推理吞吐量显著提升,高IoU定位准确率更高
- 基于1.38亿样本数据集,适合需要高效精准定位的场景
视觉语言模型通常将视觉定位与检测建模为坐标-标记生成问题,将每个2D框序列化为多个独立学习和解码的一维标记,导致解码过程严格串行,效率低下。我们提出LocateAnything,一种基于并行框解码(PBD)的统一生成式定位与检测框架。通过将边界框、点等几何元素作为原子单元一次性解码,该方法保持了框内几何一致性,并实现显著并行性。实验表明,PBD在提升解码吞吐量的同时,也提高了定位精度。我们还构建了可扩展的数据引擎,创建了包含超过1.38亿训练样本的LocateAnything-Data数据集,大幅增强了数据多样性以支持高精度定位。大量评估显示,LocateAnything在多个基准上突破了速度-精度权衡,实现了更高的解码效率和更优的高IoU定位性能。结果表明,并行框解码与大规模训练数据具有互补优势,共同推动了高效且精确的统一视觉定位与检测。
原文摘要 · Abstract (English)
Vision-language models (VLMs) commonly formulate visual grounding and detection as a coordinate-token generation problem, serializing each 2D box into multiple 1D tokens that are learned and decoded largely independently. This token-by-token decoding mismatches the coupled structure of box geometry and creates a practical inference bottleneck due to strictly sequential generation. We introduce LocateAnything, a unified generative grounding and detection framework based on Parallel Box Decoding (PBD). By decoding geometric elements such as bounding boxes and points as atomic units in a single step, LocateAnything preserves intra-box geometric coherence and unlocks substantial parallelism. We show that PBD improves both decoding throughput and localization accuracy. We further develop a scalable data engine and curate LocateAnything-Data, a large-scale dataset with more than 138 million training samples, substantially increasing data diversity for high-precision localization. Extensive evaluations show that LocateAnything advances the speed-accuracy frontier, achieving significantly higher decoding throughput while improving high-IoU localization quality across diverse benchmarks. The results highlight the complementary benefits of Parallel Box Decoding and large-scale training data in enabling efficient and precise unified visual grounding and detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。