arXiv:2502.13923cs.CVcs.CL2025-02被引 5.7k

Qwen2.5-VL强化视觉语言理解,支持文档、图表、长视频精准分析。

Qwen2.5-VL Technical Report

  • 采用动态分辨率与绝对时间编码,原生处理多尺度图像和长达数小时的视频。
  • 在发票、表格、图表解析上表现优异,支持边界框与点定位,精度显著提升。
  • 适合作为交互式视觉智能体,用于电脑与手机操作等真实场景任务。

我们推出Qwen2.5-VL,是Qwen视觉语言系列的最新旗舰模型,在基础能力与创新功能上均有显著提升。该模型通过增强的视觉识别、精确的目标定位、稳健的文档解析以及长视频理解,实现了对世界的深入认知与交互。其突出能力包括使用边界框或点精准定位物体,从发票、表单和表格中提取结构化数据,并对图表、示意图和版面进行详细分析。为应对复杂输入,Qwen2.5-VL引入动态分辨率处理和绝对时间编码,可处理不同尺寸图像及长达数小时的视频,实现秒级事件定位,无需依赖传统归一化方法。通过从零训练原生动态分辨率视觉变压器(ViT)并结合窗口注意力机制,降低计算开销同时保持原生分辨率。因此,Qwen2.5-VL不仅在静态图像与文档理解中表现出色,更可作为交互式视觉智能体,具备推理、工具使用与任务执行能力,适用于操作计算机与移动设备等真实场景。该模型提供三种尺寸,覆盖边缘计算到高性能计算的不同需求。旗舰版Qwen2.5-VL-72B在性能上媲美GPT-4o与Claude 3.5 Sonnet,尤其在文档与图示理解方面领先。此外,其语言能力保持了Qwen2.5大语言模型的核心优势。

原文摘要 · Abstract (English)

We introduce Qwen2.5-VL, the latest flagship model of Qwen vision-language series, which demonstrates significant advancements in both foundational capabilities and innovative functionalities. Qwen2.5-VL achieves a major leap forward in understanding and interacting with the world through enhanced visual recognition, precise object localization, robust document parsing, and long-video comprehension. A standout feature of Qwen2.5-VL is its ability to localize objects using bounding boxes or points accurately. It provides robust structured data extraction from invoices, forms, and tables, as well as detailed analysis of charts, diagrams, and layouts. To handle complex inputs, Qwen2.5-VL introduces dynamic resolution processing and absolute time encoding, enabling it to process images of varying sizes and videos of extended durations (up to hours) with second-level event localization. This allows the model to natively perceive spatial scales and temporal dynamics without relying on traditional normalization techniques. By training a native dynamic-resolution Vision Transformer (ViT) from scratch and incorporating Window Attention, we reduce computational overhead while maintaining native resolution. As a result, Qwen2.5-VL excels not only in static image and document understanding but also as an interactive visual agent capable of reasoning, tool usage, and task execution in real-world scenarios such as operating computers and mobile devices. Qwen2.5-VL is available in three sizes, addressing diverse use cases from edge AI to high-performance computing. The flagship Qwen2.5-VL-72B model matches state-of-the-art models like GPT-4o and Claude 3.5 Sonnet, particularly excelling in document and diagram understanding. Additionally, Qwen2.5-VL maintains robust linguistic performance, preserving the core language competencies of the Qwen2.5 LLM.

视觉语言文档理解长视频分析智能代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。