arXiv:2604.03157cs.AI2026-04

用强化学习提升视觉语言模型看懂图表的能力,效果更好、更快、更省资源。

Chart-RL: Policy Optimization Reinforcement Learning for Enhanced Visual Reasoning in Chart Question Answering with Vision Language Models

  • 通过策略优化的强化学习框架,让模型从反馈中改进视觉感知与逻辑推理。
  • 在ChartQAPro上,40亿参数模型准确率达63.4%,超过80亿参数基线模型。
  • 仅需单张显卡微调,推理速度提升至9秒,延迟大幅降低。

视觉语言模型(VLMs)在实现真正智能方面取得进展,但其在图表问答(CQA)任务中仍面临数值提取不准、隐含视觉关系难理解、空间关系注意力不足等问题。本文提出Chart-RL,一种基于策略优化的强化学习框架,通过反馈驱动的策略优化增强模型对图表的理解能力。该框架结合自适应奖励函数与低秩适配(LoRA)的参数高效微调,仅需单卡即可完成训练。在ChartQAPro数据集上,经过强化学习微调的Qwen3-VL-4B-Instruct模型达到63.4%的准确率,优于未微调的80亿参数模型(58.0%),同时将推理时间从31秒降至9秒,显著提升效率与性能。

原文摘要 · Abstract (English)

The recent advancements in Vision Language Models (VLMs) have demonstrated progress toward true intelligence requiring robust reasoning capabilities. Beyond pattern recognition, linguistic reasoning must integrate with visual comprehension, particularly for Chart Question Answering (CQA) tasks involving complex data visualizations. Current VLMs face significant limitations in CQA, including imprecise numerical extraction, difficulty interpreting implicit visual relationships, and inadequate attention mechanisms for capturing spatial relationships in charts. In this work, we address these challenges by presenting Chart-RL, a novel reinforcement learning framework that enhances VLMs chart understanding through feedback-driven policy optimization of visual perception and logical inference. Our key innovation includes a comprehensive framework integrating Reinforcement Learning (RL) from Policy Optimization techniques along with adaptive reward functions, that demonstrates superior performance compared to baseline foundation models and competitive results against larger state-of-the-art architectures. We also integrated Parameter-Efficient Fine-Tuning through Low-Rank Adaptation (LoRA) in the RL framework that only requires single GPU configurations while preserving performance integrity. We conducted extensive benchmarking across open-source, proprietary, and state-of-the-art closed-source models utilizing the ChartQAPro dataset. The RL fine-tuned Qwen3-VL-4B-Instruct model achieved an answer accuracy of 0.634, surpassing the 0.580 accuracy of the Qwen3-VL-8B-Instruct foundation model despite utilizing half the parameter count, while simultaneously reducing inference latency from 31 seconds to 9 seconds.

图表问答强化学习视觉语言模型高效微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。