arXiv:2606.19646cs.IRcs.CV2026-06

通过智能路由减少图表问答中昂贵的视觉模型调用

SAFE-Cascade: Cost-Adaptive Vision-Language Routing for Chart Question Answering

论文配图:SAFE-Cascade: Cost-Adaptive Vision-Language Routing for Chart Question Answering
图 1 · 摘自论文原文
  • 先用OCR提取文字,再用轻量语言模型初答,由学习器决定是否升级到视觉模型
  • 在保持99%准确率的同时,将视觉模型调用降低26.9%,成本减少9.3%
  • 用户可实时查看决策依据,灵活调整阈值以权衡精度与成本

视觉语言模型(VLM)在图表问答中表现强大,但每次查询都调用VLM代价高昂。本文提出SAFE-Cascade,一种成本自适应的交互式图表问答系统。给定图表图像和自然语言问题,系统首先通过OCR提取图表文本,使用纯文本语言模型生成初步答案,再由一个学习的路由器判断是否接受该答案或升级至VLM。演示界面直观展示OCR证据、文本答案、路由概率、升级决策、最终答案、预估成本与延迟。系统基于Azure Document Intelligence进行OCR,采用gpt-5-mini作为文本模型,gemini-2.5-flash-image作为VLM,随机森林路由器基于运行时特征训练。在375个测试样本上,系统实现69.1%统一准确率,仅需73.1%的VLM调用,相比全量使用VLM的基线(67.7%准确率,100%调用),提升不显著,可视为性能相当而调用减少26.9%,成本降低9.3%。演示表明,选择性模态路由能提升多模态系统的透明度、可调性和成本意识。

原文摘要 · Abstract (English)

Vision-language models (VLMs) are powerful for chart question answering, but invoking a VLM for every query can be unnecessarily expensive when many questions are answerable from OCR text and lightweight language reasoning. We demonstrate SAFE-Cascade, an interactive system for cost-adaptive chart question answering. Given a chart image and a natural-language question, SAFE-Cascade first extracts chart text with OCR, obtains a provisional answer from a text-only language model, and then uses a learned router to decide whether to accept the text answer or escalate to a VLM. The demo exposes this decision process to users: OCR evidence, text-only answer, routing probability, escalation decision, final answer, estimated cost, and estimated latency are shown side by side. SAFE-Cascade is designed as a transparent interface for understanding when visual grounding is actually needed. Users can upload or select charts, ask questions, inspect the evidence used by each pathway, compare text-only and VLM answers, and adjust the escalation threshold to explore the accuracy-cost frontier. The system is implemented with Azure Document Intelligence for OCR, gpt-5-mini as the text-only model, gemini-2.5-flash-image as the VLM, and a Random Forest router trained on inference-time features. On a held-out ChartQA test split of 375 examples from a 2,500-example experiment, SAFE-Cascade achieves 69.1% unified accuracy with 73.1% VLM invocation, compared with 67.7% accuracy and 100% VLM invocation for the full-VLM baseline. The observed +1.4 percentage-point difference is statistically uncertain, so we interpret SAFE-Cascade as matching full-VLM performance while reducing VLM calls by 26.9% and estimated cost by 9.3%. The demonstration shows how selective modality routing can make multimodal knowledge systems more transparent, tunable, and cost-aware.

图表问答视觉语言模型成本优化智能路由

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。