arXiv:2604.25914cs.CL2026-04被引 2

评测可视化智能体在真实职场中的综合能力,发现现有模型表现不足50%。

DV-World: Benchmarking Data Visualization Agents in Real-World Scenarios

论文配图:DV-World: Benchmarking Data Visualization Agents in Real-World Scenarios
图 1 · 摘自论文原文
  • 构建跨场景任务集,模拟真实数据处理全流程
  • 多模态评估框架下顶尖模型平均准确率低于50%
  • 适合研究企业级数据智能与人机交互的学者

真实世界的数据可视化(DV)需要原生环境理解、跨平台演进和主动意图对齐。现有基准常受限于代码沙箱、单一语言创作任务,且假设用户意图完全明确。为此,我们提出DV-World,一个包含260个任务的基准,用于评估可视化智能体在真实职业生命周期中的表现。该基准涵盖三个领域:DV-Sheet支持原生表格操作,包括图表与仪表板创建及诊断修复;DV-Evolution要求在不同编程范式下适配并重构参考可视化成果;DV-Interact通过用户模拟器实现与模糊需求的主动对齐。混合评估框架融合表格值对齐(Table-value Alignment)保证数值精度,以及基于多模态大模型的评分机制(MLLM-as-a-Judge)进行语义视觉评估。实验显示,当前最优模型整体性能不足50%,暴露出在复杂现实挑战下的显著短板。DV-World为推动企业级工作流所需多功能能力建设提供了真实测试平台。数据与代码已公开于项目主页。

原文摘要 · Abstract (English)

Real-world data visualization (DV) requires native environmental grounding, cross-platform evolution, and proactive intent alignment. Yet, existing benchmarks often suffer from code-sandbox confinement, single-language creation-only tasks, and assumption of perfect intent. To bridge these gaps, we introduce DV-World, a benchmark of 260 tasks designed to evaluate DV agents across real-world professional lifecycles. DV-World spans three domains: DV-Sheet for native spreadsheet manipulation including chart and dashboard creation as well as diagnostic repair; DV-Evolution for adapting and restructuring reference visual artifacts to fit new data across diverse programming paradigms and DV-Interact for proactive intent alignment with a user simulator that mimics real-world ambiguous requirements. Our hybrid evaluation framework integrates Table-value Alignment for numerical precision and MLLM-as-a-Judge with rubrics for semantic-visual assessment. Experiments reveal that state-of-the-art models achieve less than 50% overall performance, exposing critical deficits in handling the complex challenges of real-world data visualization. DV-World provides a realistic testbed to steer development toward the versatile expertise required in enterprise workflows. Our data and code are available at \href{https://github.com/DA-Open/DV-World}{this project page}.

数据可视化智能代理评估基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。