让可视化生成过程可解释,用户能看清每一步设计思路。
DeepVIS: Bridging Natural Language and Data Visualization Through Step-wise Reasoning
- 引入思维链推理,将自然语言转可视化的流程拆解为可追踪步骤。
- 构建nvBench-CoT数据集,支持模型在模糊描述下生成高质量可视化。
- 开发交互界面,支持用户检查推理步骤并精准修改输出结果。
尽管数据可视化能有效揭示模式并传递洞察,但制作高效可视化需熟悉创作工具,常打断分析流程。大语言模型虽有望自动将分析意图转化为可视化,但现有方法缺乏透明的推理过程,导致用户无法理解设计逻辑,也无法优化不理想的输出。为此,我们提出在自然语言转可视化(NL2VIS)流程中融入思维链(CoT)推理。首先,设计了完整的NL2VIS思维链推理流程,并开发自动化管道为现有数据集添加结构化推理步骤。其次,提出nvBench-CoT数据集,捕捉从模糊自然语言描述到最终可视化之间的详细分步推理过程,用于模型微调时实现顶尖性能。第三,开发DeepVIS交互式界面,紧密集成于CoT推理流程,使用户可查看推理步骤、发现错误并进行针对性调整。定量基准评估、两个使用案例及用户研究共同表明,该CoT框架显著提升NL2VIS质量,同时为用户提供有价值的推理洞察。
原文摘要 · Abstract (English)
Although data visualization is powerful for revealing patterns and communicating insights, creating effective visualizations requires familiarity with authoring tools and often disrupts the analysis flow. While large language models show promise for automatically converting analysis intent into visualizations, existing methods function as black boxes without transparent reasoning processes, which prevents users from understanding design rationales and refining suboptimal outputs. To bridge this gap, we propose integrating Chain-of-Thought (CoT) reasoning into the Natural Language to Visualization (NL2VIS) pipeline. First, we design a comprehensive CoT reasoning process for NL2VIS and develop an automatic pipeline to equip existing datasets with structured reasoning steps. Second, we introduce nvBench-CoT, a specialized dataset capturing detailed step-by-step reasoning from ambiguous natural language descriptions to finalized visualizations, which enables state-of-the-art performance when used for model fine-tuning. Third, we develop DeepVIS, an interactive visual interface that tightly integrates with the CoT reasoning process, allowing users to inspect reasoning steps, identify errors, and make targeted adjustments to improve visualization outcomes. Quantitative benchmark evaluations, two use cases, and a user study collectively demonstrate that our CoT framework effectively enhances NL2VIS quality while providing insightful reasoning steps to users.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。