用大模型自动设计图表,提升准确率与视觉美感
ChartDesign: Towards LLM Designer of Data Visualization
- 让大模型学习人类专家的作图逻辑,从表格数据生成设计参数
- 在测试集上准确率达84%,比最强基线高31个百分点
- 适合需要高效可视化、降低设计门槛的研究与业务场景
图表是呈现数据、发现模式和传达洞察的主要方式,但设计仍需大量人力与专业知识,如选择合适的图表类型、坐标轴方向、字体大小和布局。现有自动化系统多依赖人工规则,难以跨领域泛化。本文提出ChartDesign,通过后训练大语言模型模仿人类专家,根据表格数据生成图表设计属性。我们从公共调查(PewResearch)和学术库(CharXiV)中收集多样化的数据-设计配对,利用视觉语言模型提取图表中的设计信息,包括图表类型、子类型、对齐方式、标题、坐标轴标签和柱状间距,并以JSON格式整理。随后在Phi3、Qwen3和InternVL2.5上微调LoRA适配器,学习从数据到设计规范的映射。实验表明,ChartDesign在保留测试集上达到84%准确率(优于最佳基线53%),并能泛化至未见领域。生成的设计所渲染的图表视觉效果佳,获人类偏好认可,显著缩小了人与AI在数据可视化上的差距。
原文摘要 · Abstract (English)
Charts are the dominant medium for visualizing data, discovering patterns and trends, and communicating data driven insights, yet designing them still requires expensive human effort and expertise, such as selecting appropriate chart types, axis orientations, font sizes, and layouts. Most automatic visualization systems rely on handcrafted heuristics or simple rule matching and therefore struggle to generalize across domains. This work explores the potential of large language models (LLMs) as chart designers. We propose ChartDesign, which post-trains LLMs to imitate human experts and generate chart design attributes given tabular data. To this end, we curate a diverse training corpus of data design pairs from charts in public surveys (PewResearch) and academic repositories (CharXiV). Vision language models are used to extract data and design attributes from these charts, including chart type, sub type, alignment, titles, axis labels, and bar spacing, formatted as JSON. We then fine tune LoRA adapters on Phi3, Qwen3, and InternVL2.5 to learn a mapping from data to design specifications. ChartDesign significantly improves chart design performance over strong baselines, achieving up to 84% accuracy on a held-out test set (vs. 53% for the best baseline) and generalizing to unseen domains. We further show that charts rendered from ChartDesign generated specifications are visually appealing and human preferred, narrowing the human AI gap in data visualization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。