构建首个科学架构图文本生成数据集,支持高保真自动绘图。
Text2Arch: A Dataset for Generating Scientific Architecture Diagrams from Natural Language Descriptions

- 基于文本描述生成中间代码,再转为高精度架构图。
- 新数据集包含数千张图、对应文字和DOT代码,性能超越基线模型。
- 适合教育、AI设计、企业架构可视化等场景使用。
仅靠文字描述复杂系统或科学流程效率低且易产生歧义。能从自然语言生成高语义保真度的科学架构图的系统,在企业架构可视化、AI驱动的软件设计及教育内容生成中具有广泛应用价值。本文聚焦于利用语言模型理解输入文本,生成可转化为高质量架构图的中间代码。然而,当前缺乏干净的大规模开源数据集,导致该任务缺乏有效的公开模型。为此,我们构建了综合性数据集 extsc{Text2Arch},包含科学架构图、对应的文本描述以及关联的DOT代码表示。基于此资源,我们微调了一系列小型语言模型,并采用GPT-4o进行上下文学习。大量实验表明, extsc{Text2Arch} 模型显著优于现有基线模型(如DiagramAgent),并达到与GPT-4o上下文学习相当的生成水平。代码、数据和模型均已公开。
原文摘要 · Abstract (English)
Communicating complex system designs or scientific processes through text alone is inefficient and prone to ambiguity. A system that automatically generates scientific architecture diagrams from text with high semantic fidelity can be useful in multiple applications like enterprise architecture visualization, AI-driven software design, and educational content creation. Hence, in this paper, we focus on leveraging language models to perform semantic understanding of the input text description to generate intermediate code that can be processed to generate high-fidelity architecture diagrams. Unfortunately, no clean large-scale open-access dataset exists, implying lack of any effective open models for this task. Hence, we contribute a comprehensive dataset, \system, comprising scientific architecture images, their corresponding textual descriptions, and associated DOT code representations. Leveraging this resource, we fine-tune a suite of small language models, and also perform in-context learning using GPT-4o. Through extensive experimentation, we show that \system{} models significantly outperform existing baseline models like DiagramAgent and perform at par with in-context learning-based generations from GPT-4o. We make the code, data and models publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。