用大模型自动生图,输入文字或代码就能生成结构化图表。
GenAI-DrawIO-Creator: A Framework for Automated Diagram Generation
- 用大模型理解自然语言或代码,生成符合draw.io格式的可编辑图表。
- 原型实测生成准确率高,图像转图也支持,时间大幅缩短。
- 适合需要快速出图的开发者、设计师和科研人员。
图表是传达复杂信息的关键工具,但创建和修改仍耗时费力。我们提出GenAI-DrawIO-Creator,一个利用大型语言模型(LLMs)自动化生成和操作draw.io所用结构化XML格式图表的新框架。系统集成Claude 3.7进行结构化视觉数据推理,生成有效图表表示。核心贡献包括支持实时更新的高层系统设计,以及专门的提示工程与错误检测机制,确保输出的XML格式正确。我们展示了一个可运行原型,能从自然语言或代码生成准确图表(如网络架构图、流程图),甚至可从图像复制图表。模拟评估显示,该方法显著减少绘图时间,且输出具有高结构保真度。结果表明Claude 3.7在处理结构化视觉推理任务上潜力巨大,为未来AI辅助绘图应用奠定基础。
原文摘要 · Abstract (English)
Diagrams are crucial for communicating complex information, yet creating and modifying them remains a labor-intensive task. We present GenAI-DrawIO-Creator, a novel framework that leverages Large Language Models (LLMs) to automate diagram generation and manipulation in the structured XML format used by draw.io. Our system integrates Claude 3.7 to reason about structured visual data and produce valid diagram representations. Key contributions include a high-level system design enabling real-time diagram updates, specialized prompt engineering and error-checking to ensure well-formed XML outputs. We demonstrate a working prototype capable of generating accurate diagrams (such as network architectures and flowcharts) from natural language or code, and even replicating diagrams from images. Simulated evaluations show that our approach significantly reduces diagram creation time and produces outputs with high structural fidelity. Our results highlight the promise of Claude 3.7 in handling structured visual reasoning tasks and lay the groundwork for future research in AI-assisted diagramming applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。