用自然语言把静态图表变互动,无需编程
From Static to Interactive: Authoring Interactive Visualizations via Natural Language
- 通过自然语言指令生成交互动作与调整逻辑
- 支持多种交互方式,用户可灵活定义操作行为
- 适合非技术人员快速为图表添加互动功能
交互性对有效数据可视化至关重要。然而,为现有静态图表添加交互通常困难重重,因为原始代码和数据往往不可用,即使可用也需大量时间与精力。为此,我们提出Athanor,一种基于多模态大语言模型(MLLMs)与自然语言指令的全新方法,将静态可视化转换为交互式形式。该方法包含三项关键创新:(1) 将可视化交互映射为用户动作及对应调整的动作-修改交互设计空间;(2) 多智能体需求分析器,将自然语言指令转化为可执行的操作空间;(3) 可视化抽象转换器,无论底层实现如何,都将静态图表转为灵活可交互的表示。Athanor使用户可通过自然语言轻松创建交互,无需编程。我们通过两项案例研究与深度用户访谈评估了该方法,结果表明其在便捷性与实用性方面均表现良好,能有效为静态可视化添加灵活交互。
原文摘要 · Abstract (English)
Interactivity is crucial for effective data visualizations. However, it is often challenging to implement interactions for existing static visualizations, since the underlying code and data for existing static visualizations are often not available, and it also takes significant time and effort to enable interactions for them even if the original code and data are available. To fill this gap, we propose Athanor, a novel approach to transform existing static visualizations into interactive ones using multimodal large language models (MLLMs) and natural language instructions. Our approach introduces three key innovations: (1) an action-modification interaction design space that maps visualization interactions into user actions and corresponding adjustments, (2) a multi-agent requirement analyzer that translates natural language instructions into an actionable operational space, and (3) a visualization abstraction transformer that converts static visualizations into flexible and interactive representations regardless of their underlying implementation. Athanor allows users to effortlessly author interactions through natural language instructions, eliminating the need for programming. We conducted two case studies and in-depth interviews with target users to evaluate our approach. The results demonstrate the effectiveness and usability of our approach in allowing users to conveniently enable flexible interactions for static visualizations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。