arXiv:2412.18673cs.AIcs.HC2024-12KDD被引 1

将投影图坐标转为连贯文本,实现数据探索与生成的无缝衔接。

MapExplorer: New Content Generation from Low-Dimensional Visualizations

  • 基于投影图坐标生成语义一致的文本内容,实现可视化到生成的映射。
  • 在多个数据集上验证了生成科学假说、虚构角色和攻击大模型的有效性。
  • 提出细粒度评估指标Atometric,量化生成文本的逻辑一致性与对齐度。

低维可视化(即“投影图”)广泛应用于科学与创意领域,用于解析大规模复杂数据集。这类可视化不仅有助于理解已有知识空间,还隐式引导探索未知区域。尽管t-SNE和UMAP等技术可生成此类地图,但尚无系统方法利用它们生成新内容。为此,我们提出MapExplorer,一种新型知识发现任务,将任意投影图中的坐标转化为连贯且上下文对齐的文本内容,使用户能交互式地探索并发现嵌入在地图中的洞察。为评估MapExplorer方法的表现,我们提出Atometric,一种受ROUGE启发的细粒度指标,用于量化生成文本与参考文本之间的逻辑连贯性与对齐度。在多样数据集上的实验表明,MapExplorer在生成科学假设、构建合成人格及设计攻击大语言模型策略方面具有广泛适用性,甚至在简单基线方法下也表现良好。通过连接可视化与生成,我们的工作揭示了MapExplorer在大规模数据探索中实现人机协同的巨大潜力。

原文摘要 · Abstract (English)

Low-dimensional visualizations, or "projection maps," are widely used in scientific and creative domains to interpret large-scale and complex datasets. These visualizations not only aid in understanding existing knowledge spaces but also implicitly guide exploration into unknown areas. Although techniques such as t-SNE and UMAP can generate these maps, there exists no systematic method for leveraging them to generate new content. To address this, we introduce MapExplorer, a novel knowledge discovery task that translates coordinates within any projection map into coherent, contextually aligned textual content. This allows users to interactively explore and uncover insights embedded in the maps. To evaluate the performance of MapExplorer methods, we propose Atometric, a fine-grained metric inspired by ROUGE that quantifies logical coherence and alignment between generated and reference text. Experiments on diverse datasets demonstrate the versatility of MapExplorer in generating scientific hypotheses, crafting synthetic personas, and devising strategies for attacking large language models-even with simple baseline methods. By bridging visualization and generation, our work highlights the potential of MapExplorer to enable intuitive human-AI collaboration in large-scale data exploration.

知识发现文本生成可视化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。