arXiv:2609.06664cs.IRcs.CL2026-09

让论文主题图可审计,每条标签都有原文证据支持。

EviMap: Evidence-Grounded Hierarchical Topic Maps for Exploring Unlabeled Corpora

论文配图:EviMap: Evidence-Grounded Hierarchical Topic Maps for Exploring Unlabeled Corpora
图 1 · 摘自论文原文
  • 用模型生成的上下文引导,从文档中提取证据短语构建三级主题图。
  • 在6个不同数据集上验证,支持用户逐层钻取并交叉比对主题。
  • 适合需要可追溯分析结果的研究者,尤其擅长无标签文本探索。

研究团队常需在无标签、无查询的情况下探索自由文本集合(如评论、报告)。此时首个主题图决定用户关注点,必须可验证。现有方法在规模与可验证性间权衡:定性编码慢,搜索需预设查询,聚类和主题模型虽可扩展但标签难解释,单次大模型摘要流畅却难复现。本文提出EviMap,一个交互式系统,为用户提供可审计的主题概览。基于模型生成的上下文描述和潜在利益相关方关切,系统提取文档内的证据短语,而非整篇文档,组织成三层次结构:方面、组别与细粒度主题。嵌入聚类缩小大模型进行细粒度判断的搜索空间。每个节点可回溯至原文支撑片段,实现文档与主题的证据关联,支持用户审计标签。用户可从顶层地图切入,深入主题,查看原始文档中的高亮证据,并组合两个主题查找同时涉及两者的文档。我们在涵盖2,108至101,699篇文档的六个异构语料上验证该流程,对比了扁平与层级的LLM基线。通过将每个标签锚定在原文片段,EviMap使主题图不仅易读,更可验。代码、演示视频与交互仪表板见https://github.com/zhiyintan/EviMap。

原文摘要 · Abstract (English)

Research teams and organizations often explore unfamiliar free-text collections, from survey comments and reviews to reports and domain documents, before labels, queries or coding schemes exist. At this stage, the first thematic map shapes what users notice, prioritize and carry into downstream analysis, so it should be trusted only insofar as it can be verified. Existing options force a trade-off between scale and verifiability. Qualitative coding preserves evidence but is slow. Search presupposes a query. Clustering and topic models scale but produce labels users must interpret. One-shot large language model (LLM) summaries are fluent yet difficult to reproduce or audit. We present EviMap, an interactive system providing researchers and practitioners with an auditable thematic overview of such corpora. Guided by model-generated context describing the corpus and hypothesized stakeholder concerns, EviMap extracts within-document evidence phrases and organizes them, rather than whole documents, into a three-level map of aspects, groups and fine-grained topics. Embedding-based clustering narrows the search space for finer semantic judgments by the LLM. Each node traces back to supporting phrase spans, so documents link to topics through evidence they contain and users can audit labels against the original text. Users can start from a top-level corpus map, drill into topics, inspect highlighted evidence in original documents, and combine two topics to find documents discussing both. We demonstrate this workflow across six heterogeneous corpora spanning 2,108 to 101,699 documents, with a comparison against flat and hierarchical LLM baselines. By grounding every label in verbatim source spans, EviMap makes a topic map not just readable, but verifiable. Code, demo video, and interactive dashboard are available at https://github.com/zhiyintan/EviMap.

主题建模可解释性文本探索大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。