arXiv:2604.16317cs.IRcs.AI2026-04

从1.5万篇论文中自动提取6万+城市数据集,构建可搜索的开放平台。

Paper2Data: Large-Scale LLM Extraction and Metadata Structuring of Global Urban Data from Scientific Literature

论文配图:Paper2Data: Large-Scale LLM Extraction and Metadata Structuring of Global Urban Data from Scientific Literature
图 1 · 摘自论文原文
  • 用大模型自动识别论文中的数据集并统一结构化元信息。
  • 数据识别召回率达90%,字段精确度超80%。
  • 发现谷歌难搜到的9%冷门数据集,适合跨学科研究者使用。

城市数据支撑多学科应用,但全球范围内缺乏统一的数据发现平台,研究者常需手动检索网站或文献。为此,我们构建了开源的城市数据发现门户 extit{UrbanDataMiner},支持对超过60,000个来自15,000篇自然杂志关联论文的城市数据集进行逐项搜索与筛选。该平台由 extit{Paper2Data} 驱动,这是一个大规模、基于大模型的自动化流水线,能从科学论文中自动识别数据集提及,并以统一的城市数据元信息模式进行结构化。人工标注评估显示, extit{Paper2Data} 在数据集识别上达到约90%的召回率,字段级精确度高于80%。此外, extit{UrbanDataMiner} 可检索到超过9%通过通用搜索引擎(如Google)难以发现的数据集。本工作首次建立了基于文献的大规模城市数据发现基础设施,推动跨学科数据驱动研究的系统性与可复用性。代码与数据已公开:https://github.com/Yourunwen/Paper2Data。

原文摘要 · Abstract (English)

Urban data support a wide range of applications across multiple disciplines. However, at the global scale, there is no unified platform for urban data discovery. As a result, researchers often have to manually search through websites or scientific literature to identify relevant datasets. To address this problem, we curate an open urban data discovery portal, \textit{UrbanDataMiner}, which supports dataset-level search and filtering over more than 60{,}000 urban datasets extracted from over 15{,}000 Nature-affiliated publications. \textit{UrbanDataMiner} is enabled by \textit{Paper2Data}, a novel large-scale LLM-driven pipeline that automatically identifies dataset mentions in scientific papers and structures them using a unified urban data metadata schema. Human-annotated evaluation demonstrates that \textit{Paper2Data} achieves high recall (approximately 90\%) in dataset identification and high field-level precision (above 80\%). In addition, \textit{UrbanDataMiner} can retrieve over 9\% of datasets that are not easily discoverable through general-purpose search engines such as Google. Overall, our work provides the first large-scale, literature-derived infrastructure for urban data discovery and enables more systematic and reusable data-driven research across disciplines. Our code and data are publicly available\footnote{https://github.com/Yourunwen/Paper2Data}.

城市数据大模型数据发现文献挖掘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。