arXiv:2601.02578cs.CLcs.IR2026-01被引 1

用自然语言指令实现可复用的在线数据收集,成本降十倍

DataParasite Enables Scalable and Repurposable Online Data Curation

  • 将表格任务拆解为独立实体搜索,通过配置文件驱动
  • 在多个社科任务中准确率高,成本降低一个数量级
  • 无需预定义实体列表,适合研究者快速复用

计算社会科学中的许多问题依赖于从异构网络来源构建的数据集,但这一过程通常耗时、昂贵且难以复现。大语言模型虽能实现智能搜索与结构化提取,但现有系统常不透明、僵化或不适于科学数据整理。本文提出 DataParasite,一个开源、模块化的可扩展在线数据采集流水线。该系统将表格整理任务分解为基于轻量级配置文件的独立实体级搜索,并通过共享的、任务无关的 Python 脚本执行。关键优势在于,同一流水线可通过自然语言指令快速适配新任务,包括无预定义实体列表的情形。我们在多个经典计算社会科学研究任务上评估该方法,涵盖教授招聘史、精英人物逝世事件及政治生涯轨迹等。结果表明,DataParasite 在多项任务中均实现高准确率,同时相较人工整理将数据采集成本降低一个数量级。通过降低技术与人力门槛,DataParasite 为计算社会科学乃至更广泛领域提供了可扩展、透明、可复用的数据整理基础。

原文摘要 · Abstract (English)

Many questions in computational social science rely on datasets assembled from heterogeneous online sources, a process that is often labor-intensive, costly, and difficult to reproduce. Recent advances in large language models enable agentic search and structured extraction from the web, but existing systems are frequently opaque, inflexible, or poorly suited to scientific data curation. Here we introduce DataParasite, an open-source, modular pipeline for scalable online data collection. DataParasite decomposes tabular curation tasks into independent, entity-level searches defined through lightweight configuration files and executed through a shared, task-agnostic python script. Crucially, the same pipeline can be repurposed to new tasks, including those without predefined entity lists, using only natural-language instructions. We evaluate the pipeline on multiple canonical tasks in computational social science, including faculty hiring histories, elite death events, and political career trajectories. Across tasks, DataParasite achieves high accuracy while reducing data-collection costs by an order of magnitude relative to manual curation. By lowering the technical and labor barriers to online data assembly, DataParasite provides a practical foundation for scalable, transparent, and reusable data curation in computational social science and beyond.

数据采集LLM应用可复现性自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。