用自然语言指令自动收集网页数据,减少人工和成本。
AutoData: A Multi-Agent System for Open Web Data Collection
- 多智能体系统通过消息超图协调任务,提升协作效率。
- 在三个领域数据集上表现优于基线方法,降低令牌消耗。
- 适合需要自动化数据采集的研究者与开发者使用。
数据驱动系统与人工智能技术的爆炸式增长加剧了对高质量网络数据集的需求。现有数据采集方法存在人力投入大、可扩展性差的问题:基于包装器的方法适应性差且难以复现,基于大模型的方法则计算与资金成本高昂。为此,我们提出AutoData——一种无需人工干预的自动化网页数据收集多智能体系统,仅需自然语言指令即可定义目标数据集。系统采用创新的定向消息超图架构,由中央任务管理器协调研发团队中的多个智能体。同时引入超图缓存机制,显著提升多智能体协作效率,缓解现有大模型系统的令牌开销问题。我们还构建了Instruct2DS基准数据集,支持学术、金融、体育三个领域的实时数据采集。在Instruct2DS及三个现有基准上的综合评估显示,AutoData性能显著优于基线方法。针对绘本收集、问卷论文提取等复杂任务的案例研究进一步验证其适用性。代码与数据集已开源。
原文摘要 · Abstract (English)
The exponential growth of data-driven systems and AI technologies has intensified the demand for high-quality web-sourced datasets. While existing datasets have proven valuable, conventional web data collection approaches face significant limitations in terms of human effort and scalability. Current data-collecting solutions fall into two categories: wrapper-based methods that struggle with adaptability and reproducibility, and large language model (LLM)-based approaches that incur substantial computational and financial costs. To address these challenges, we propose AutoData, a novel multi-agent system for Automated web Data collection, that requires minimal human intervention, i.e., only necessitating a natural language instruction specifying the desired dataset. In addition, AutoData is designed with a robust multi-agent architecture, featuring a novel oriented message hypergraph coordinated by a central task manager, to efficiently organize agents across research and development squads. Besides, we introduce a novel hypergraph cache system to advance the multi-agent collaboration process that enables efficient automated data collection and mitigates the token cost issues prevalent in existing LLM-based systems. Moreover, we introduce Instruct2DS, a new benchmark dataset supporting live data collection from web sources across three domains: academic, finance, and sports. Comprehensive evaluations over Instruct2DS and three existing benchmark datasets demonstrate AutoData's superior performance compared to baseline methods. Case studies on challenging tasks such as picture book collection and paper extraction from surveys further validate its applicability. Our source code and dataset are available at https://github.com/GraphResearcher/AutoData.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。