arXiv:2410.17619cs.CEcs.AI2024-10被引 2

用大模型自动处理体育俱乐部的PDF数据,准确率达90%。

From PDFs to Structured Data: Utilizing LLM Analysis in Sports Database Management

  • 结合GPT-4和Claude 3 Opus,将PDF报告转为结构化数据
  • 处理72份文件,成功转化超7900行数据,错误率仅10%
  • 适合需要自动化处理半结构化文档的组织使用

本研究探讨大型语言模型(LLMs)在将半结构化PDF文档数据转化为结构化格式方面的有效性,重点应用于更新芬兰体育俱乐部数据库。通过行动研究方法,我们开发并评估了一种结合OpenAI GPT-4与Anthropic Claude 3 Opus模型的AI辅助方案,用于处理72份体育联合会会员报告。系统在自动化处理中达到90%成功率,成功处理65份文件且无错误,完成超过7,900行数据转换。尽管初始开发耗时约三个月,与传统人工处理相当,但该系统可使未来处理时间减少约90%。主要挑战包括多语言内容、跨页数据处理及冗余信息管理。研究结果表明,虽LLMs在自动化半结构化数据处理方面潜力显著,但最优效果仍需结合人工智能自动化与选择性人工审核的混合模式。本研究为组织级数据管理中的实际LLM应用提供了新见解,并推动了传统数据处理流程的转型。

原文摘要 · Abstract (English)

This study investigates the effectiveness of Large Language Models (LLMs) in processing semi-structured data from PDF documents into structured formats, specifically examining their application in updating the Finnish Sports Clubs Database. Through action research methodology, we developed and evaluated an AI-assisted approach utilizing OpenAI's GPT-4 and Anthropic's Claude 3 Opus models to process data from 72 sports federation membership reports. The system achieved a 90% success rate in automated processing, successfully handling 65 of 72 files without errors and converting over 7,900 rows of data. While the initial development time was comparable to traditional manual processing (three months), the implemented system shows potential for reducing future processing time by approximately 90%. Key challenges included handling multilingual content, processing multi-page datasets, and managing extraneous information. The findings suggest that while LLMs demonstrate significant potential for automating semi-structured data processing tasks, optimal results are achieved through a hybrid approach combining AI automation with selective human oversight. This research contributes to the growing body of literature on practical LLM applications in organizational data management and provides insights into the transformation of traditional data processing workflows.

大模型应用数据自动化结构化提取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。