用AI解决企业ERP系统中多语言员工数据的清洗与查询难题
RAG-Driven Data Quality Governance for Enterprise ERP Systems
- 分阶段清洗+大模型生成SQL,自动处理跨语言数据
- 92.5%查询有效,90.7%语义准确,响应时间从2.3天降至5秒内
- 适合需要高可靠AI数据治理的大型企业应用
管理24万条员工记录的企业ERP系统在多语言环境下面临严重数据质量问题。本文提出端到端解决方案:先通过多阶段清洗流程(包括翻译标准化、拼写纠正、实体去重)定期同步微软SQL Server与PostgreSQL数据;再基于GPT-4o构建检索增强生成框架,将土耳其语、俄语和英语的自然语言问题转化为经过验证的SQL查询。该系统采用LangChain编排、FAISS向量相似度搜索及500+已验证样例的少样本学习。评估显示,对2,847条生产环境查询,系统实现92.5%查询有效性、95.1%模式符合率、90.7%语义准确性。查询响应时间由2.3天缩短至5秒内,系统可用率达99.2%,且相比GPT-3.5降低46%延迟、68%成本。模块化设计支持可复现的AI原生数据治理,在企业级规模下获得4.3/5.0用户满意度。
原文摘要 · Abstract (English)
Enterprise ERP systems managing hundreds of thousands of employee records face critical data quality challenges when human resources departments perform decentralized manual entry across multiple languages. We present an end-to-end pipeline combining automated data cleaning with LLM-driven SQL query generation, deployed on a production system managing 240,000 employee records over six months. The system operates in two integrated stages: a multi-stage cleaning pipeline that performs translation normalization, spelling correction, and entity deduplication during periodic synchronization from Microsoft SQL Server to PostgreSQL; and a retrieval-augmented generation framework powered by GPT-4o that translates natural-language questions in Turkish, Russian, and English into validated SQL queries. The query engine employs LangChain orchestration, FAISS vector similarity search, and few-shot learning with 500+ validated examples. Our evaluation demonstrates 92.5% query validity, 95.1% schema compliance, and 90.7\% semantic accuracy on 2,847 production queries. The system reduces query turnaround time from 2.3 days to under 5 seconds while maintaining 99.2% uptime, with GPT-4o achieving 46% lower latency and 68% cost reduction versus GPT-3.5. This modular architecture provides a reproducible framework for AI-native enterprise data governance, demonstrating real-world viability at enterprise scale with 4.3/5.0 user satisfaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。