九个大模型协作+检索增强,精准提取工业零件规格信息
Retrieval-Augmented Multi-LLM Ensemble for Industrial Part Specification Extraction
- 多模型并行提取+检索增强,融合不同模型优势
- 在真实工业数据上准确率显著优于单模型基线
- 适合制造业、采购与维护场景的高可靠系统
从非结构化文本中提取工业零件规格仍是制造、采购和维护领域的长期挑战,人工处理耗时且易出错。本文提出一种检索增强型多大模型集成框架RAGsemble,通过结构化三阶段流程协调九个先进大语言模型(LLM),涵盖Gemini(2.0, 2.5, 1.5)、OpenAI(GPT-4o, o4-mini)、Mistral Large及Gemma(1B, 4B, 3n-e4b)等模型家族。系统采用基于FAISS的语义检索实现事实性约束,确保输出可验证。架构包含:(1)多样化模型并行提取;(2)基于高性能模型的目标增强;(3)带冲突消解与置信度评分的智能融合。检索机制实时接入结构化零件数据库,支持相似性匹配参考,用于验证、优化与丰富输出。在真实工业数据集上的实验表明,该方法在提取准确率、技术完整性与结构化输出质量方面均显著优于主流单模型基线。核心贡献包括面向工业领域的可扩展集成架构、全流程的RAG无缝整合、全面的质量评估机制,以及可部署于知识密集型制造环境的生产级解决方案。
原文摘要 · Abstract (English)
Industrial part specification extraction from unstructured text remains a persistent challenge in manufacturing, procurement, and maintenance, where manual processing is both time-consuming and error-prone. This paper introduces a retrieval-augmented multi-LLM ensemble framework that orchestrates nine state-of-the-art Large Language Models (LLMs) within a structured three-phase pipeline. RAGsemble addresses key limitations of single-model systems by combining the complementary strengths of model families including Gemini (2.0, 2.5, 1.5), OpenAI (GPT-4o, o4-mini), Mistral Large, and Gemma (1B, 4B, 3n-e4b), while grounding outputs in factual data using FAISS-based semantic retrieval. The system architecture consists of three stages: (1) parallel extraction by diverse LLMs, (2) targeted research augmentation leveraging high-performing models, and (3) intelligent synthesis with conflict resolution and confidence-aware scoring. RAG integration provides real-time access to structured part databases, enabling the system to validate, refine, and enrich outputs through similarity-based reference retrieval. Experimental results using real industrial datasets demonstrate significant gains in extraction accuracy, technical completeness, and structured output quality compared to leading single-LLM baselines. Key contributions include a scalable ensemble architecture for industrial domains, seamless RAG integration throughout the pipeline, comprehensive quality assessment mechanisms, and a production-ready solution suitable for deployment in knowledge-intensive manufacturing environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。