arXiv:2606.11605cs.LGcs.AI2026-06

用大模型提取物理知识,训练轻量高精度制造过程预测模型。

Physics-Distilled Neural Network enabled by Large Language Models for Manufacturing Process-Property Predictive Modeling

  • 通过大模型从文献提取物理先验,构建带知识的教师模型。
  • 在小数据下仍保持高精度,跨五类制造工艺稳定有效。
  • 学生模型推理超6000 Hz,适合工业实时部署。

制造过程-性能关系的预测常受限于高昂实验成本和复杂黑箱模型的不可解释性。本文提出一种新型知识蒸馏框架,在数据稀缺场景下实现高精度预测。该框架通过大语言模型从科学文献系统提取解析性物理先验,并融入特权教师模型;采用图掩码注意力层捕捉输入变量间的复杂物理依赖,包括严格设定值或静态与高频时序特征组合。此特权知识被蒸馏至轻量学生预测器以供推理。在五个不同制造工艺上开展全面实验,鉴于数据集规模小,采用重复K折交叉验证以确保统计可靠性。结果表明,该框架在所有评估领域均持续实现高预测精度。尤为重要的是,即使大模型提取的物理先验不完整或欠优,架构仍表现出显著容错能力,维持稳健预测性能。此外,学生预测器推理频率超过6000 Hz,可实现在标准工业硬件上的实时边缘部署。本工作为连接理论物理与数据受限环境下的实时工业监测提供了可扩展解决方案。

原文摘要 · Abstract (English)

Predicting process-property relationships in manufacturing is often challenged by high experimental costs and the limited interpretability of complex 'black-box' models. This paper proposes a novel knowledge distillation framework designed to achieve high-accuracy predictions in data-scarce scenarios. The framework integrates analytical physics priors, which are systematically extracted from scientific literature via Large Language Models, into a privileged teacher model. We employ a Graph-Masked Attention layer to capture the complex physical dependencies among input variables showing strict setpoints or a combination of static and high-frequency temporal signatures. This privileged knowledge is distilled into a lightweight student predictor for inference. The feasibility and robustness of the framework are evaluated through a comprehensive experiment across five diverse manufacturing processes. To ensure statistical reliability, given the small dataset sizes, a repeated K-fold cross-validation technique is employed to quantify model stability and generalization. Results indicate that the proposed framework consistently achieves high predictive accuracy across all evaluated domains. Most importantly, the architecture demonstrates significant fault tolerance by maintaining robust predictive performance even in scenarios where LLM-derived analytical priors are suboptimal or incomplete. Furthermore, the student predictor achieves an inference frequency exceeding 6000 Hz, which facilitates real-time edge deployment on standard industrial hardware. This work provides a scalable solution for bridging the gap between theoretical physics and real-time industrial monitoring in data-limited environments.

制造预测知识蒸馏大模型应用实时推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。