用大模型解析工业文档,让预测模型理解变量含义,提升准确率。
LLM-Guided Task-Semantic Field Factorization for Industrial Process Forecasting

- 基于工艺文档构建任务语义场,让模型理解变量物理意义。
- 在多个工业场景中平均降低3.6%的预测误差,最高降24.9%。
- 仅增加不到5千参数,推理延迟低于8微秒,适合部署。
过程工业依赖时序预测与软传感估算难以在线测量的质量变量。标签数据稀缺,工况频繁变化,每次重训模型或重建对齐管道成本高昂。现有数据常含变量表与工艺文档,记录变量名称、单位、物理意义及工艺角色。但标准时序模型通常将输入视为匿名数值列。现有文本增强方法也极少让模型在每个数值窗口内获取输入变量与目标之间的语义逻辑关系。为此,本文提出任务语义场分解(TSF),一种由大语言模型(LLM)引导的框架。TSF在训练前从任务规程与变量文档构建任务语义场,仅用LLM进行离线语义构造。在线训练与推理由常规时序骨干网络完成。训练与推理过程中,当前数值窗口激活变量语义,使语义信息参与每项预测,支持对不同预测目标与工况切换的自适应。在多个复杂工业预测与延迟软传感任务中,TSF平均降低MAE 3.6%。所有数据集-骨干组合的宏平均降幅为2.9%,最大降幅达24.9%。模型仅增加约0.7–4.3k参数,单样本额外推理开销低于8μs。结果表明,TSF将现有工艺文档转化为跨骨干与语义生成器的实际预测增益,同时保持轻量化部署特性。
原文摘要 · Abstract (English)
Process industries rely on time-series forecasting and soft sensing to estimate quality variables that are hard to measure online. Labeled data are scarce, operating regimes change frequently, and retraining models or rebuilding alignment pipelines for each scenario is costly. Such settings often provide variable tables and process documents that record variable names, units, physical meanings, and process roles. However, standard time-series backbones usually treat inputs as anonymous numerical columns. Existing text-enhanced methods also rarely make the semantic-logical relations between input variables and the prediction target available to the model within each numerical window. To address this problem, this article proposes Task-Semantic Field Factorization (TSF), a large language model (LLM)-guided framework. TSF builds a task-semantic field from task protocols and variable documents before training and uses the LLM only for offline semantic construction. Online training and inference are handled by conventional time-series backbones. During training and inference, the current numerical window activates variable semantics, so semantic information participates in each prediction and supports adaptation to different prediction targets and operating shifts. Across multiple complex industrial forecasting and delayed soft-sensing tasks, TSF reduces MAE by 3.6\% on average. Across all dataset--backbone pairs, the macro-average reduction is 2.9\%, with a maximum reduction of 24.9\%. It adds only about 0.7--4.3k parameters, with less than 8\,$μ$s/sample of additional online inference overhead. These results show that TSF turns existing process documents into measurable forecasting gains across backbones and semantic generators while remaining lightweight for deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。