arXiv:2606.15314cs.LGcs.AI2026-06

LLMs在工业车辆改装预测中辅助表现优于替代,尤其适合与传统模型结合使用。

LLMs on Tabular Data with Limited Semantics: Evidence from Industrial Car Retrofit Prediction

论文配图:LLMs on Tabular Data with Limited Semantics: Evidence from Industrial Car Retrofit Prediction
图 1 · 摘自论文原文
  • 用LLM嵌入特征提升表格数据建模效果
  • 直接提示词在无语义信息时性能崩塌(AUC=0.5)
  • 混合堆叠模型在多分类任务中表现最佳(F1=0.626)

工业改造规划依赖结构化运营数据而非自由文本:需判断新注册原型车是否需要改造、需何种改造包及改造时长。研究基于284,271辆车辆注册数据与48,716条清洗后的改造记录,对比强基准模型与三种基于LLM的策略(特征嵌入、直接提示分类、ML+LLM堆叠)在行序列输入下的表现。在二分类、15类改造类型分类、单次改造时长回归及月度汇总基准上,经典树集成模型仍为最优独立模型。但结果表明:嵌入特征在表格上仍有价值(二分类AUC=0.982),直接提示在语义被哈希去除后失效(二分类AUC=0.500;多分类加权F1=0.018),而混合堆叠模型成为人工构建的最佳多分类模型(加权F1=0.626)。在月度基准中,滞后特征的机器学习优于时间序列基础模型,尽管Chronos-small在零样本预测中仍具竞争力。结果表明,在隐私受限的工业表格数据上,LLM更适合作为补充组件而非替代强基线模型。

原文摘要 · Abstract (English)

Industrial retrofit planning depends on structured operational data rather than free text: planners must estimate whether a newly registered prototype will require a retrofit, which retrofit package it will need, and how long the work will take. We study an industrial dataset linking a prototype-registration system (284,271 vehicles) with a retrofit-management system (48,716 cleaned visits), and compare strong tabular machine learning baselines with three LLM-based strategies on row-serialized inputs: embedding features (Amazon Titan), direct prompted classification (Claude Sonnet 4), and an ML+LLM stacking approach. Across binary occurrence prediction, 15-way retrofit-type classification, per-visit duration regression, and an aggregated monthly benchmark, classical tree ensembles remain the strongest standalone models. However, the LLM results reveal a consistent pattern: embeddings remain useful on tables (binary AUC = 0.982), direct prompting collapses once semantic signal is stripped by hashing (binary AUC = 0.500; multiclass weighted F1 = 0.018), and hybrid stacking yields the best manually built multiclass model (weighted F1 = 0.626). On the monthly benchmark, lag-based machine learning outperforms time-series foundation models, though Chronos-small remains competitive in zero-shot forecasting. The results suggest that on privacy-constrained industrial tables, LLMs are more effective as complementary components than as replacements for strong tabular baselines.

表格数据LLM应用工业预测混合模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。