arXiv:2603.22738cs.LG2026-03被引 2

用多任务信息增强表格大模型,提升钢铁性能预测精度与效率

Multitask-Informed Prior for In-Context Learning on Tabular Data: Application to Steel Property Prediction

  • 通过目标平均和任务适配器改进基础模型先验,融合多性能关联
  • 在真实轧钢数据上超越传统方法与主流表格模型,精度显著提升
  • 适合工业质量控制场景,实现快速、可靠、可扩展的智能预测

热轧过程中钢铁力学性能(如薄板直接轧制,TSDR)的准确预测因化学成分、工艺参数与微观组织间的复杂交互而极具挑战。传统实验与经验方法资源消耗大且难以适应不同生产条件。现有方法普遍未显式利用关键力学性能间的强相关性,错失多任务学习带来的增益。为此,本文提出一种多任务学习框架,通过新型微调策略将多任务感知注入基于Transformer的表格上下文学习基础模型TabPFN的先验中。原为单目标回归/分类设计,现通过两种互补方法扩展:(i) 目标平均,生成兼容单目标架构的统一标量信号;(ii) 任务特定适配器,在微调阶段引入任务特异性监督。二者协同引导模型形成捕捉关键力学指标跨属性关系的多任务感知先验。在真实工业TSDR数据集上的大量实验表明,该方法在多项评估指标上优于经典机器学习与最新表格学习模型。尤其相比任务专用微调,本方法同时提升预测精度与计算效率,验证了多任务感知先验适配使表格基础模型能够实现可扩展、快速、可靠的自动化质量控制与工艺优化部署。

原文摘要 · Abstract (English)

Accurate prediction of mechanical properties of steel during hot rolling processes, such as Thin Slab Direct Rolling (TSDR), remains challenging due to complex interactions among chemical compositions, processing parameters, and resultant microstructures. Traditional empirical and experimental methodologies, while effective, are often resource-intensive and lack adaptability to varied production conditions. Moreover, most existing approaches do not explicitly leverage the strong correlations among key mechanical properties, missing an opportunity to improve predictive accuracy through multitask learning. To address this, we present a multitask learning framework that injects multitask awareness into the prior of TabPFN--a transformer-based foundation model for in-context learning on tabular data--through novel fine-tuning strategies. Originally designed for single-target regression or classification, we augment TabPFN's prior with two complementary approaches: (i) target averaging, which provides a unified scalar signal compatible with TabPFN's single-target architecture, and (ii) task-specific adapters, which introduce task-specific supervision during fine-tuning. These strategies jointly guide the model toward a multitask-informed prior that captures cross-property relationships among key mechanical metrics. Extensive experiments on an industrial TSDR dataset demonstrate that our multitask adaptations outperform classical machine learning methods and recent state-of-the-art tabular learning models across multiple evaluation metrics. Notably, our approach enhances both predictive accuracy and computational efficiency compared to task-specific fine-tuning, demonstrating that multitask-aware prior adaptation enables foundation models for tabular data to deliver scalable, rapid, and reliable deployment for automated industrial quality control and process optimization in TSDR.

钢铁预测多任务学习表格模型工业应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。