融合多模态数据与物理规律,提升化工批次过程异常检测与预测精度。
UTOPYA: A Multimodal Deep Learning Framework for Physics-Informed Anomaly Detection and Time-Series Prediction

- 通过FiLM调制注意力与门控融合,整合八类传感器数据。
- 窗口级测试AUROC达0.832,实验级多信号评分0.874,显著优于基线。
- 揭示正则化与异常检测间的矛盾,指导实际部署中的模型设计。
批次过程中的异常检测受限于瞬态动态、故障标签稀缺及单一模态传感器数据依赖。本文提出UTOPYA(统一时间观测物理信息异常检测与时序预测框架),一个1520万参数的多模态深度学习框架,通过特征逐维线性调制(FiLM)条件交叉模态注意力与门控融合,联合解决批次蒸馏中的异常检测、时序预测与相位分类问题。引入物理信息正则化,强制时间平滑性与热力学单调性;采用课程学习,按物理难度顺序引入训练样本。在Arweiler等(2026)的119个实验多模态批次蒸馏数据集上,UTOPYA实现窗口级测试AUROC 0.832,实验级多信号评分0.874,显著优于四种外部基线(PCA、自编码器、孤立森林、LSTM自编码器),最高提升+0.147。15种架构消融表明,静态上下文通过FiLM调制是关键,使实验级多信号AUROC从0.729提升至0.874。14种训练策略消融显示,实例归一化、Mixup、集成、测试时增强、随机权重平均等常用技术在数据稀缺环境下非但无益,反而损害泛化能力,揭示平滑正则化与异常检测之间的根本张力,为多模态过程监控部署提供实用指导。
原文摘要 · Abstract (English)
Anomaly detection in batch processes is hindered by transient dynamics, scarce fault labels, and reliance on single-modality sensor data. This work introduces UTOPYA (Unified Temporal Observation for Physics-Informed Anomaly Detection and Time-Series Prediction), a 15.2M-parameter multimodal framework that jointly addresses anomaly detection, time-series prediction, and phase classification in batch distillation by fusing eight data modalities through Feature-wise Linear Modulation (FiLM) conditioned cross-modal attention and gated fusion. A physics-informed regularisation scheme introduced in this work enforces temporal smoothness and thermodynamic monotonicity, while curriculum learning introduces training samples in order of physical difficulty. On the 119-experiment multimodal batch distillation dataset of Arweiler et al. (2026), UTOPYA achieves a window-level test AUROC of 0.832 and 0.874 under multi-signal experiment-level scoring, substantially outperforming four external baselines (PCA, autoencoder, Isolation Forest, and LSTM autoencoder) evaluated under identical conditions (+0.147 window-level AUROC over the best baseline). A multimodal ablation over 15~architectural configurations shows that static context via FiLM conditioning is the key enabler, lifting experiment-level multi-signal AUROC by +0.145 over the unimodal baseline (0.729 to 0.874). Separately, a training ablation across 14 design choices reveals that several widely-adopted techniques, including instance normalisation, Mixup, ensembling, test-time augmentation, and stochastic weight averaging, fail to improve or actively degrade generalisation in this data-scarce setting. These negative results expose a fundamental tension between smoothing-based regularisation and anomaly detection, providing practical guidance for multimodal process monitoring deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。