通过随机丢弃模态,提升重型卡车发动机故障诊断的准确率。
When More Modalities Hurt: Modality Dropout for Heavy-Duty Vehicle Engine Diagnostics

- 训练时随机关闭一个模态,迫使模型依赖弱信号。
- 文本+故障码融合达68.8%准确率,比纯文本提升3.5个百分点。
- 对不同故障类型,各模态优势各异,适配性强。
重型卡车诊断产生三种独立数据模态:非结构化多语言维修投诉、缺失值超80%的高维传感器遥测数据,以及诊断故障码(DTCs)。我们在某大型卡车制造商的专有数据集上,研究三者融合是否提升发动机部件分类性能。在五类发动机部件(885个样本)上进行五折交叉验证,发现朴素融合仅小幅优于纯文本(65.3%)。而训练中引入模态丢弃(每批次随机禁用一个模态),迫使网络依赖弱输入,使文本+DTC融合达到68.8%准确率(加权F1: 0.67),较纯文本提升3.5点(65.3%,加权F1: 0.64),为所有方法最优。分类型分析显示:文本描述症状,DTC编码结构化故障信号,传感器反映物理状态。进排气故障中,传感器单独达93%,文本仅80%;燃油系统故障中,融合+模态丢弃使准确率从15%提升至38%。据我们所知,这是首次在工业车辆诊断中应用文本、传感器与故障码三模态融合。
原文摘要 · Abstract (English)
Heavy-duty vehicle diagnostics generate three disconnected data modalities: unstructured multi- lingual service complaints, high-dimensional sensor telemetry with over 80% missing values, and Diagnostic Trouble Codes (DTCs). We investigate whether fusing these modalities improves engine component classification on a proprietary dataset from a major truck manufacturer. Through 5-fold cross-validation across multiple model configurations spanning three model families on five engine component classes (885 samples, the full cross-database matched population for this manufacturer), we find that naive fusion provides modest gains over text alone (65.3%). However, modality dropout during training, which randomly disables entire modalities per batch, forces the network to exploit weaker inputs and achieves 68.8% accuracy on text+DTC fusion (weighted F1: 0.67), a 3.5-point improvement over text-only (65.3%, weighted F1: 0.64) and the best result across all methods including logistic regression and gradient-boosted trees. Per-class analysis shows that the dominant modality varies by fault type: text describes symptoms, DTCs encode structured fault signals, and sensors measure physical state. On intake/exhaust faults, sensors alone reach 93% where text achieves 80%. On fuel system faults, fusion with modality dropout nearly triples accuracy from 15% to 38% over text alone. To our knowledge, this is the first application of three-way modality fusion combining text, sensors, and fault codes in industrial vehicle diagnostics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。