构建可复现的故障预测评估框架,统一多任务多领域标准
Picid: A Modular Evaluation Infrastructure for Reproducible PHM Across Tasks and Domains
- 将故障预测评估流程模块化为可执行协议
- 在12个数据集上验证13种模型,结果可比可复现
- 适合需要公平对比模型性能的研究者使用
故障预测与健康管理(PHM)的发展受限于跨任务、数据集和应用领域缺乏标准化、可复用的评估实践。现有报告结果常难以复现和比较,因数据划分、预处理、标签对齐、时间窗口设定及评价指标等关键协议选择常隐含或随意实现。本文提出 extit{Picid},一个模块化的评估基础设施,将 PHM 评估流程形式化为显式、可执行、可复现的协议。通过明确定义的抽象, extit{Picid} 实现确定性、防泄漏的数据集构建,同时保持对多样化 PHM 场景的灵活性。该框架通过统一接口支持故障检测、诊断和预测任务,且可扩展至新数据集和模型类别而不破坏协议一致性。通过标准化数据契约与评估边界, extit{Picid} 还实现了诊断(分类)与预测(回归)任务间的公平跨任务比较,使同一模型族可在异构设置下一致评估。我们在电池、轴承、涡轮发动机、液压系统、过滤系统及建筑等12个数据集上,对13种模型进行了实证评估。本工作为 PHM 领域建立了可复用的标准、公平、可复现的评估基础。
原文摘要 · Abstract (English)
Progress in Prognostics and Health Management (PHM) is hindered by the lack of standardized and reusable evaluation practices across tasks, datasets, and application domains. Reported results are often difficult to reproduce and compare, as key protocol choices, such as data splits, preprocessing, label alignment, temporal windowing, and metrics, are often implicit or implemented ad hoc. We introduce \picid, a modular evaluation infrastructure that formalizes the PHM evaluation pipeline as an explicit, executable, and reproducible protocol. Through well-defined abstractions, \picid enforces deterministic, leakage-safe dataset construction while remaining flexible across diverse PHM settings. The framework supports fault detection, diagnostics, and prognostics through a unified interface and can be extended to new datasets and model classes without violating protocol invariants. By standardizing data contracts and evaluation boundaries, \picid also enables fair cross-task comparisons across diagnostics (classification) and prognostics (regression), allowing identical model families to be evaluated consistently across heterogeneous settings. We demonstrate \picid through an empirical evaluation of thirteen models on twelve datasets spanning batteries, bearings, turbofan engines, hydraulics, filtration systems, and buildings. This work establishes a reusable foundation for standardized, fair and reproducible evaluation in PHM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。