arXiv:2508.00880cs.LGcs.AI2025-08被引 7

分析楼宇暖通系统故障检测中机器学习的可复现性问题

Reproducibility of Machine Learning-Based Fault Detection and Diagnosis for HVAC Systems in Buildings: An Empirical Study

  • 调研100+篇论文,发现近九成结果无法复现
  • 72%论文未说明数据来源,仅2篇提供代码且1个失效
  • 学术与产业作者复现性无显著差异,需制度推动

可复现性是科学研究所必需的基础,使独立验证成为可能。近年来,机器学习(ML)领域也面临透明度与可靠性问题,部分源于数据访问受限、方法细节缺失,以及固有的非确定性与计算约束。本文针对建筑能源系统中机器学习应用的可复现性进行实证研究。结果表明,几乎所有论文在关键维度上均缺乏足够披露:72%未说明数据集是否公开、私有或商业可用;仅两篇提供代码链接,其中一篇已失效。尽管三分之二的研究由纯学术作者完成,但其可复现性与产业合作论文无显著差异。研究呼吁制定可复现性指南、加强研究人员培训,并由期刊与会议推行促进透明度的政策。

原文摘要 · Abstract (English)

Reproducibility is a cornerstone of scientific research, enabling independent verification and validation of empirical findings. The topic gained prominence in fields such as psychology and medicine, where concerns about non - replicable results sparked ongoing discussions about research practices. In recent years, the fast-growing field of Machine Learning (ML) has become part of this discourse, as it faces similar concerns about transparency and reliability. Some reproducibility issues in ML research are shared with other fields, such as limited access to data and missing methodological details. In addition, ML introduces specific challenges, including inherent nondeterminism and computational constraints. While reproducibility issues are increasingly recognized by the ML community and its major conferences, less is known about how these challenges manifest in applied disciplines. This paper contributes to closing this gap by analyzing the transparency and reproducibility standards of ML applications in building energy systems. The results indicate that nearly all articles are not reproducible due to insufficient disclosure across key dimensions of reproducibility. 72% of the articles do not specify whether the dataset used is public, proprietary, or commercially available. Only two papers share a link to their code - one of which was broken. Two-thirds of the publications were authored exclusively by academic researchers, yet no significant differences in reproducibility were observed compared to publications with industry-affiliated authors. These findings highlight the need for targeted interventions, including reproducibility guidelines, training for researchers, and policies by journals and conferences that promote transparency and reproducibility.

可复现性机器学习楼宇系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。