构建因果学习统一评测平台,推动可复现、公平的因果研究。
Introducing CausalBench: A Flexible Benchmark Framework for Causal Analysis and Machine Learning
- 设计可扩展的基准框架,整合数据、算法、指标与评估接口
- 支持多场景因果分析,提升研究可比性与透明度
- 适合关注因果推理、公平性与可复现性的研究人员
尽管机器学习在诸多应用中取得卓越成果,用户逐渐意识到其核心缺陷:相关性无法替代因果关系。传统发现因果关系的方法依赖随机对照实验(RCT),但在许多情境下不切实际甚至违背伦理。从观察数据中学习因果关系提供了有前景的替代方案。尽管这一领域相对新兴,却旨在超越传统机器学习,但仍面临诸多挑战。当前进展受限于缺乏统一的基准数据集、算法、评估指标和接口。本文提出 { em CausalBench},一个透明、公平、易用的评估平台,旨在 (a) 通过促进新算法、数据集和指标的科学协作,推动因果学习研究发展;(b) 提升因果学习研究中的科学客观性、可复现性、公平性及对偏差的认知。CausalBench 提供数据、算法、模型和指标的基准测试服务,满足广泛科学与工程领域的需要。
原文摘要 · Abstract (English)
While witnessing the exceptional success of machine learning (ML) technologies in many applications, users are starting to notice a critical shortcoming of ML: correlation is a poor substitute for causation. The conventional way to discover causal relationships is to use randomized controlled experiments (RCT); in many situations, however, these are impractical or sometimes unethical. Causal learning from observational data offers a promising alternative. While being relatively recent, causal learning aims to go far beyond conventional machine learning, yet several major challenges remain. Unfortunately, advances are hampered due to the lack of unified benchmark datasets, algorithms, metrics, and evaluation service interfaces for causal learning. In this paper, we introduce {\em CausalBench}, a transparent, fair, and easy-to-use evaluation platform, aiming to (a) enable the advancement of research in causal learning by facilitating scientific collaboration in novel algorithms, datasets, and metrics and (b) promote scientific objectivity, reproducibility, fairness, and awareness of bias in causal learning research. CausalBench provides services for benchmarking data, algorithms, models, and metrics, impacting the needs of a broad of scientific and engineering disciplines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。