构建可配置高保真仿真数据集,评测因果表征学习方法。
CausalVerse: Benchmarking Causal Representation Learning with Configurable High-Fidelity Simulations
- 用高保真视觉仿真生成带真实因果结构的数据
- 涵盖24个子场景,共20万张图像、300万帧视频
- 支持灵活修改因果结构,适合研究者测试不同假设
因果表征学习(CRL)旨在揭示数据生成过程并识别潜在的因果变量与关系,但其评估因缺乏已知的真实因果变量与结构而困难重重。现有评估多依赖简单合成数据或真实任务下游表现,难以兼顾真实感与评估精度。本文提出新基准CausalVerse,基于高保真视觉仿真数据,兼具真实视觉复杂性与可访问的真实因果生成过程。数据集包含约20万张图像和300万帧视频,覆盖静态图像生成、动态物理模拟、机器人操作和交通情景分析四个领域,24个子场景。这些场景从静态到动态,从简单到复杂,单代理到多代理交互,提供全面测试平台。此外,用户可灵活访问并配置底层因果结构,以适配CRL中的各类假设,如域标签、时间依赖或干预历史。利用该基准,我们评估了代表性CRL方法,并为实践者和初学者提供实证洞察,帮助选择或扩展合适的CRL框架以应对实际问题。
原文摘要 · Abstract (English)
Causal Representation Learning (CRL) aims to uncover the data-generating process and identify the underlying causal variables and relations, whose evaluation remains inherently challenging due to the requirement of known ground-truth causal variables and causal structure. Existing evaluations often rely on either simplistic synthetic datasets or downstream performance on real-world tasks, generally suffering a dilemma between realism and evaluative precision. In this paper, we introduce a new benchmark for CRL using high-fidelity simulated visual data that retains both realistic visual complexity and, more importantly, access to ground-truth causal generating processes. The dataset comprises around 200 thousand images and 3 million video frames across 24 sub-scenes in four domains: static image generation, dynamic physical simulations, robotic manipulations, and traffic situation analysis. These scenarios range from static to dynamic settings, simple to complex structures, and single to multi-agent interactions, offering a comprehensive testbed that hopefully bridges the gap between rigorous evaluation and real-world applicability. In addition, we provide flexible access to the underlying causal structures, allowing users to modify or configure them to align with the required assumptions in CRL, such as available domain labels, temporal dependencies, or intervention histories. Leveraging this benchmark, we evaluated representative CRL methods across diverse paradigms and offered empirical insights to assist practitioners and newcomers in choosing or extending appropriate CRL frameworks to properly address specific types of real problems that can benefit from the CRL perspective. Welcome to visit our: Project page:https://causal-verse.github.io/, Dataset:https://huggingface.co/CausalVerse.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。