首个统一多领域信道基础模型评测基准,支持跨模型可复现比较。
CFM-Bench: A Unified Multi-Domain, Multi-Task Benchmark for Channel Foundation Models

- 构建涵盖6个领域的统一数据集,保留原始信道状态信息与物理元数据。
- 包含15.79万张单帧样本,划分严格避免时空泄漏,支持下游微调与评估。
- 覆盖物理层、无线接入网等6类任务,助力信道模型迁移能力验证。
信道基础模型(CFMs)通常在各不相同的模型专属流程中进行评估,涉及数据、无线配置、划分方式、适配方法、任务定义和度量指标的差异,导致模型间无法实现可复现的对比。本文发布CFM-Bench,一个统一的多领域、多任务基准,包含来自六个领域的157,900个官方单帧样本,涵盖3GPP统计仿真、两种射线追踪流程、陆地与空中实测数据,以及同步车辆多模态仿真。源域特定接口保留每个领域中的复杂信道状态信息(CSI)和物理元数据,同时允许记录模型特定的预处理流程。为减少时空泄露,官方划分严格隔离完整轨迹、测量会话、飞行任务、车载链路、仿真实例或缓冲空间区域。基准不包含任何用于基础模型预训练的划分,保留官方训练集供下游微调,并明确标注模型开发所用数据。六类任务覆盖物理层(PHY)、无线接入网(RAN)及智能感知与通信(ISAC)应用,包括CSI反馈、频域与时域信道外推、传播状态分类、当前与未来波束预测,以及单帧与时序定位。对CSI反馈、信道外推、当前波束预测和无线定位的代表性实验提供了可复现的基准结果,适用于预训练信道预测模型与专用神经网络。结果表明,相对模型性能在不同数据域间存在差异,凸显了使用统一数据划分、任务定义和评估指标的重要性。CFM-Bench为评估信道表征在模型、领域与任务间的迁移能力提供统一基底。
原文摘要 · Abstract (English)
Channel foundation models (CFMs) are commonly evaluated in model-specific pipelines that differ in data, radio configurations, partitions, adaptation procedures, task definitions, and metrics, preventing reproducible comparison across CFMs and against task-specific networks. We release CFM-Bench, a unified multi-domain, multi-task benchmark comprising 157,900 official single-frame examples from six domains spanning 3GPP statistical simulation, two ray-tracing pipelines, terrestrial and aerial measurements, and synchronized vehicular multimodal simulation. Source-specific interfaces preserve complex channel state information (CSI) and the physical metadata available in each domain while allowing documented model-specific preprocessing. To reduce spatio-temporal leakage, official partitions isolate complete trajectories, measurement sessions, flights, vehicle links, simulation realizations, or buffered spatial regions. CFM-Bench excludes all benchmark splits from foundation-model pretraining, reserves the official training split for downstream fine-tuning, and reports the data used during model development. Six task groups across PHY, RAN, and ISAC applications cover CSI feedback, frequency and temporal channel extrapolation, propagation-state classification, current- and future-beam prediction, and single-frame and temporal localization. Representative experiments on CSI feedback, channel extrapolation, current-beam prediction, and wireless positioning provide reproducible reference results for pretrained channel-prediction models and task-specific neural networks. These results show that relative model performance can vary across data domains, highlighting the importance of using common data partitions, task definitions, and evaluation metrics. CFM-Bench provides a common substrate for evaluating the transferability of channel representations across models, domains, and tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。