系统评估生成模型在真实传感器数据上的表现,揭示关键成功因素。
Signal or Noise? Understanding Generative Models for Real-World Sensor Time Series

- 构建跨14个场景的SensorGen数据集,覆盖4大领域7个数据集
- 流匹配模型在多数场景表现最优,高频信号需时频建模
- 合成数据能提升下游任务性能,实用价值超越视觉逼真度
生成模型已改变机器学习对复杂数据分布的表示方式,尤其在语言和视觉领域。然而,许多真实系统以连续、高维且含噪声的传感器时间序列形式被观测。现有传感器数据生成方法在模态、数据集和任务设定上分散,难以系统理解生成模型在真实场景中的成功与失败原因。为填补这一空白,我们提出SensorGen,一项涵盖14个设置、4个领域、7个数据集和12种信号模态的大规模传感器信号生成研究。基于SensorGen,我们系统评估了五大主流生成模型家族,发现三项关键结论:(1) 流匹配模型在多数场景中表现优异;(2) 信号特性至关重要,人口统计协变量有助于纵向生成,时频建模提升高频信号生成质量;(3) 生成信号具有实际应用价值,模型规模扩大可提升生成质量,合成数据能改善下游任务表现。SensorGen共同建立了对真实传感器数据生成中设计选择、评估协议和失效模式的更全面理解。
原文摘要 · Abstract (English)
Generative models have changed how machine learning represents complex data distributions, especially in language and vision, yet many real-world systems are observed instead as continuous, high-dimensional, and noisy sensor time series. Existing generative modeling of sensor data, however, remains fragmented across modalities, datasets, and task formulations, limiting a systematic understanding of when, how, and why generative models succeed or fail in real-world settings. To address this gap, we introduce SensorGen, a large-scale study of sensor-signal generation spanning 14 settings across 4 domains, 7 datasets, and 12 signal modalities. Leveraging SensorGen, we systematically evaluate generative models from five major families and uncover three key findings: (1) flow-matching models provide strong overall performance across most settings; (2) signal properties matter, with demographic covariates improving longitudinal generation and time-frequency modeling improving high-frequency signal generation; and (3) generated signals have practical utility beyond visual realism, with scaling improving generation quality and synthetic data improving downstream performance. Together, SensorGen establishes a broader understanding of design choices, evaluation protocols, and failure modes in real-world sensor data generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。