arXiv:2510.25785cs.LGcs.AI2025-10被引 21

提出分层掩码自编码器,揭示可穿戴设备时间序列中的多尺度结构。

HiMAE: Hierarchical Masked Autoencoders Discover Resolution-Specific Structure in Wearable Time Series

  • 分层结构结合掩码自编码,生成多分辨率嵌入表征。
  • 在分类、回归任务中超越现有模型,且模型仅占其1/1000大小。
  • 可在智能手表端实时运行,适合边缘部署与健康信号分析。

可穿戴传感器产生大量生理时间序列数据,但其预测价值的内在原理仍不清晰。我们假设时间分辨率是表征学习的根本维度,不同临床与行为结果依赖于不同尺度的结构。为验证这一假设,我们提出HiMAE(分层掩码自编码器),一种结合掩码自编码与分层卷积编码器-解码器的自监督框架。HiMAE生成多分辨率嵌入,可系统评估哪些时间尺度包含预测信号,将分辨率从超参数转变为可解释性探针。在分类、回归和生成基准测试中,HiMAE持续优于现有基础模型,且模型规模小一个数量级。该模型足够紧凑,可完全在手表上运行,实现智能手表级CPU上的亚毫秒级推理,支持真正的边缘推理。这些贡献使HiMAE既是一种高效自监督学习方法,也是探测可穿戴健康数据中尺度敏感结构的发现工具。

原文摘要 · Abstract (English)

Wearable sensors provide abundant physiological time series, yet the principles governing their predictive utility remain unclear. We hypothesize that temporal resolution is a fundamental axis of representation learning, with different clinical and behavioral outcomes relying on structure at distinct scales. To test this resolution hypothesis, we introduce HiMAE (Hierarchical Masked Autoencoder), a self supervised framework that combines masked autoencoding with a hierarchical convolutional encoder decoder. HiMAE produces multi resolution embeddings that enable systematic evaluation of which temporal scales carry predictive signal, transforming resolution from a hyperparameter into a probe for interpretability. Across classification, regression, and generative benchmarks, HiMAE consistently outperforms state of the art foundation models that collapse scale, while being orders of magnitude smaller. HiMAE is an efficient representation learner compact enough to run entirely on watch, achieving sub millisecond inference on smartwatch class CPUs for true edge inference. Together, these contributions position HiMAE as both an efficient self supervised learning method and a discovery tool for scale sensitive structure in wearable health.

自监督学习可穿戴健康多尺度分析边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。