SlotFM用注意力机制解析加速度信号,适配手势、步态等多样任务。
SlotFM: A Motion Foundation Model with Slot Attention for Diverse Downstream Tasks
- 引入时频槽注意力,从原始信号中提取多组关键特征
- 在16项任务中平均提升4.5%性能,13项超越现有自监督方法
- 适合需要细粒度信号理解的可穿戴设备应用
可穿戴加速度计广泛应用于手势识别、步态分析和运动监测等领域。然而,现有基础模型主要聚焦于行走、锻炼等常见日常活动分类,限制了其在依赖其他信号特性的任务中的适用性。本文提出SlotFM,一种能泛化到多样化下游任务的加速度基础模型。SlotFM采用时频槽注意力(Time-Frequency Slot Attention),在时间与频率两个维度上处理原始信号,生成多个小型嵌入(槽),每个槽捕捉信号的不同成分,使任务特定头能够关注最相关数据部分。此外,我们设计了两种损失正则化器,分别捕捉局部结构和频率模式,提升对细微细节的重建能力,并帮助嵌入保留任务相关特征。我们在16个分类与回归任务上评估SlotFM,这些任务超出传统人体活动识别范畴。结果表明,该方法在13项任务中优于现有自监督方法,在其余任务中达到最佳表现水平。平均性能提升4.5%,验证了感知基础模型的强大泛化能力。
原文摘要 · Abstract (English)
Wearable accelerometers are used for a wide range of applications, such as gesture recognition, gait analysis, and sports monitoring. Yet most existing foundation models focus primarily on classifying common daily activities such as locomotion and exercise, limiting their applicability to the broader range of tasks that rely on other signal characteristics. We present SlotFM, an accelerometer foundation model that generalizes across diverse downstream tasks. SlotFM uses Time-Frequency Slot Attention, an extension of Slot Attention that processes both time and frequency representations of the raw signals. It generates multiple small embeddings (slots), each capturing different signal components, enabling task-specific heads to focus on the most relevant parts of the data. We also introduce two loss regularizers that capture local structure and frequency patterns, which improve reconstruction of fine-grained details and helps the embeddings preserve task-relevant information. We evaluate SlotFM on 16 classification and regression downstream tasks that extend beyond standard human activity recognition. It outperforms existing self-supervised approaches on 13 of these tasks and achieves comparable results to the best performing approaches on the remaining tasks. On average, our method yields a 4.5% performance gain, demonstrating strong generalization for sensing foundation models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。