用强化学习生成跨用户通用动作特征,提升可穿戴设备识别准确率。
Collaborative Temporal Feature Generation via Critic-Free Reinforcement Learning for Cross-User Sensor-Based Activity Recognition
- 设计协作式时序特征生成框架,基于Transformer自回归构建特征序列。
- 在DSADS和PAMAP2数据集上达到88.53%和75.22%的跨用户准确率。
- 无需评判器,通过组内对比优化,适合多用户场景下的动作识别任务。
基于可穿戴惯性传感器的人体动作识别是健康监测、健身分析和情境感知计算的基础,但其部署受制于跨用户差异,源于生理特征、运动习惯和传感器位置的异质性。现有领域泛化方法或忽略传感器流的时间依赖性,或依赖不切实际的目标域标注。本文提出新范式:将通用特征提取建模为由强化学习驱动的协作式序列生成过程。所提框架CTFG(协作时序特征生成)采用基于Transformer的自回归生成器,逐次构建特征标记序列,每个标记基于先前上下文与编码后的传感器输入。生成器通过组相对策略优化(Group-Relative Policy Optimization)进行训练,该无评判器算法通过对同一输入采样的多个序列进行组内比较,以相对归一化获得优势信号,而非依赖学习的价值估计。此设计消除了评判器方法中的分布依赖偏差,提供稳定自校准的优化信号,适用于异构用户分布。三目标奖励函数包含类别判别力、跨用户不变性与时间保真度,共同塑造特征空间以区分动作、对齐用户分布并保留精细时间内容。在DSADS与PAMAP2基准测试中,该方法实现最优跨用户准确率(88.53%与75.22%),显著降低任务间训练方差,加速收敛,并在不同动作空间维度下保持鲁棒泛化能力。
原文摘要 · Abstract (English)
Human Activity Recognition using wearable inertial sensors is foundational to healthcare monitoring, fitness analytics, and context-aware computing, yet its deployment is hindered by cross-user variability arising from heterogeneous physiological traits, motor habits, and sensor placements. Existing domain generalization approaches either neglect temporal dependencies in sensor streams or depend on impractical target-domain annotations. We propose a different paradigm: modeling generalizable feature extraction as a collaborative sequential generation process governed by reinforcement learning. Our framework, CTFG (Collaborative Temporal Feature Generation), employs a Transformer-based autoregressive generator that incrementally constructs feature token sequences, each conditioned on prior context and the encoded sensor input. The generator is optimized via Group-Relative Policy Optimization, a critic-free algorithm that evaluates each generated sequence against a cohort of alternatives sampled from the same input, deriving advantages through intra-group normalization rather than learned value estimation. This design eliminates the distribution-dependent bias inherent in critic-based methods and provides self-calibrating optimization signals that remain stable across heterogeneous user distributions. A tri-objective reward comprising class discrimination, cross-user invariance, and temporal fidelity jointly shapes the feature space to separate activities, align user distributions, and preserve fine-grained temporal content. Evaluations on the DSADS and PAMAP2 benchmarks demonstrate state-of-the-art cross-user accuracy (88.53\% and 75.22\%), substantial reduction in inter-task training variance, accelerated convergence, and robust generalization under varying action-space dimensionalities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。