用检索增强模块提升动作识别,动态融合更鲁棒。
Modular Retrieval-Augmented Generalization for Human Action Recognition

- 引入可插拔的检索增强模块,适配任意现有模型。
- 在10个真实数据集上显著提升性能,稳定增益明显。
- 基于物理知识自适应融合,缓解冗余与固定策略问题。
基于惯性测量单元(IMU)的人体动作识别(HAR)旨在从时序运动信号中解析和分类用户行为。近年来,深度学习框架通过学习和提取判别性时空表征,显著提升了识别性能。然而,基于IMU的HAR仍面临训练样本有限和静态知识利用等关键挑战,严重制约其大规模部署。本文提出MoRA,首个专为运动序列设计的检索增强模块,可灵活集成到任何现有HAR模型中,在保持推理效率的同时提升识别性能。为解决检索结果信息冗余及融合策略僵化问题,我们设计了不确定性自适应融合单元,利用IMU信号中的先验物理知识,动态调整原始输出与检索信息的融合策略,实现更鲁棒的识别。在10个真实世界数据集上的大量实验表明,MoRA能显著提升现有IMU-HAR模型的性能,持续带来稳定有效的增益。代码已开源:https://github.com/liavonpenn/mora。
原文摘要 · Abstract (English)
Inertial Measurement Unit (IMU)-based Human Activity Recognition (HAR) aims to interpret and classify user behaviors from temporal motion signals. Recently, deep learning frameworks have advanced this task by learning and extracting discriminative spatiotemporal representations, significantly improving recognition performance. However, IMU-based HAR still faces several critical challenges, particularly limited training samples and static knowledge utilization, both of which severely hinder its large-scale deployment. In this paper, we introduce MoRA, the first Retrieval-Augmented Module specifically designed for motion series. It can be flexibly integrated into any existing HAR model, enhancing recognition performance while maintaining inference efficiency. To address issues such as information redundancy in retrieval results and rigid fusion strategies, we propose an uncertainty-adaptive fusion unit within MoRA. This unit leverages previous physical knowledge from IMU signals to dynamically adjust the fusion strategy between original outputs and retrieved information, enabling more robust recognition. Extensive experiments on ten real-world datasets demonstrate that MoRA significantly improves the performance of existing IMU-based HAR models, consistently delivering stable and effective gains. The source code of MoRA is available at: https://github.com/liavonpenn/mora.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。