arXiv:2603.04509cs.CV2026-03

融合视觉、姿态与物体信息,提升老人居家活动识别准确率

Recognition of Daily Activities through Multi-Modal Deep Learning: A Video, Pose, and Object-Aware Approach for Ambient Assisted Living

  • 用3D CNN+图卷积网络处理视频与人体姿态数据
  • 通过交叉注意力融合物体检测信息,提升识别准确率
  • 适合智能养老系统研发者参考,尤其关注老人安全监护

日常活动识别是实现高效环境辅助生活(AAL)系统的关键,尤其在监测老年人室内健康状况、支持其独立生活方面至关重要。然而,构建鲁棒的活动识别系统面临诸多挑战:类内差异大、类间相似性强、环境变化多、摄像头视角不同及场景复杂等。本文提出一种面向老年人群在AAL场景中的多模态活动识别方法,结合3D卷积神经网络(3D CNN)处理的视觉信息与图卷积网络(GCN)分析的人体3D姿态数据,并通过交叉注意力机制将物体检测模块提取的上下文信息与3D CNN特征融合,以提升识别精度。该方法在包含真实室内活动的Toyota SmartHome数据集上进行评估,结果表明所提系统在多种日常生活活动上达到具有竞争力的分类准确率,展现出作为先进AAL监控系统核心组件的潜力,有助于推动智能化系统在保障老年人安全与自主性方面的应用。

原文摘要 · Abstract (English)

Recognition of daily activities is a critical element for effective Ambient Assisted Living (AAL) systems, particularly to monitor the well-being and support the independence of older adults in indoor environments. However, developing robust activity recognition systems faces significant challenges, including intra-class variability, inter-class similarity, environmental variability, camera perspectives, and scene complexity. This paper presents a multi-modal approach for the recognition of activities of daily living tailored for older adults within AAL settings. The proposed system integrates visual information processed by a 3D Convolutional Neural Network (CNN) with 3D human pose data analyzed by a Graph Convolutional Network. Contextual information, derived from an object detection module, is fused with the 3D CNN features using a cross-attention mechanism to enhance recognition accuracy. This method is evaluated using the Toyota SmartHome dataset, which consists of real-world indoor activities. The results indicate that the proposed system achieves competitive classification accuracy for a range of daily activities, highlighting its potential as an essential component for advanced AAL monitoring solutions. This advancement supports the broader goal of developing intelligent systems that promote safety and autonomy among older adults.

活动识别多模态学习智能养老

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。