用骨骼数据识别两人互动,为智能基建中的社会行为分析提供隐私保护方案。
Read the Room: Inferring Social Context Through Dyadic Interaction Recognition in Cyber-physical-social Infrastructure Systems
- 基于深度传感器提取骨骼数据,识别12类双人互动
- 五种算法在真实场景下验证,有效捕捉文化情感特征
- 适用于智慧社区、公共空间等需隐私保护的社交场景
网络物理社会基础设施系统(CPSIS)旨在将物理基础设施与社会目标对齐。本文聚焦于通过真实世界数据识别双人互动,作为衡量社会行为的基础。研究对比了五种基于骨骼数据的互动识别算法,在包含12类双人互动的数据集上进行评估。这些互动类型涵盖象征性动作和情感表达,能反映文化与情感层面的人际交互特征。相较于依赖RGB相机的方案,深度传感器可避免隐私泄露,仅通过骨骼运动分析实现高效识别。该方法为构建可解释、可预测且隐私友好的社会感知系统提供了关键技术支撑。
原文摘要 · Abstract (English)
Cyber-physical systems (CPS) integrate sensing, computing, and control to improve infrastructure performance, focusing on economic goals like performance and safety. However, they often neglect potential human-centered (or ''social'') benefits. Cyber-physical-social infrastructure systems (CPSIS) aim to address this by aligning CPS with social objectives. This involves defining social benefits, understanding human interactions with each other and infrastructure, developing privacy-preserving measurement methods, modeling these interactions for prediction, linking them to social benefits, and actuating the physical environment to foster positive social outcomes. This paper delves into recognizing dyadic human interactions using real-world data, which is the backbone to measuring social behavior. This lays a foundation to address the need to enhance understanding of the deeper meanings and mutual responses inherent in human interactions. While RGB cameras are informative for interaction recognition, privacy concerns arise. Depth sensors offer a privacy-conscious alternative by analyzing skeletal movements. This study compares five skeleton-based interaction recognition algorithms on a dataset of 12 dyadic interactions. Unlike single-person datasets, these interactions, categorized into communication types like emblems and affect displays, offer insights into the cultural and emotional aspects of human interactions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。