arXiv:2511.03666cs.CV2025-11NeurIPS被引 1

通过身体部位线索实现更精准的社交互动检测

Part-Aware Bottom-Up Group Reasoning for Fine-Grained Social Interaction Detection

  • 基于身体部位特征与人际关联推理群体结构
  • 在NVI数据集上达到新最好效果,准确率显著提升
  • 适合需要细粒度社交行为分析的研究与应用

社交互动常由细微线索如面部表情、视线方向和手势等引发。现有方法忽视这些细微线索,主要依赖个体的整体表征,且直接检测社交群体而未显式建模个体间互动。这限制了对局部社交信号的捕捉,并在需从细微线索推断群体配置时引入歧义。本文提出一种面向细粒度社交互动检测的部分感知自底向上群体推理框架。该方法利用身体部位特征及其相互关系推断群体配置与互动。模型先检测个体并用部分感知线索增强特征,再通过基于相似性的推理关联个体,综合考虑空间关系与暗示互动的细微社交线索,实现更准确的群体推断。在NVI数据集上的实验表明,本方法优于先前方法,达到新最优性能;在Café数据集上的附加结果进一步验证了其在群体活动理解中的泛化能力。

原文摘要 · Abstract (English)

Social interactions often emerge from subtle, fine-grained cues such as facial expressions, gaze, and gestures. However, existing methods for social interaction detection overlook such nuanced cues and primarily rely on holistic representations of individuals. Moreover, they directly detect social groups without explicitly modeling the underlying interactions between individuals. These drawbacks limit their ability to capture localized social signals and introduce ambiguity when group configurations should be inferred from social interactions grounded in nuanced cues. In this work, we propose a part-aware bottom-up group reasoning framework for fine-grained social interaction detection. The proposed method infers social groups and their interactions using body part features and their interpersonal relations. Our model first detects individuals and enhances their features using part-aware cues, and then infers group configuration by associating individuals via similarity-based reasoning, which considers not only spatial relations but also subtle social cues that signal interactions, leading to more accurate group inference. Experiments on the NVI dataset demonstrate that our method outperforms prior methods, achieving the new state of the art, while additional results on the Café dataset further validate its generalizability to group activity understanding.

社交互动细粒度分析群体推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。