用图神经网络实现跨摄像头目标关联,提升追踪准确性。
Cross-Camera Data Association via GNN for Supervised Graph Clustering
- 基于图神经网络预测跨摄像头节点连接关系。
- 在多个场景下优于现有方法,准确率显著提升。
- 端到端处理,无需后期图结构优化,适合实际部署。
跨摄像头数据关联是多摄像头计算机视觉的核心任务之一。尽管常通过架构设计和损失函数融入检测与追踪流程,但其本身也构成独立挑战。目标是在所有摄像头中关联同一目标的外观特征。本文从有监督图聚类视角出发,将各摄像头捕获的实例作为图节点,利用视觉特征与位置属性表示。通过图神经网络(GNN)分析节点间关系,生成边嵌入并分类判断节点对是否存在连接。核心为图连通性预测。在实验室、篮球场、露台等多样环境的多摄像头行人数据集上验证,所提方法SGC-CCA在所有聚类指标上均超越当前最优方法GNN-CCA,提供无需图后处理的端到端聚类解决方案。代码已开源:https://github.com/djordjened92/cca-gnnclust。
原文摘要 · Abstract (English)
Cross-camera data association is one of the cornerstones of the multi-camera computer vision field. Although often integrated into detection and tracking tasks through architecture design and loss definition, it is also recognized as an independent challenge. The ultimate goal is to connect appearances of one item from all cameras, wherever it is visible. Therefore, one possible perspective on this task involves supervised clustering of the affinity graph, where nodes are instances captured by all cameras. They are represented by appropriate visual features and positional attributes. We leverage the advantages of GNN (Graph Neural Network) architecture to examine nodes' relations and generate representative edge embeddings. These embeddings are then classified to determine the existence or non-existence of connections in node pairs. Therefore, the core of this approach is graph connectivity prediction. Experimental validation was conducted on multicamera pedestrian datasets across diverse environments such as the laboratory, basketball court, and terrace. Our proposed method, named SGC-CCA, outperformed the state-of-the-art method named GNN-CCA across all clustering metrics, offering an end-to-end clustering solution without the need for graph post-processing. The code is available at https://github.com/djordjened92/cca-gnnclust.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。