无需标注,自动推断复杂关系结构,提升模型对高阶交互的捕捉能力。
SPHINX: Structural Prediction using Hypergraph Inference Network
- 通过可微聚类与采样,从节点信号反推隐式超图结构
- 在轨迹预测任务中显著提升性能,优于仅用成对关系的方法
- 适合高阶关系难标注的场景,如交通、社交网络分析
高阶关系在众多现实系统中至关重要,但标注成本高昂甚至不可行。现有方法或忽略高阶交互,或将其简化为成对连接。为此,我们提出SPHINX——一种基于超图推理网络的结构预测模型,可在无显式超图结构的情况下,仅从最终节点信号中无监督地学习隐式超图结构。模型采用可微聚类方法,逐个预测每个超边对应的节点概率分布,并利用最新的k-子集采样技术生成离散超图结构,有效缓解了以往方法的训练不稳定性。该模型可生成适配现代超图神经网络的高阶结构,从而在难以标注高阶关系的领域中捕捉复杂交互。在两个具有挑战性的轨迹预测数据集上,通过大量消融实验和对比测试,验证了其推断出的超图结构具有可解释性,并能显著提升模型最终性能。
原文摘要 · Abstract (English)
The importance of higher-order relations is widely recognized in a large number of real-world systems. However, annotating them is a tedious and sometimes impossible task. Consequently, current approaches for data modelling either ignore the higher-order interactions altogether or simplify them into pairwise connections. In order to facilitate higher-order processing, even when a hypergraph structure is not available, we introduce Structural Prediction using Hypergraph Inference Network (SPHINX), a model that learns to infer a latent hypergraph structure in an unsupervised way, solely from the final node-level signal. The model consists of a soft, differentiable clustering method used to sequentially predict, for each hyperedge, the probability distribution over the nodes and a sampling algorithm that converts them into an explicit hypergraph structure. We show that the recent advancement in $k$-subset sampling represents a suitable tool for producing discrete hypergraph structures, addressing some of the training instabilities exhibited by prior works. The resulting model can generate the higher-order structure necessary for any modern hypergraph neural network, facilitating the capture of higher-order interaction in domains where annotating them is difficult. Through extensive ablation studies and experiments conducted on two challenging datasets for trajectory prediction, we demonstrate that our model is capable of inferring suitable latent hypergraphs, that are interpretable and enhance the final performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。