提出新算法FastGFDs,让普通电脑也能高效验证图函数依赖。
FastGFDs: Efficient Validation of Graph Functional Dependencies with Desbordante

- 采用核心优先分解与紧凑路径索引,顺序处理全图。
- 相比旧方案平均提速2.6倍,内存消耗降低5倍。
- 适合在低配单机上运行的图数据验证任务。
图函数依赖(GFD)是一种新兴概念,用于捕捉图的拓扑结构及属性间的函数依赖关系。验证某个GFD是否在特定图上成立称为GFD验证,该过程计算开销巨大,其中定位合适子图占总运行时间约99%。原作者提出一种专为高性能服务器集群设计的并行算法。本文目标是使GFD验证适用于消费级PC。初步实验表明原算法在此类环境不理想。因此我们提出FastGFDs——一种基于最新图匹配技术的序列化算法,不依赖并行架构,直接作用于整图。其创新点在于使用核心优先分解(Core-First Decomposition)和紧凑路径索引(CPI)。与朴素序列算法及原并行方案对比,测试显示本算法在真实图数据上平均性能提升2.6倍,最高达3倍,内存消耗减少5倍。我们还开源了基于Desbordante平台的实现,据我们所知,这是首个公开可用的GFD验证算法实现。
原文摘要 · Abstract (English)
Graph functional dependencies (GFD) are a recently-developed concept aimed at capturing both topological structures in graphs and functional dependencies between attributes. The process of verifying whether a given GFD holds over a particular graph is referred to as GFD validation. In this very computationally expensive problem, locating suitable subgraphs accounts for about 99% of the total run time. The concept's authors originally proposed a parallel scheme (algorithm), targeting specifically clusters of high-performance servers. The goal of this study is to open GFD validation to a broader public by making it possible to run it on a consumer class PC. Our initial experiments demonstrated that the existing algorithm may not be optimal for these purposes. Therefore, we propose FastGFDs - a GFD validation algorithm that employs a recently developed graph matching technique. In contrast to the parallel scheme, it is sequential and operates on the entire graph. Its novelty lies in the use of Core-First Decomposition and the Compact Path Index (CPI). We compare it with the naive sequential algorithm and the parallel scheme, evaluating run times and memory consumption. The current study is the first step towards designing an efficient algorithm for GFD validation in low-end single-node environments. We also provide an open-source implementation of GFD validation over large data graphs. To the best of our knowledge, this is the only publicly available implementation of an algorithm for this problem. It is developed in Desbordante - an open-source high-performance data profiler aimed at science-intensive tasks. Finally, our experiments on a real-life graph demonstrated up to three times performance (2.6x on average) improvement over the parallel scheme. Employing the new subgraph matching algorithm also reduced memory consumption by five times.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。