arXiv:2603.13772cs.IR2026-03

GreCon3大幅降低布尔矩阵分解的资源消耗,让大数据可用。

GreCon3: Mitigating High Resource Utilization of GreCon Algorithms for Boolean Matrix Factorization

  • 用新数据结构追踪未处理数据,节省内存
  • 实验显示性能远超前代算法GreCon2
  • 适合处理大规模二值数据的科研与工程人员

布尔矩阵分解(BMF)是分析二值数据、挖掘潜在信息的重要工具。形式概念分析(FCA)为BMF算法设计提供了关键洞察,催生了GreCon和GreCon2算法,但其高内存占用和长运行时间限制了应用。本文提出GreCon3,对这些算法进行重大改进,显著提升计算效率与内存使用。核心是引入一种新型空间高效数据结构,用于追踪未处理数据;同时提出增量初始化策略,减少内存开销并剔除无关数据。此外,发现首组因子可更轻松获得,因其通常描述数据大部分内容,该优化与其他改进共同大幅提升整体性能。实验表明,GreCon3在多项指标上显著优于GreCon2,推动基于FCA的BMF技术发展,使以往不可行的大规模数据分解成为可能。

原文摘要 · Abstract (English)

Boolean matrix factorization (BMF) is a fundamental tool for analyzing binary data and discovering latent information hidden in the data. Formal Concept Analysis (FCA) provides us with an essential insight into BMF and the design of algorithms. Due to FCA, we have the GreCon and GreCon2 algorithms providing high-quality factorizations at the cost of high memory consumption and long running times. In this paper, we introduce GreCon3, a substantial revision of these algorithms, significantly improving both computational efficiency and memory usage. These improvements are achieved with a novel space-efficient data structure that tracks unprocessed data. Further, a novel strategy incrementally initializing this data structure is proposed. This strategy reduces memory consumption and omits data irrelevant to the remainder of the computation. Moreover, we show that the first factors can be discovered with less effort. Since the first factors tend to describe large portions of the data, this optimization, along with others, significantly contributes to the overall improvement of the algorithm's performance. An experimental evaluation shows that GreCon3 substantially outperforms its predecessor GreCon2. The proposed algorithm thus advances the state of the art in BMF based on FCA and enables efficient factorization of datasets previously infeasible for the GreCon algorithm.

布尔矩阵算法优化数据挖掘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。