arXiv:2411.00615cs.DBcs.LG2024-11

基于预设分类构建关联规则,兼顾高频与高可靠性

Apriori_Goal algorithm for constructing association rules for a database with a given classification

  • 按目标分类生成关联规则,利用频度与可靠性的单调性优化搜索
  • 可发现低频但高可靠的罕见规则及负相关规则
  • 适合医疗等需精准筛选的场景,兼顾效率与规则质量

针对具有预定义分类的数据库,提出一种高效的 Apriori_Goal 算法,用于构建形如 $X \Rightarrow Goal_k$ 的关联规则。规则质量由五个指标衡量:两个反映频率,两个反映可靠性,第五个为前四者的加权和。算法首先生成单前提规则,要求前提 $X$ 与结论 $Goal_k$ 的相关性超过阈值;随后基于规则频率的反单调性与可靠性的单调性,逐步扩展前提。新规则通常频率下降但可靠性上升。论文证明了规则生成过程的正确性。该算法能同时构造高频规则与低频但高可靠的罕见规则,并支持生成前提与结论呈负相关的负规则,在实际应用中可用于排除不良目标。算法效率依赖于数据库编码方式及其按目标参数划分的子集。以医疗数据库为例,给出了规则构建的时间复杂度估算。

原文摘要 · Abstract (English)

An efficient Apriori_Goal algorithm is proposed for constructing association rules in a relational database with predefined classification. The target parameter of the database specifies a finite number of goals $Goal_k$, for each of which the algorithm constructs association rules of the form $X \Rightarrow Goal_k$. The quality of the generated rules is characterized by five criteria: two represent rule frequency, two reflect rule reliability, and the fifth is a weighted sum of these four criteria. The algorithm initially generates rules with single premises, where the correlation criterion between the premise $X$ and the conclusion $Goal_k$ exceeds a specified threshold. Then, rules with extended premises are built based on the anti-monotonicity of rule frequency criteria and the monotonicity of rule reliability criteria. Newly constructed rules tend to decrease in frequency while increasing in reliability. The article proves several statements that justify the rule construction process. The algorithm enables the construction of both high-frequency and rare rules with low occurrence frequency but high reliability. It also allows for the generation of negative rules with negative correlation between the premise and conclusion, which can be valuable in practical applications for filtering out undesired goals. The efficiency of the algorithm is based on two factors: the method of encoding the database and its partitioning into subsets linked to the target parameter. Time complexity estimates for rule construction are provided using a medical database as an example.

关联规则数据挖掘医疗分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。