arXiv:2505.15648cs.LGcs.DS2025-05AAAI被引 7

研究如何用小决策树少出错地分类数据,关键突破是引入容忍错误数参数。

Learning Small Decision Trees with Few Outliers: A Parameterized Perspective

  • 以允许最多t个错误为约束,构造更小的决策树
  • 证明当考虑错误容忍度t时问题可高效求解
  • 适合关注决策树压缩与鲁棒性的研究人员

决策树是机器学习中用于表示、分类和泛化数据的基本工具。理想情况下应构建‘小’决策树,通过最小化其规模(s)或深度(d)实现。本文研究一种推广的决策树学习问题:给定分类实例E和整数t,目标是找到一个‘小’决策树,最多在t个样本上与E不一致。考虑两个问题:DTSO(最小化规模s)和DTDO(最小化深度d)。我们首先证明,当以s+δ_max或d+δ_max为参数时,两者均为W[1]-难;其中δ_max是不同标签样本间最多差异的特征数。进一步证明,若加入参数t,问题转为FPT。还分析了两类问题的核化复杂度,得到若干正负结果。

原文摘要 · Abstract (English)

Decision trees are a fundamental tool in machine learning for representing, classifying, and generalizing data. It is desirable to construct ``small'' decision trees, by minimizing either the \textit{size} ($s$) or the \textit{depth} $(d)$ of the \textit{decision tree} (\textsc{DT}). Recently, the parameterized complexity of \textsc{Decision Tree Learning} has attracted a lot of attention. We consider a generalization of \textsc{Decision Tree Learning} where given a \textit{classification instance} $E$ and an integer $t$, the task is to find a ``small'' \textsc{DT} that disagrees with $E$ in at most $t$ examples. We consider two problems: \textsc{DTSO} and \textsc{DTDO}, where the goal is to construct a \textsc{DT} minimizing $s$ and $d$, respectively. We first establish that both \textsc{DTSO} and \textsc{DTDO} are W[1]-hard when parameterized by $s+δ_{max}$ and $d+δ_{max}$, respectively, where $δ_{max}$ is the maximum number of features in which two differently labeled examples can differ. We complement this result by showing that these problems become \textsc{FPT} if we include the parameter $t$. We also consider the kernelization complexity of these problems and establish several positive and negative results for both \textsc{DTSO} and \textsc{DTDO}.

决策树参数复杂度算法优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。