arXiv:2602.02931stat.MEcs.LG2026-02

为分组数据设计可比较组间差异的树模型,提升预测精度。

Weighted Sum-of-Trees Model for Clustered Data

  • 为每组数据训练独立决策树,通过加权融合实现跨组预测。
  • 在模拟和真实癌症数据中,预测性能优于传统树模型。
  • 可直接比较各组树结构与特征重要性,揭示组间差异。

分组数据在临床、教育和社会科学中极为常见,其观测值嵌套于不同群体中。传统线性混合模型通过随机效应处理组内相关性,但难以扩展至非线性模型。现有方法虽将混合模型拓展至决策树与随机森林,却仅使用全局固定效应进行跨组预测,隐含所有群体共享相同结果模型的假设。本文提出轻量级加权树总和模型,为每个样本组学习独立决策树,并基于相似性加权融合预测结果,使新组预测更贴近训练集中最相似的组。该方法还能直接比较各组树结构与变量重要性,实现组间差异推断。实验显示,本模型在多种模拟场景下优于传统决策树与随机森林。最后,在癌症基因组图谱(TCGA)肉瘤队列的真实数据上验证,患者按肉瘤亚型分组,模型表现优异。

原文摘要 · Abstract (English)

Clustered data, which arise when observations are nested within groups, are incredibly common in clinical, education, and social science research. Traditionally, a linear mixed model, which includes random effects to account for within-group correlation, would be used to model the observed data and make new predictions on unseen data. Some work has been done to extend the mixed model approach beyond linear regression into more complex and non-parametric models, such as decision trees and random forests. However, existing methods are limited to using the global fixed effects for prediction on data from out-of-sample groups, effectively assuming that all clusters share a common outcome model. We propose a lightweight sum-of-trees model in which we learn a decision tree for each sample group. We combine the predictions from these trees using weights so that out-of-sample group predictions are more closely aligned with the most similar groups in the training data. This strategy also allows for inference on the similarity across groups in the outcome prediction model, as the unique tree structures and variable importances for each group can be directly compared. We show our model outperforms traditional decision trees and random forests in a variety of simulation settings. Finally, we showcase our method on real-world data from the sarcoma cohort of The Cancer Genome Atlas, where patient samples are grouped by sarcoma subtype.

分组数据决策树加权融合组间差异

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。