将混合效应模型与深度学习结合,统一处理表格数据的多层次分析。
TabMixNN: A Unified Deep Learning Framework for Structural Mixed Effects Modeling on Tabular Data
- 分三阶段架构:随机效应编码、通用建模主干、任务专用预测头
- 支持回归、分类、多任务等多元结果类型,可处理纵向与空间数据
- 提供类似R语言公式接口,适合需可解释性的生物统计与社科研究者
我们提出TabMixNN,一个基于PyTorch的灵活深度学习框架,将经典混合效应建模与现代神经网络结构相结合,用于表格数据的分析。该框架针对日益增长的对能处理层次化数据结构且支持多种结果类型(包括回归、分类和多任务学习)的需求。其采用模块化三阶段架构:(1) 带变分随机效应和灵活协方差结构的混合效应编码器;(2) 包括广义结构方程模型(GSEM)和时空流形网络在内的主干架构;(3) 支持多种结果族的任务专用预测头。关键创新包括类R语言公式接口以提升易用性,支持有向无环图(DAG)约束用于因果结构学习,使用随机偏微分方程(SPDE)核进行空间建模,以及包含SHAP值和方差分解在内的综合可解释性工具。我们在纵向数据分析、基因组预测和时空建模中展示了框架的灵活性。TabMixNN为研究人员提供了一个统一接口,在利用深度学习的同时保持经典混合效应模型的可解释性与理论基础。
原文摘要 · Abstract (English)
We present TabMixNN, a flexible PyTorch-based deep learning framework that synthesizes classical mixed-effects modeling with modern neural network architectures for tabular data analysis. TabMixNN addresses the growing need for methods that can handle hierarchical data structures while supporting diverse outcome types including regression, classification, and multitask learning. The framework implements a modular three-stage architecture: (1) a mixed-effects encoder with variational random effects and flexible covariance structures, (2) backbone architectures including Generalized Structural Equation Models (GSEM) and spatial-temporal manifold networks, and (3) outcome-specific prediction heads supporting multiple outcome families. Key innovations include an R-style formula interface for accessibility, support for directed acyclic graph (DAG) constraints for causal structure learning, Stochastic Partial Differential Equation (SPDE) kernels for spatial modeling, and comprehensive interpretability tools including SHAP values and variance decomposition. We demonstrate the framework's flexibility through applications to longitudinal data analysis, genomic prediction, and spatial-temporal modeling. TabMixNN provides a unified interface for researchers to leverage deep learning while maintaining the interpretability and theoretical grounding of classical mixed-effects models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。