针对用户在不同情境下的感知差异,提出自适应剪枝的个性化建模方法。
CRoP: Context-wise Robust Static Human-Sensing Personalization
- 用预训练模型加最小子网络剪枝,保留通用知识同时捕捉个体特征
- 在四个数据集上实现更优的个性化效果与跨情境鲁棒性
- 特别适合医疗等数据稀缺场景,提升个体化感知可靠性
深度学习与物联网的发展推动了多样化的身体感知应用。然而,受多种因素或情境影响,人体感知模式存在显著差异,导致通用神经网络因自然分布偏移而性能下降。为解决此问题,个性化建模被引入以适配个体用户。但现有研究普遍忽视感官数据中用户内部的情境异质性,限制了个体内的泛化能力。这一局限在临床应用中尤为关键,因数据有限,既难以泛化也难个性化。值得注意的是,外部因素如治疗进展可能导致用户自身感知属性发生变化,进一步加剧挑战。为此,本文提出CRoP——一种新型静态个性化方法。CRoP利用现成预训练模型作为通用起点,通过在极小子网络上进行自适应剪枝来捕捉用户特异性特征,同时保留其余参数中的通用知识。CRoP在四个人体感知数据集(包括两个真实健康领域数据集)上展现出更优的个性化效果与用户内鲁棒性,凸显其实际与社会价值。为验证其泛化能力与设计合理性,本文还通过梯度内积分析、消融实验及与前沿基线的对比提供了实证支持。
原文摘要 · Abstract (English)
The advancement in deep learning and internet-of-things have led to diverse human sensing applications. However, distinct patterns in human sensing, influenced by various factors or contexts, challenge the generic neural network model's performance due to natural distribution shifts. To address this, personalization tailors models to individual users. Yet most personalization studies overlook intra-user heterogeneity across contexts in sensory data, limiting intra-user generalizability. This limitation is especially critical in clinical applications, where limited data availability hampers both generalizability and personalization. Notably, intra-user sensing attributes are expected to change due to external factors such as treatment progression, further complicating the challenges. To address the intra-user generalization challenge, this work introduces CRoP, a novel static personalization approach. CRoP leverages off-the-shelf pre-trained models as generic starting points and captures user-specific traits through adaptive pruning on a minimal sub-network while allowing generic knowledge to be incorporated in remaining parameters. CRoP demonstrates superior personalization effectiveness and intra-user robustness across four human-sensing datasets, including two from real-world health domains, underscoring its practical and social impact. Additionally, to support CRoP's generalization ability and design choices, we provide empirical justification through gradient inner product analysis, ablation studies, and comparisons against state-of-the-art baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。