用可调参数的展开网络,让模型自适应不同数据分布。
Tunable Domain Adaptation Using Unfolding
- 基于迭代优化思想的可展开网络,通过可调参数控制适应性。
- 在噪声自适应信号恢复等任务中性能优于联合训练,接近专用模型。
- 适合需要解释性和灵活适配的回归类实际应用。
机器学习模型在面对分布不同的领域(如噪声水平差异)时往往泛化能力差。传统方法如为每个领域单独训练或使用单一模型联合训练,灵活性和效果均有局限。为此,我们提出两种基于可解释展开网络的回归任务域自适应方法:参数可调域自适应(P-TDA)利用已知领域参数动态调整,数据驱动可调域自适应(DD-TDA)则从输入数据直接推断适应策略。我们在压缩感知场景下的噪声自适应稀疏信号恢复、域自适应增益校准和相位重建任务中验证,性能优于联合训练基线,且接近领域专用模型。该工作展示了展开网络在回归任务中实现高效、可解释域自适应的潜力。
原文摘要 · Abstract (English)
Machine learning models often struggle to generalize across domains with varying data distributions, such as differing noise levels, leading to degraded performance. Traditional strategies like personalized training, which trains separate models per domain, and joint training, which uses a single model for all domains, have significant limitations in flexibility and effectiveness. To address this, we propose two novel domain adaptation methods for regression tasks based on interpretable unrolled networks--deep architectures inspired by iterative optimization algorithms. These models leverage the functional dependence of select tunable parameters on domain variables, enabling controlled adaptation during inference. Our methods include Parametric Tunable-Domain Adaptation (P-TDA), which uses known domain parameters for dynamic tuning, and Data-Driven Tunable-Domain Adaptation (DD-TDA), which infers domain adaptation directly from input data. We validate our approach on compressed sensing problems involving noise-adaptive sparse signal recovery, domain-adaptive gain calibration, and domain-adaptive phase retrieval, demonstrating improved or comparable performance to domain-specific models while surpassing joint training baselines. This work highlights the potential of unrolled networks for effective, interpretable domain adaptation in regression settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。