arXiv:2603.23783cs.LGcs.AI2026-03

用概率几何对齐提升小样本域适应的稳定性与可靠性

Probabilistic Geometric Alignment via Bayesian Latent Transport for Domain-Adaptive Foundation Models

  • 基于贝叶斯潜在传输,将域适应建模为表示空间中的随机几何对齐问题
  • 在多个数据集上显著降低潜在流形差异,加速能量衰减并改善协方差校准
  • 适合需要高可信度不确定性估计的跨域迁移场景,如医疗或自动驾驶

由于潜在分布不匹配、优化动态不稳定和不确定性传播失准,利用少量监督将大规模基础模型适配到新领域仍是根本挑战。本文提出一种考虑不确定性的概率潜在传输框架,将域适应建模为表示空间中的随机几何对齐问题。引入贝叶斯传输算子,沿Wasserstein型测地线重新分配潜在概率质量,同时采用PAC-Bayesian正则化机制控制后验模型复杂度,防止灾难性过拟合。该方法在分布偏移下提供收敛稳定性、损失曲面平滑性和样本效率的理论保障。实验表明,相比确定性微调和对抗域适应基线,其显著降低了潜在流形差异,加速了传输能量衰减,并提升了协方差校准效果。此外,后验不确定性演化有界,表明跨域迁移中具备更优的概率可靠性。通过建立随机最优传输几何与统计泛化理论之间的原理性联系,本框架为现代基础架构在异构环境中的鲁棒适应提供了新视角。结果表明,考虑不确定性的概率对齐是下一代深度表征系统可靠迁移的可行范式。

原文摘要 · Abstract (English)

Adapting large-scale foundation models to new domains with limited supervision remains a fundamental challenge due to latent distribution mismatch, unstable optimization dynamics, and miscalibrated uncertainty propagation. This paper introduces an uncertainty-aware probabilistic latent transport framework that formulates domain adaptation as a stochastic geometric alignment problem in representation space. A Bayesian transport operator is proposed to redistribute latent probability mass along Wasserstein-type geodesic trajectories, while a PAC-Bayesian regularization mechanism constrains posterior model complexity to mitigate catastrophic overfitting. The proposed formulation yields theoretical guarantees on convergence stability, loss landscape smoothness, and sample efficiency under distributional shift. Empirical analyses demonstrate substantial reduction in latent manifold discrepancy, accelerated transport energy decay, and improved covariance calibration compared with deterministic fine-tuning and adversarial domain adaptation baselines. Furthermore, bounded posterior uncertainty evolution indicates enhanced probabilistic reliability during cross-domain transfer. By establishing a principled connection between stochastic optimal transport geometry and statistical generalization theory, the proposed framework provides new insights into robust adaptation of modern foundation architectures operating in heterogeneous environments. These findings suggest that uncertainty-aware probabilistic alignment constitutes a promising paradigm for reliable transfer learning in next-generation deep representation systems.

域适应概率建模贝叶斯方法迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。