arXiv:2510.00478cs.LG2025-10NeurIPS

用扩散模型隐式传递分类边界,实现无源数据泄露的域适应。

Vicinity-Guided Discriminative Latent Diffusion for Privacy-Preserving Domain Adaptation

  • 通过高斯先验建模源特征邻域,让扩散网络将噪声样本拉回标签一致表示。
  • 在多个标准基准上优于现有方法,目标域准确率提升显著。
  • 适合需要保护源数据隐私的工业级迁移学习场景。

以往的潜在扩散模型(LDM)研究主要集中于生成任务,对其在判别性迁移中的潜力关注不足。本文提出判别性邻域扩散(DVD),一种基于LDM的新框架,用于更实用的无源域适应(SFDA):源方可在不暴露原始数据的前提下,共享预训练分类器与一个仅在源数据上训练一次的辅助潜在扩散模块。DVD通过在每个源特征的k近邻上拟合高斯先验,将标签信息编码到其潜在邻域中,并训练扩散网络将噪声样本逐步还原为标签一致的表示。适配阶段,从目标特征的潜在邻域采样,使用冻结的扩散模块生成类源提示,再以简单InfoNCE损失对齐目标编码器,显式迁移决策边界而无需访问源数据。在多个标准SFDA基准上,DVD性能超越当前最优方法。进一步实验表明,同一扩散模块还能提升源分类器在域内数据上的准确率,并增强监督分类与域泛化任务表现。因此,DVD将LDM重新诠释为可实际应用、保障隐私的知识传递桥梁,解决了此前方法尚未攻克的核心挑战。

原文摘要 · Abstract (English)

Recent work on latent diffusion models (LDMs) has focused almost exclusively on generative tasks, leaving their potential for discriminative transfer largely unexplored. We introduce Discriminative Vicinity Diffusion (DVD), a novel LDM-based framework for a more practical variant of source-free domain adaptation (SFDA): the source provider may share not only a pre-trained classifier but also an auxiliary latent diffusion module, trained once on the source data and never exposing raw source samples. DVD encodes each source feature's label information into its latent vicinity by fitting a Gaussian prior over its k-nearest neighbors and training the diffusion network to drift noisy samples back to label-consistent representations. During adaptation, we sample from each target feature's latent vicinity, apply the frozen diffusion module to generate source-like cues, and use a simple InfoNCE loss to align the target encoder to these cues, explicitly transferring decision boundaries without source access. Across standard SFDA benchmarks, DVD outperforms state-of-the-art methods. We further show that the same latent diffusion module enhances the source classifier's accuracy on in-domain data and boosts performance in supervised classification and domain generalization experiments. DVD thus reinterprets LDMs as practical, privacy-preserving bridges for explicit knowledge transfer, addressing a core challenge in source-free domain adaptation that prior methods have yet to solve.

域适应扩散模型隐私保护无源迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。