arXiv:2606.03212cs.LG2026-06

用扩散模型做先验,提升低秩张量分解在噪声缺失数据中的表现

Bayesian Tensor Decomposition with Diffusion Model Prior

论文配图:Bayesian Tensor Decomposition with Diffusion Model Prior
图 1 · 摘自论文原文
  • 结合扩散模型与累积收缩先验,自动选择张量分解秩
  • 在高分辨率图像修复中优于现有贝叶斯与插件式方法
  • 无需调参的自适应耦合机制,适合复杂真实数据

低秩张量分解在干净完整数据上表现良好,但在严重缺失或噪声下性能下降。传统低秩性作为先验过于简单,手工设计的稀疏性或平滑性先验也难以捕捉真实数据的丰富统计特性。为弥补重污染下的弱归纳偏置,需引入学习得到的数据驱动先验;但现有扩散模型难以与张量分解及可追溯后验推断兼容。为此,本文提出DiffBCP:一种混合先验贝叶斯CP分解框架,将累积收缩过程先验用于自动秩选择,并引入预训练扩散模型作为重建张量的隐式数据先验。为实现可追踪后验推断,设计分裂吉布斯采样器:CP因子采用共轭更新,扩散模块通过低秩引导去噪采样。噪声自适应耦合调度进一步降低对人工退火参数的敏感性。在图像补全与去噪任务(包括高分辨率分布外图像)上的实验表明,该方法持续优于贝叶斯、非线性及插件式张量分解基线。

原文摘要 · Abstract (English)

Low-rank tensor decomposition (TD) is usually effective on clean, fully observed data, but it often degrades under severe missingness or noise. Low-rankness is itself a useful but limited structural prior, and additional handcrafted priors (e.g., sparsity or smoothness) still fall short of capturing the rich statistics of real-world data. To compensate for this weak inductive bias under heavy corruption, one would like to inject a learned, data-driven prior; however, the state-of-the-art diffusion models are not readily compatible with current TD and tractable posterior inference. To address these challenges, we introduce DiffBCP, a hybrid-prior Bayesian CP decomposition framework that couples a cumulative shrinkage process prior over the CP factors for automatic rank selection with an off-the-shelf pre-trained diffusion model as an implicit data prior on the reconstructed tensor. To make posterior inference tractable despite the coupling among the likelihood, low-rank constraint, and diffusion prior, we develop a split Gibbs sampler: CP factors admit conjugate updates, while the diffusion block is sampled via low-rank-guided denoising. A noise-adaptive coupling schedule further reduces sensitivity to hand-tuned annealing. Experiments on image inpainting and denoising, including high-resolution out-of-distribution images, show consistent gains over Bayesian, nonlinear, and plug-and-play TD baselines.

张量分解扩散模型贝叶斯推断图像修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。