arXiv:2608.30081cs.LGcs.CV2026-08

揭示生成图像与训练数据簇的关联,无需重训模型即可定位关键数据。

Tracing Generated Samples to Training-Data Clusters in Flow-Matching Models

论文配图:Tracing Generated Samples to Training-Data Clusters in Flow-Matching Models
图 1 · 摘自论文原文
  • 提出基于轨迹的归因方法,结合解析与学习策略计算生成样本对训练簇的影响。
  • 在两个流匹配潜空间中验证,语义相似性为强基线,闭式解法表现不俗。
  • 适用于模型可解释性研究,尤其适合关注生成过程影响路径的开发者。

理解哪些训练样本影响生成图像,是生成建模中的重要问题。在流匹配中,训练样本通过生成轨迹上的速度场影响生成结果。移除样本会改变速度场,其对最终图像的影响取决于变化在轨迹中的传播方式。因此,速度场的局部变化并不一定预测最终反事实效应。本文采用混合解析-学习方法研究流匹配模型中的归因问题,并推导出基于轨迹的簇级归因分数。我们通过独立重训的留一簇外(LOO)模型评估这些归因分数,并在两个不同流匹配潜空间中与多种归因基线进行对比。实验表明,语义相似性构成强基线,而闭式轨迹归因在部分指标上具有竞争力,且无需反事实重训或模型梯度。结果表明,流匹配中的归因不仅依赖于与训练样本的语义相似性,还受潜在表示、轨迹动态及影响传播机制的影响。

原文摘要 · Abstract (English)

Understanding which training samples influence a generated image is an important problem in generative modeling. In flow matching, training samples influence the generated image through the velocity field along the generation trajectory. Removing samples to examine their counterfactual influence changes the velocity field, and the resulting effect on the final image depends on how the change propagates through the trajectory. Consequently, local changes in the velocity field do not necessarily predict the final counterfactual effect. This work investigates attribution in flow-matching models through a hybrid analytical--learned approach, and uses it to derive trajectory-based attribution scores at the cluster level. We evaluate these attribution scores using independently retrained leave-one-cluster-out (LOO) models, and compare with several attribution baselines using two different flow-matching latent spaces. Our experiments show that semantic similarity constitutes a strong baseline, while the closed-form trajectory-based attribution is competitive in some metrics without requiring counterfactual retraining or model gradients. Our results show that attribution in flow matching depends not only on semantic similarity to training samples, but also on the latent representation, trajectory dynamics, and how influence is propagated to the final output.

生成模型归因分析流匹配可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。