用积分弦替代梯度,提升密度比估计的稳定性和效率。
Diffusion Secant Alignment for Score-Based Density Ratio Estimation
- 用区间积分的弦代替瞬时梯度作为学习目标,降低方差。
- 在相同精度下减少函数求值次数,且在分布差异大时仍稳定。
- 适合需要高鲁棒性的密度比估计场景,如生成模型训练。
随着基于得分和扩散的方法兴起,密度比估计的重要性日益凸显。现有基于切线的方法依赖高方差的学习目标,导致训练不稳定且推理时需昂贵的数值积分。本文提出区间退火的弦对齐密度比估计(ISA-DRE),一种基于扩散插值的得分框架,将瞬时切线替换为区间积分的弦作为学习目标。理论上证明弦具有更低方差、更平滑的特性,并严格包含切线作为无穷小极限。为实现弦学习,引入弦对齐恒等式(SAI)确保弦与切线表示的一致性,以及收缩区间退火(CIA)保障稳定收敛。实验表明,该稳定性优先的框架在函数求值次数更少的情况下达到相当或更优性能,在分布差异大的情况下表现稳健,有效缓解密度深渊问题。
原文摘要 · Abstract (English)
Estimating density ratios has become increasingly important with the recent rise of score-based and diffusion-inspired methods. However, current tangent-based approaches rely on a high-variance learning objective, which leads to unstable training and costly numerical integration during inference. We propose \textit{Interval-annealed Secant Alignment Density Ratio Estimation (ISA-DRE)}, a score-based framework along diffusion interpolants that replaces the instantaneous tangent with its interval integral, the secant, as the learning target. We show theoretically that the secant is a provably lower variance and smoother target for neural approximation, and also a strictly more general representation that contains the tangent as the infinitesimal limit. To make secant learning feasible, we introduce the \textit{Secant Alignment Identity (SAI)} to enforce self consistency between secant and tangent representations, and \textit{Contraction Interval Annealing (CIA)} to ensure stable convergence. Empirically, this stability-first formulation produces high efficiency and accuracy. ISA-DRE achieves comparable or superior results with fewer function evaluations, demonstrating robustness under large distribution discrepancies and effectively mitigating the density-chasm problem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。