用分源能量模型分离混叠信号,让每个隐变量自主演化成独立声源。
StrEBM: A Structured Latent Energy-Based Model for Blind Source Separation

- 为每个隐变量设计专属能量函数,实现分源结构化表征学习
- 在线性和非线性混合下均有效恢复原始信号成分
- 适合研究可解释的隐空间结构与盲源分离新方法
本文提出StrEBM,一种用于分源结构化表征学习的结构化潜在能量模型。该框架通过为不同潜变量分配可学习的结构偏置,而非用单一共享能量约束整个潜空间,旨在促进可识别且解耦的潜空间组织。以盲源分离为具体验证场景,可直接观察潜变量随训练向不同源成分演化的过程。在所提框架中,潜变量轨迹与观测生成映射、分源结构参数一同优化。每个潜变量采用独立的能量函数,使不同潜成分在训练中逐渐演化为特定源角色。本研究使用类高斯过程能量函数,引入可学习长度尺度,但该框架不限于高斯过程,具有更通用的结构化潜能量模型潜力。在合成多通道信号上,无论线性或非线性混合,模型均能有效恢复源成分,初步验证了框架可行性。同时发现训练后期收敛缓慢、非线性观测映射下稳定性下降等优化特性。这些结果不仅揭示当前基于高斯过程实例的行为特征,也为未来探索更丰富的分源能量族与更鲁棒的非线性优化策略奠定基础。
原文摘要 · Abstract (English)
This paper proposes StrEBM, a structured latent energy-based model for source-wise structured representation learning. The framework is motivated by a broader goal of promoting identifiable and decoupled latent organization by assigning different latent dimensions their own learnable structural biases, rather than constraining the entire latent representation with a single shared energy. In this sense, blind source separation is adopted here as a concrete and verifiable testbed, through which the evolution of latent dimensions toward distinct underlying components can be directly examined. In the proposed framework, latent trajectories are optimized directly together with an observation-generation map and source-wise structural parameters. Each latent dimension is associated with its own energy-based formulation, allowing different latent components to gradually evolve toward distinct source-like roles during training. In the present study, this source-wise energy design is instantiated using Gaussian-process-inspired energies with learnable length-scales, but the framework itself is not restricted to Gaussian processes and is intended as a more general structured latent EBM formulation. Experiments on synthetic multichannel signals under linear and nonlinear mixing settings show that the proposed model can recover source components effectively, providing an initial empirical validation of the framework. At the same time, the study reveals important optimization characteristics, including slow late-stage convergence and reduced stability under nonlinear observation mappings. These findings not only clarify the practical behavior of the current GP-based instantiation, but also establish a basis for future investigation of richer source-wise energy families and more robust nonlinear optimization strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。