解决生态网络检测不全下的稀疏结构推断问题
Sparse Network Inference under Imperfect Detection and its Application to Ecological Networks

- 用非凸正则化建模组内相似与组间连接的稀疏性
- 在真实和合成数据上显著提升结构恢复精度
- 适合处理检测不全、稀疏且尺度失衡的生态网络
从计数数据中恢复潜在结构在网络推断中备受关注,尤其在需要同时捕捉双分网络中跨组交互与组内相似模式的生态研究中。此类网络通常稀疏且检测不完全。现有模型多聚焦于交互恢复,对诱导的相似图研究较少。此外,稀疏性常未受控,尺度不平衡,导致估计过度稀疏或缩放不当,影响结构恢复。为此,我们提出一种结构化稀疏非负低秩分解框架,并估计检测概率。对潜在相似性和连通性结构施加非凸ℓ₁/₂正则化,以促进组内相似与跨组连接的稀疏性及更好的相对尺度。优化问题为非凸非光滑。我们设计基于ADMM的自适应惩罚算法与尺度感知初始化,并在温和正则条件下证明其渐近可行性与聚点的KKT平稳性。在合成与真实生态数据集上的实验表明,相比现有基线,本方法显著提升潜在因子及相似/连通结构的恢复效果。
原文摘要 · Abstract (English)
Recovering latent structure from count data has received considerable attention in network inference, particularly when one seeks both cross-group interactions and within-group similarity patterns in bipartite networks, which is widely used in ecology research. Such networks are often sparse and inherently imperfect in their detection. Existing models mainly focus on interaction recovery, while the induced similarity graphs are much less studied. Moreover, sparsity is often not controlled, and scale is unbalanced, leading to oversparse or poorly rescaled estimates with degrading structural recovery. To address these issues, we propose a framework for structured sparse nonnegative low-rank factorization with detection probability estimation. We impose nonconvex $\ell_{1/2}$ regularization on the latent similarity and connectivity structures to promote sparsity within-group similarity and cross-group connectivity with better relative scale. The resulting optimization problem is nonconvex and nonsmooth. To solve it, we develop an ADMM-based algorithm with adaptive penalization and scale-aware initialization and establish its asymptotic feasibility and KKT stationarity of cluster points under mild regularity conditions. Experiments on synthetic and real-world ecological datasets demonstrate improved recovery of latent factors and similarity/connectivity structure relative to existing baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。