arXiv:2603.25951cs.CV2026-03被引 1

提出低秩调制框架,让超声视频的隐空间可解释且高效

Low-Rank-Modulated Functa: Exploring the Latent Space of Implicit Neural Representations for Interpretable Ultrasound Video Analysis

  • 用低秩约束调制向量,构建时序结构化的隐空间
  • 仅用秩2就能还原心脏周期帧,准确识别收缩末期和舒张末期
  • 适合需要可解释性与轻量化分析的医疗视频场景

隐式神经表示(INRs)在连续图像建模中表现优异。现有基于Functa的方法将每帧图像编码为共享INR的调制向量,但其隐空间结构与可解释性仍不明确。本文针对超声视频提出低秩调制Functa(LRM-Functa),强制在时间维度上对调制向量施加低秩约束。应用于心脏超声数据时,隐空间呈现清晰的周期性轨迹,支持直观可视化与时间模式解析。通过遍历隐空间可生成平滑的周期性帧序列,并直接读出收缩末期(ES)与舒张末期(ED)帧,无需额外训练。实验表明,该方法在无监督检测ED/ES帧上优于已有方法,且每帧压缩至秩k=2仍保持优秀的心脏射血分数预测性能。在心超床旁数据集上的分布外帧选择以及肺部超声B线分类任务中也展现出良好泛化能力。总体而言,LRM-Functa提供了一个紧凑、可解释且通用的超声视频分析框架。代码已开源。

原文摘要 · Abstract (English)

Implicit neural representations (INRs) have emerged as a powerful framework for continuous image representation learning. In Functa-based approaches, each image is encoded as a latent modulation vector that conditions a shared INR, enabling strong reconstruction performance. However, the structure and interpretability of the corresponding latent spaces remain largely unexplored. In this work, we investigate the latent space of Functa-based models for ultrasound videos and propose Low-Rank-Modulated Functa (LRM-Functa), a novel architecture that enforces a low-rank adaptation of modulation vectors in the time-resolved latent space. When applied to cardiac ultrasound, the resulting latent space exhibits clearly structured periodic trajectories, facilitating visualization and interpretability of temporal patterns. The latent space can be traversed to sample novel frames, revealing smooth transitions along the cardiac cycle, and enabling direct readout of end-diastolic (ED) and end-systolic (ES) frames without additional model training. We show that LRM-Functa outperforms prior methods in unsupervised ED and ES frame detection, while compressing each video frame to as low as rank k=2 without sacrificing competitive downstream performance on ejection fraction prediction. Evaluations on out-of-distribution frame selection in a cardiac point-of-care dataset, as well as on lung ultrasound for B-line classification, demonstrate the generalizability of our approach. Overall, LRM-Functa provides a compact, interpretable, and generalizable framework for ultrasound video analysis. The code is available at https://github.com/JuliaWolleb/LRM_Functa.

超声视频隐空间可解释性低秩建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。