用神经隐式表示压缩超声视频,提升分析通用性与效率
VidFuncta: Towards Generalizable Neural Representations for Ultrasound Videos
- 将超声视频分解为静态向量和随时间变化的调制向量
- 在三个数据集上重建效果优于2D/3D基线,下游任务直接使用调制向量
- 适合医学影像分析、视频压缩及跨任务迁移研究者
超声在临床中广泛应用,但标准深度学习方法因采集不统一和操作者偏差,在完整视频分析上表现不佳。本文提出VidFuncta,基于隐式神经表示(INR)框架Functa,将可变长度的超声视频编码为紧凑的时间解析表示。该方法将每段视频解耦为一个特定于视频的静态向量和一系列时变调制向量,同时捕捉动态变化与数据集级冗余。实验在心脏、肺部和乳腺三个公开超声视频数据集上验证,其视频重建性能超越2D与3D基线,并支持直接以1D调制向量进行下游任务。评估包括射血分数预测、B线检测和乳腺病灶分类,结果表明VidFuncta具备良好的泛化能力与效率。代码已开源。
原文摘要 · Abstract (English)
Ultrasound is widely used in clinical care, yet standard deep learning methods often struggle with full video analysis due to non-standardized acquisition and operator bias. We offer a new perspective on ultrasound video analysis through implicit neural representations (INRs). We build on Functa, an INR framework in which each image is represented by a modulation vector that conditions a shared neural network. However, its extension to the temporal domain of medical videos remains unexplored. To address this gap, we propose VidFuncta, a novel framework that leverages Functa to encode variable-length ultrasound videos into compact, time-resolved representations. VidFuncta disentangles each video into a static video-specific vector and a sequence of time-dependent modulation vectors, capturing both temporal dynamics and dataset-level redundancies. Our method outperforms 2D and 3D baselines on video reconstruction and enables downstream tasks to directly operate on the learned 1D modulation vectors. We validate VidFuncta on three public ultrasound video datasets -- cardiac, lung, and breast -- and evaluate its downstream performance on ejection fraction prediction, B-line detection, and breast lesion classification. These results highlight the potential of VidFuncta as a generalizable and efficient representation framework for ultrasound videos. Our code is publicly available under https://github.com/JuliaWolleb/VidFuncta_public.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。