arXiv:2604.22388cs.CV2026-04

用三分支网络从超声视频精准识别前列腺癌,提升诊断准确率。

HFS-TriNet: A Three-Branch Collaborative Feature Learning Network for Prostate Cancer Classification from TRUS Videos

论文配图:HFS-TriNet: A Three-Branch Collaborative Feature Learning Network for Prostate Cancer Classification from TRUS Videos
图 1 · 摘自论文原文
  • 设计三分支结构:标准网络+医学大模型+小波变换分支协同提取特征。
  • 动态采样策略减少冗余,覆盖完整视频时序,提升训练效率。
  • 适合医疗影像分析、医学图像识别方向的研究者参考。

经直肠超声(TRUS)成像是一种成本低且无创的前列腺癌诊断手段。相较于静态图像,TRUS视频蕴含更丰富的时空信息,有助于提升计算机辅助诊断(CAD)系统的准确性和鲁棒性。然而,视频分析也面临新挑战:信息冗余导致计算开销高;类内与类间相似度高,使特征提取困难;信号噪声比低,影响关键信息识别。为此,本文提出启发式帧选择(HFS)与三分支协作特征学习网络(HFS-TriNet),用于从TRUS视频中分类前列腺癌。具体而言,通过间隔采样视频片段以缓解冗余;采用动态初始化起始点的HFS策略,确保采样片段覆盖整个视频序列。为增强特征提取能力,除常规的ResNet50分支外,还引入:1)基于预训练医学分割一切模型(SAM)的大模型分支,提取每帧深层特征,并结合归一化注意力模块捕捉时间一致性;2)小波变换残差卷积(WTCR)分支,在高频域提取病灶边缘信息,同时在低频域实现降噪。

原文摘要 · Abstract (English)

Transrectal ultrasound (TRUS) imaging is a cost-effective and non-invasive modality widely used in the diagnosis of prostate cancer. The computer-aided diagnosis (CAD) relying on TRUS images has been extensively investigated recently. Compared to static images, TRUS video provides richer spatial-temporal information, which make it a promising alternative for improving the accuracy and robustness of CAD systems. However, TRUS video analysis also introduces new challenges. These include information redundancy, which increases computational costs; high intra- and inter-class similarity, which complicates feature extraction; and a low signal-to-noise ratio, which hinders the identification of clinically relevant information. To address these problems, we propose a heuristic frame selection (HFS) and a three-branch collaborative feature learning network (HFS-TriNet) for prostate cancer classification from TRUS videos. Specifically, selecting a clip of video frames at intervals for training can mitigate redundancy. The HFS strategy dynamically initializes the starting point of each training clip, which ensures that the sampled clips span the entire video sequence. For better feature extraction, besides a regular ResNet50 branch, we also utilize 1) a large model branch based a pre-trained medical segment anything model (SAM) to extract deep features of each frame and a normalization-based attention module to explore the temporal consistency; and 2) a wavelet transform convolutional residual (WTCR) branch that extracts lesion edge information in the high-frequency domain and performs denoising in the low-frequency domain.

前列腺癌视频分析多分支网络医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。