arXiv:2609.07336cs.CV2026-09

实时拼接角膜共聚焦显微图像,提升神经网络评估的准确性与临床可用性。

CRISP: Corneal Confocal Microscopy Real-Time Image Stitching Pipeline

论文配图:CRISP: Corneal Confocal Microscopy Real-Time Image Stitching Pipeline
图 1 · 摘自论文原文
  • 通过聚焦感知筛选和局部配准,实现实时图像拼接。
  • 支持无延迟覆盖反馈,可输出拼接帧、位姿与锚点信息。
  • 首个开源实时拼接框架,适用于常规视频流,推动临床应用。

表层神经丛(SNP)形态反映外周神经健康状态,角膜共聚焦显微镜(CCM)可实现活体、实时、无创的SNP观察。然而主流CCM设备每帧视野有限,而SNP空间分布不均,离散采样易受位置和帧选择影响,限制了其定量评估的可重复性与临床推广。广域拼接可通过整合连续采集的CCM图像重建大范围SNP图谱,但现有方法多依赖离线处理、专用硬件或特定采集协议,缺乏针对常规CCM视频流的开源实时方案。本文提出CRISP(Corneal confocal microscopy Real-time Image Stitching Pipeline),一个面向常规CCM检查视频流的开源实时广域拼接框架。CRISP通过聚焦感知门控排除模糊与断裂片段,基于局部两两配准传播位姿,并利用稀疏锚点地图保持非冗余空间覆盖;当局部时间连续性中断时,系统通过全局外观检索与几何验证完成重定位及子图合并。该框架在检查过程中优先提供低延迟覆盖反馈,同时输出接受帧、位姿与锚点信息以初始化离线精细拼接。据我们所知,CRISP是首个公开发布的针对常规CCM视频流的实时广域拼接框架。通过降低广域拼接的使用与复现门槛,有望推动SNP广域成像从研究工具走向常规临床流程。

原文摘要 · Abstract (English)

Morphology of the sub-basal nerve plexus (SNP) reflects peripheral nerve health, and corneal confocal microscopy (CCM) provides an important means for in vivo, real-time, non-invasive observation of the SNP. However, mainstream CCM devices offer a limited field of view per frame, whereas the SNP is spatially non-uniform; discrete image sampling is therefore sensitive to sampling location and frame selection, which limits the reproducibility and clinical adoption of CCM as a quantitative assessment tool. Wide-field stitching can reconstruct larger SNP mosaics by integrating sequentially acquired CCM images, but existing methods largely rely on offline post-processing, additional hardware, or specific acquisition protocols, and lack open-source real-time solutions for conventional CCM video streams. This paper presents CRISP (Corneal confocal microscopy Real-time Image Stitching Pipeline), an open-source real-time SNP wide-field stitching framework for conventional CCM examination video streams. CRISP excludes defocused and discontinuous segments via focus-aware gating, propagates poses through local pairwise registration, and maintains non-redundant spatial coverage with a sparse anchor map; when local temporal continuity is interrupted, the system completes relocalization and subgraph merging through global appearance retrieval followed by geometric verification. The framework prioritizes low-latency coverage feedback during examination while outputting accepted frames, poses, and anchor information to initialize offline fine stitching. To our knowledge, CRISP is the first open-source real-time SNP wide-field stitching framework released for conventional CCM video streams. By lowering the barrier to adoption and reproduction of wide-field stitching, CRISP may help move SNP wide-field imaging from a research tool into routine clinical examination workflows.

医学影像图像拼接实时处理角膜成像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。