arXiv:2608.08402cs.CV2026-08

用AI解决光纤内窥镜成像模糊问题,实现高分辨率活体近红外成像。

Agentic AI-powered flexible fiber-bundle endoscopy for high-resolution NIR-II fluorescence imaging in vivo

  • 通过光学与计算协同设计优化纤束,减少串扰和图像失真。
  • 采用AI模型实现蜂窝伪影去除,重建图像分辨率提升四倍。
  • 适用于小鼠、人体组织等多场景,适合临床转化研究者。

光纤束内窥镜为经自然腔道进行临床荧光成像提供了紧凑灵活的路径,但自1950年首次报道以来,受限于低空间分辨率、蜂窝伪影及芯间串扰。这一问题在近红外-II波段(NIR-II,1000–3000 nm)尤为显著,尽管该波段具备更优对比度、分辨率和组织穿透深度。本文提出一种由人工智能驱动的柔性内窥镜平台,通过光学-计算协同设计突破上述限制:优化超细光纤束以抑制串扰引起的图像模糊,并实现从可见光到NIR-II波段的高保真图像传输;同时开发了基于视觉-语言模型的代理引导专家混合(AGENT-Guided Mixture-of-Experts, GAME)流程,动态路由输入至合适修复专家,实现蜂窝伪影消除与图像恢复。GAME提供单一修复入口,兼容细胞、小鼠及人体样本等多种生物医学图像。该系统使图像重建分辨率超越奈奎斯特-香农采样极限四倍。其应用在活体小鼠中成功实现了解剖结构的NIR-II成像,并对数字微镜器件(DMD)投影的人类胃管与淋巴系统进行了成像,为未来临床转化奠定基础。

原文摘要 · Abstract (English)

Fiber-bundle endoscopy offers a compact and flexible route for clinical fluorescence imaging through natural human orifices, but since its first report in the 1950s, it has remained limited by low spatial resolution, honeycomb artifacts, and inter-core crosstalk. The crosstalk becomes more pronounced at near-infrared-II wavelengths (NIR-II, 1000-3000 nm), a spectral window that offers superior contrast, resolution, and tissue penetration depth for biomedical imaging. Here, we present an AI-powered flexible endoscopy platform that overcomes these constraints through optical-computational co-design: optimizing ultrathin fiber bundles to mitigate crosstalk-induced image blur and enable high-fidelity image transmission across the visible-to-NIR-II spectral range, and developing an Agent-Guided Mixture-of-Experts (GAME) pipeline for honeycomb-artifact removal and image restoration. GAME provides a single restoration entry point for diverse biomedical images acquired with our endoscope, spanning cell, mouse and human samples. It dynamically routes each input to suitable restoration experts via a vision-language model, facilitating image reconstruction with a fourfold resolution improvement beyond the NyquistShannon sampling limit. The utility of our endoscope is demonstrated through in vivo NIR-II imaging of anatomical structures in mice, as well as imaging of the digital micromirror device (DMD)-projected human gastric tube and lymphatic system, paving the way for future clinical translation.

内窥镜AI成像NIR-II纤维束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。